2024-05-24T22:54:56.709659382Z .. 2024-05-24T22:54:57.339101294Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-05-24T22:54:58.669328940Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-05-24T22:55:04.127874548Z [2024-05-24T22:55:04.122+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-05-24T22:55:05.131413734Z [2024-05-24T22:55:05.130+0000] {db.py:755} INFO - Waiting for migrations... 1 second(s) 2024-05-24T22:55:06.133343810Z [2024-05-24T22:55:06.132+0000] {db.py:755} INFO - Waiting for migrations... 2 second(s) 2024-05-24T22:55:18.398883576Z 2024-05-24T22:55:19.417673832Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-05-24T22:55:21.977634093Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-05-24T22:55:26.896685794Z [2024-05-24 22:55:26 +0000] [16] [INFO] Starting gunicorn 20.1.0 2024-05-24T22:55:26.910352539Z [2024-05-24 22:55:26 +0000] [16] [INFO] Listening at: http://[::]:8793 (16) 2024-05-24T22:55:26.910366381Z [2024-05-24 22:55:26 +0000] [16] [INFO] Using worker: sync 2024-05-24T22:55:26.929014447Z [2024-05-24 22:55:26 +0000] [17] [INFO] Booting worker with pid: 17 2024-05-24T22:55:26.970244505Z [2024-05-24 22:55:26 +0000] [18] [INFO] Booting worker with pid: 18 2024-05-24T22:55:29.473839934Z 2024-05-24T22:55:29.473858133Z -------------- celery@airflow-worker-0 v5.2.7 (dawn-chorus) 2024-05-24T22:55:29.473863122Z --- ***** ----- 2024-05-24T22:55:29.473867404Z -- ******* ---- Linux-5.15.0-47-generic-x86_64-with-glibc2.31 2024-05-24 22:55:29 2024-05-24T22:55:29.473870774Z - *** --- * --- 2024-05-24T22:55:29.473874533Z - ** ---------- [config] 2024-05-24T22:55:29.473878677Z - ** ---------- .> app: airflow.executors.celery_executor:0x7efd6836ec50 2024-05-24T22:55:29.473882044Z - ** ---------- .> transport: redis://:**@airflow-redis:6379/0 2024-05-24T22:55:29.473892207Z - ** ---------- .> results: postgresql://postgres:**@airflow-postgresql.osm:5432/postgres 2024-05-24T22:55:29.473897299Z - *** --- * --- .> concurrency: 16 (prefork) 2024-05-24T22:55:29.473900869Z -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker) 2024-05-24T22:55:29.473904321Z --- ***** ----- 2024-05-24T22:55:29.473907688Z -------------- [queues] 2024-05-24T22:55:29.473911158Z .> default exchange=default(direct) key=default 2024-05-24T22:55:29.473914487Z 2024-05-24T22:55:29.473917699Z 2024-05-24T22:55:29.473921512Z [tasks] 2024-05-24T22:55:29.473929419Z . airflow.executors.celery_executor.execute_command 2024-05-24T22:55:29.473932875Z 2024-05-24T22:55:34.433330531Z [2024-05-24 22:55:34,418: INFO/MainProcess] Connected to redis://:**@airflow-redis:6379/0 2024-05-24T22:55:34.434954010Z [2024-05-24 22:55:34,434: INFO/MainProcess] mingle: searching for neighbors 2024-05-24T22:55:35.450700639Z [2024-05-24 22:55:35,450: INFO/MainProcess] mingle: all alone 2024-05-24T22:55:35.475104342Z [2024-05-24 22:55:35,474: INFO/MainProcess] celery@airflow-worker-0 ready. 2024-05-24T22:56:29.601388586Z [2024-05-24 22:56:29,600: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[613e61da-444e-4f13-b463-bf9c299fb3f0] received 2024-05-24T22:56:29.683742894Z [2024-05-24 22:56:29,682: INFO/ForkPoolWorker-15] [613e61da-444e-4f13-b463-bf9c299fb3f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T22:56:30.106554824Z [2024-05-24 22:56:30,103: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T22:56:30.458496189Z [2024-05-24 22:56:30,458: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T22:57:01.099250336Z [2024-05-24 22:57:01,098: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[613e61da-444e-4f13-b463-bf9c299fb3f0] succeeded in 31.495074262999992s: None 2024-05-24T22:57:11.190061057Z [2024-05-24 22:57:11,189: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7106c08c-fbeb-469f-b112-d66952bf2f18] received 2024-05-24T22:57:11.199595281Z [2024-05-24 22:57:11,199: INFO/ForkPoolWorker-15] [7106c08c-fbeb-469f-b112-d66952bf2f18] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T22:57:11.515473273Z [2024-05-24 22:57:11,512: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T22:57:11.756839947Z [2024-05-24 22:57:11,756: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T22:57:20.659623446Z [2024-05-24 22:57:20,659: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7106c08c-fbeb-469f-b112-d66952bf2f18] succeeded in 9.467573018999929s: None 2024-05-24T22:58:00.163356264Z [2024-05-24 22:58:00,162: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ea46060-2418-42b1-805a-c782332245b2] received 2024-05-24T22:58:00.177037447Z [2024-05-24 22:58:00,176: INFO/ForkPoolWorker-15] [6ea46060-2418-42b1-805a-c782332245b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T22:58:00.533652597Z [2024-05-24 22:58:00,530: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T22:58:00.867907541Z [2024-05-24 22:58:00,867: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T22:58:01.555273328Z [2024-05-24 22:58:01,554: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6ea46060-2418-42b1-805a-c782332245b2] succeeded in 1.3852991979999842s: None 2024-05-24T23:00:01.108572485Z [2024-05-24 23:00:01,107: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11596b86-ae6d-4dea-bfdc-3a10e366a5cb] received 2024-05-24T23:00:01.131467567Z [2024-05-24 23:00:01,131: INFO/ForkPoolWorker-15] [11596b86-ae6d-4dea-bfdc-3a10e366a5cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:00:01.467668894Z [2024-05-24 23:00:01,463: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:00:01.766160000Z [2024-05-24 23:00:01,765: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:00:02.379964133Z [2024-05-24 23:00:02,378: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[11596b86-ae6d-4dea-bfdc-3a10e366a5cb] succeeded in 1.2645781429999943s: None 2024-05-24T23:02:00.764155823Z [2024-05-24 23:02:00,763: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af9692c7-c926-4ae9-b8e4-46ea3feabe30] received 2024-05-24T23:02:00.783508853Z [2024-05-24 23:02:00,782: INFO/ForkPoolWorker-15] [af9692c7-c926-4ae9-b8e4-46ea3feabe30] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:02:01.134269007Z [2024-05-24 23:02:01,130: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:02:01.445110155Z [2024-05-24 23:02:01,444: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:02:02.004976554Z [2024-05-24 23:02:02,004: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[af9692c7-c926-4ae9-b8e4-46ea3feabe30] succeeded in 1.2362442460000693s: None 2024-05-24T23:03:57.387972889Z [2024-05-24 23:03:57,387: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a8f4aa47-503a-4fc9-b4a1-26f23d6f9c12] received 2024-05-24T23:03:57.403377581Z [2024-05-24 23:03:57,403: INFO/ForkPoolWorker-15] [a8f4aa47-503a-4fc9-b4a1-26f23d6f9c12] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:03:57.622859297Z [2024-05-24 23:03:57,622: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8bf06932-0bfd-4368-bd23-461443b37206] received 2024-05-24T23:03:57.770927633Z [2024-05-24 23:03:57,770: INFO/ForkPoolWorker-16] [8bf06932-0bfd-4368-bd23-461443b37206] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:03:57.951444309Z [2024-05-24 23:03:57,946: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:03:58.256127545Z [2024-05-24 23:03:58,252: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:03:59.337466007Z [2024-05-24 23:03:59,337: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:03:59.341514960Z [2024-05-24 23:03:59,341: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:03:59.387250980Z [2024-05-24 23:03:59,386: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:03:59.389903404Z [2024-05-24 23:03:59,389: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:03:59.390094566Z [2024-05-24 23:03:59,389: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:03:59.390298128Z [2024-05-24 23:03:59,390: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:03:59.390438034Z [2024-05-24 23:03:59,390: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:03:59.390886649Z [2024-05-24 23:03:59,390: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:03:59.391017491Z [2024-05-24 23:03:59,390: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:03:59.457708596Z [2024-05-24 23:03:59,457: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:03:59.460810056Z [2024-05-24 23:03:59,460: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:03:59.484742095Z [2024-05-24 23:03:59,484: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:03:59.486046416Z [2024-05-24 23:03:59,485: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:03:59.486127655Z [2024-05-24 23:03:59,485: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:03:59.486322772Z [2024-05-24 23:03:59,486: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:03:59.486468166Z [2024-05-24 23:03:59,486: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:03:59.486711127Z [2024-05-24 23:03:59,486: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:03:59.486756810Z [2024-05-24 23:03:59,486: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:03:59.518686601Z [2024-05-24 23:03:59,518: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:03:59.570426192Z [2024-05-24 23:03:59,570: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:04:00.299179726Z [2024-05-24 23:04:00,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be8dc7d9-7107-4104-adf3-87ac75310c11] received 2024-05-24T23:04:00.303411752Z [2024-05-24 23:04:00,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[40da13b1-4008-4f4e-86e8-ffbe4fe15f6f] received 2024-05-24T23:04:00.348548883Z [2024-05-24 23:04:00,348: INFO/ForkPoolWorker-1] [be8dc7d9-7107-4104-adf3-87ac75310c11] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:04:00.358031053Z [2024-05-24 23:04:00,357: INFO/ForkPoolWorker-2] [40da13b1-4008-4f4e-86e8-ffbe4fe15f6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:04:00.699890348Z [2024-05-24 23:04:00,696: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:04:00.704159410Z [2024-05-24 23:04:00,701: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:04:01.013912790Z [2024-05-24 23:04:01,013: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:04:01.777453968Z [2024-05-24 23:04:01,777: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a937598-4e2a-4781-b86d-e0e1f60c842a] received 2024-05-24T23:04:01.815035012Z [2024-05-24 23:04:01,814: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[be8dc7d9-7107-4104-adf3-87ac75310c11] succeeded in 1.5134537169999476s: None 2024-05-24T23:04:01.819897868Z [2024-05-24 23:04:01,819: INFO/ForkPoolWorker-3] [4a937598-4e2a-4781-b86d-e0e1f60c842a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:04:02.187012483Z [2024-05-24 23:04:02,183: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a8f4aa47-503a-4fc9-b4a1-26f23d6f9c12] succeeded in 4.793407553999941s: None 2024-05-24T23:04:02.213341771Z [2024-05-24 23:04:02,204: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:04:02.284683264Z [2024-05-24 23:04:02,284: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:04:02.290595044Z [2024-05-24 23:04:02,290: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:04:02.338356572Z [2024-05-24 23:04:02,338: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:04:02.339489954Z [2024-05-24 23:04:02,339: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:04:02.339596815Z [2024-05-24 23:04:02,339: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:04:02.339789054Z [2024-05-24 23:04:02,339: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:04:02.339865106Z [2024-05-24 23:04:02,339: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:04:02.340072314Z [2024-05-24 23:04:02,339: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:04:02.340116663Z [2024-05-24 23:04:02,340: INFO/ForkPoolWorker-2] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:04:02.431237166Z [2024-05-24 23:04:02,430: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:04:02.459669878Z [2024-05-24 23:04:02,459: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-24T23:04:02.465884102Z [2024-05-24 23:04:02,465: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:04:02.519041092Z [2024-05-24 23:04:02,518: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8bf06932-0bfd-4368-bd23-461443b37206] succeeded in 4.892665670000042s: None 2024-05-24T23:04:02.531080532Z [2024-05-24 23:04:02,530: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-24T23:04:02.532068274Z [2024-05-24 23:04:02,531: INFO/ForkPoolWorker-3] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:04:02.532129618Z [2024-05-24 23:04:02,532: INFO/ForkPoolWorker-3] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:04:02.532185152Z [2024-05-24 23:04:02,532: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-24T23:04:02.532357207Z [2024-05-24 23:04:02,532: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:04:02.652826159Z [2024-05-24 23:04:02,652: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:04:03.354032428Z [2024-05-24 23:04:03,353: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[4a937598-4e2a-4781-b86d-e0e1f60c842a] succeeded in 1.573623176999945s: None 2024-05-24T23:04:04.101065931Z [2024-05-24 23:04:04,100: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[40da13b1-4008-4f4e-86e8-ffbe4fe15f6f] succeeded in 3.7915564659999745s: None 2024-05-24T23:04:04.271648618Z [2024-05-24 23:04:04,271: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba0e3281-7009-451e-a4dd-a76fd5a48217] received 2024-05-24T23:04:04.286363356Z [2024-05-24 23:04:04,286: INFO/ForkPoolWorker-15] [ba0e3281-7009-451e-a4dd-a76fd5a48217] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:04:04.624519180Z [2024-05-24 23:04:04,621: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:04:05.746337336Z [2024-05-24 23:04:05,745: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:04:05.748749351Z [2024-05-24 23:04:05,748: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:04:05.778272624Z [2024-05-24 23:04:05,777: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:04:05.780872429Z [2024-05-24 23:04:05,780: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:04:05.781002778Z [2024-05-24 23:04:05,780: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:04:05.781409483Z [2024-05-24 23:04:05,781: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:04:05.782014473Z [2024-05-24 23:04:05,781: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:04:05.782828202Z [2024-05-24 23:04:05,782: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:04:05.783015570Z [2024-05-24 23:04:05,782: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:04:05.870364288Z [2024-05-24 23:04:05,870: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:04:09.479663584Z [2024-05-24 23:04:09,479: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ba0e3281-7009-451e-a4dd-a76fd5a48217] succeeded in 5.205550264999829s: None 2024-05-24T23:04:17.808929893Z [2024-05-24 23:04:17,808: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f80977fe-9f52-4e3b-b743-d9f8e1867e4e] received 2024-05-24T23:04:17.817040312Z [2024-05-24 23:04:17,816: INFO/ForkPoolWorker-15] [f80977fe-9f52-4e3b-b743-d9f8e1867e4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:04:18.207304170Z [2024-05-24 23:04:18,204: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:04:19.356223975Z [2024-05-24 23:04:19,355: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:04:19.359728109Z [2024-05-24 23:04:19,359: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:04:19.381363217Z [2024-05-24 23:04:19,381: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:04:19.383909244Z [2024-05-24 23:04:19,383: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:04:19.384035619Z [2024-05-24 23:04:19,383: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:04:19.384147705Z [2024-05-24 23:04:19,383: INFO/ForkPoolWorker-15] Read VIM ecec2318-e808-4328-be1c-1c2aff703fb0 (basic01_985978) 2024-05-24T23:04:19.384384651Z [2024-05-24 23:04:19,384: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ecec2318-e808-4328-be1c-1c2aff703fb0', 'name': 'basic01_985978', 'vim_type': 'openstack'}] 2024-05-24T23:04:19.384506348Z [2024-05-24 23:04:19,384: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:04:19.384898184Z [2024-05-24 23:04:19,384: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:04:19.385289780Z [2024-05-24 23:04:19,384: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:04:19.391431933Z [2024-05-24 23:04:19,391: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 2024-05-24T23:04:19.476360098Z [2024-05-24 23:04:19,476: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:04:20.015392143Z [2024-05-24 23:04:20,014: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f80977fe-9f52-4e3b-b743-d9f8e1867e4e] succeeded in 2.204053806000047s: None 2024-05-24T23:04:20.146023626Z [2024-05-24 23:04:20,145: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc93d091-99da-4445-bd7f-9cf096b63506] received 2024-05-24T23:04:20.161144734Z [2024-05-24 23:04:20,160: INFO/ForkPoolWorker-15] [bc93d091-99da-4445-bd7f-9cf096b63506] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:04:20.452743289Z [2024-05-24 23:04:20,449: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:04:21.589170525Z [2024-05-24 23:04:21,588: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:04:21.592481130Z [2024-05-24 23:04:21,592: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:04:21.610881158Z [2024-05-24 23:04:21,610: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:04:21.612189474Z [2024-05-24 23:04:21,611: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:04:21.612217594Z [2024-05-24 23:04:21,612: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:04:21.612226112Z [2024-05-24 23:04:21,612: INFO/ForkPoolWorker-15] Read VIM ecec2318-e808-4328-be1c-1c2aff703fb0 (basic01_985978) 2024-05-24T23:04:21.612389592Z [2024-05-24 23:04:21,612: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ecec2318-e808-4328-be1c-1c2aff703fb0', 'name': 'basic01_985978', 'vim_type': 'openstack'}] 2024-05-24T23:04:21.612499357Z [2024-05-24 23:04:21,612: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:04:21.612981117Z [2024-05-24 23:04:21,612: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:04:21.612991618Z [2024-05-24 23:04:21,612: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:04:21.618884940Z [2024-05-24 23:04:21,618: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 2024-05-24T23:04:21.697987663Z [2024-05-24 23:04:21,697: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:04:22.396987251Z [2024-05-24 23:04:22,396: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bc93d091-99da-4445-bd7f-9cf096b63506] succeeded in 2.2457619509998494s: None 2024-05-24T23:04:22.959209713Z [2024-05-24 23:04:22,958: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4306a38-d8a9-46cd-a1d0-4cbd7f18902a] received 2024-05-24T23:04:22.971855654Z [2024-05-24 23:04:22,971: INFO/ForkPoolWorker-15] [e4306a38-d8a9-46cd-a1d0-4cbd7f18902a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:04:23.275254003Z [2024-05-24 23:04:23,272: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:04:24.381764253Z [2024-05-24 23:04:24,381: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:04:24.384885458Z [2024-05-24 23:04:24,384: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:04:24.405105846Z [2024-05-24 23:04:24,404: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:04:24.406405258Z [2024-05-24 23:04:24,406: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:04:24.406421521Z [2024-05-24 23:04:24,406: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:04:24.406431755Z [2024-05-24 23:04:24,406: INFO/ForkPoolWorker-15] Read VIM ecec2318-e808-4328-be1c-1c2aff703fb0 (basic01_985978) 2024-05-24T23:04:24.406551545Z [2024-05-24 23:04:24,406: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ecec2318-e808-4328-be1c-1c2aff703fb0', 'name': 'basic01_985978', 'vim_type': 'openstack'}] 2024-05-24T23:04:24.406559419Z [2024-05-24 23:04:24,406: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:04:24.406733704Z [2024-05-24 23:04:24,406: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:04:24.406793449Z [2024-05-24 23:04:24,406: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:04:24.412708334Z [2024-05-24 23:04:24,412: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 2024-05-24T23:04:24.493128305Z [2024-05-24 23:04:24,492: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:04:25.002560506Z [2024-05-24 23:04:25,002: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e4306a38-d8a9-46cd-a1d0-4cbd7f18902a] succeeded in 2.038479352999957s: None 2024-05-24T23:04:25.306444068Z [2024-05-24 23:04:25,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c09f8767-5d3e-45ee-b41a-d8c0e1931693] received 2024-05-24T23:04:25.324351372Z [2024-05-24 23:04:25,323: INFO/ForkPoolWorker-15] [c09f8767-5d3e-45ee-b41a-d8c0e1931693] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:04:25.590713787Z [2024-05-24 23:04:25,587: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:04:26.800976689Z [2024-05-24 23:04:26,800: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:04:26.807025599Z [2024-05-24 23:04:26,805: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:04:26.834830808Z [2024-05-24 23:04:26,834: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:04:26.836110906Z [2024-05-24 23:04:26,835: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:04:26.836132562Z [2024-05-24 23:04:26,835: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:04:26.836136197Z [2024-05-24 23:04:26,836: INFO/ForkPoolWorker-15] Read VIM ecec2318-e808-4328-be1c-1c2aff703fb0 (basic01_985978) 2024-05-24T23:04:26.836444823Z [2024-05-24 23:04:26,836: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ecec2318-e808-4328-be1c-1c2aff703fb0', 'name': 'basic01_985978', 'vim_type': 'openstack'}] 2024-05-24T23:04:26.836467131Z [2024-05-24 23:04:26,836: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:04:26.836665851Z [2024-05-24 23:04:26,836: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:04:26.836671277Z [2024-05-24 23:04:26,836: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:04:26.842233276Z [2024-05-24 23:04:26,842: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 2024-05-24T23:04:26.926983038Z [2024-05-24 23:04:26,926: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:04:27.484046195Z [2024-05-24 23:04:27,483: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c09f8767-5d3e-45ee-b41a-d8c0e1931693] succeeded in 2.17449977199999s: None 2024-05-24T23:04:29.322441174Z [2024-05-24 23:04:29,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93b1e7b3-cba9-4ee2-9407-c2fe9536d308] received 2024-05-24T23:04:29.324064037Z [2024-05-24 23:04:29,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ca91e7e-4fde-4919-8822-9804013c0ba7] received 2024-05-24T23:04:29.334532363Z [2024-05-24 23:04:29,334: INFO/ForkPoolWorker-15] [93b1e7b3-cba9-4ee2-9407-c2fe9536d308] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:04:29.342242719Z [2024-05-24 23:04:29,342: INFO/ForkPoolWorker-16] [4ca91e7e-4fde-4919-8822-9804013c0ba7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:04:29.638990779Z [2024-05-24 23:04:29,635: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:04:29.656554556Z [2024-05-24 23:04:29,652: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:04:30.874944120Z [2024-05-24 23:04:30,874: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:04:30.878777975Z [2024-05-24 23:04:30,878: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:04:30.895550714Z [2024-05-24 23:04:30,895: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:04:30.896746610Z [2024-05-24 23:04:30,896: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:04:30.896757900Z [2024-05-24 23:04:30,896: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:04:30.896843788Z [2024-05-24 23:04:30,896: INFO/ForkPoolWorker-16] Read VIM ecec2318-e808-4328-be1c-1c2aff703fb0 (basic01_985978) 2024-05-24T23:04:30.897008549Z [2024-05-24 23:04:30,896: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ecec2318-e808-4328-be1c-1c2aff703fb0', 'name': 'basic01_985978', 'vim_type': 'openstack'}] 2024-05-24T23:04:30.897107703Z [2024-05-24 23:04:30,896: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:04:30.897354845Z [2024-05-24 23:04:30,897: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:04:30.897422661Z [2024-05-24 23:04:30,897: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:04:30.901349176Z [2024-05-24 23:04:30,901: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 2024-05-24T23:04:30.901741091Z [2024-05-24 23:04:30,901: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:04:30.905623329Z [2024-05-24 23:04:30,905: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:04:30.932528807Z [2024-05-24 23:04:30,932: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:04:30.934945966Z [2024-05-24 23:04:30,934: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:04:30.935187249Z [2024-05-24 23:04:30,935: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:04:30.935372376Z [2024-05-24 23:04:30,935: INFO/ForkPoolWorker-15] Read VIM ecec2318-e808-4328-be1c-1c2aff703fb0 (basic01_985978) 2024-05-24T23:04:30.935666315Z [2024-05-24 23:04:30,935: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ecec2318-e808-4328-be1c-1c2aff703fb0', 'name': 'basic01_985978', 'vim_type': 'openstack'}] 2024-05-24T23:04:30.935846122Z [2024-05-24 23:04:30,935: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:04:30.936215951Z [2024-05-24 23:04:30,936: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:04:30.936408775Z [2024-05-24 23:04:30,936: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:04:30.942003006Z [2024-05-24 23:04:30,941: INFO/ForkPoolWorker-15] Creating DAG vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0 2024-05-24T23:04:30.977306011Z [2024-05-24 23:04:30,977: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:04:31.030590122Z [2024-05-24 23:04:31,030: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:04:32.468950010Z [2024-05-24 23:04:32,468: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[93b1e7b3-cba9-4ee2-9407-c2fe9536d308] succeeded in 3.143901827000036s: None 2024-05-24T23:04:32.713942900Z [2024-05-24 23:04:32,713: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4ca91e7e-4fde-4919-8822-9804013c0ba7] succeeded in 3.37679822400014s: None 2024-05-24T23:04:49.437145525Z [2024-05-24 23:04:49,436: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25a1b55a-3778-4c88-ab9f-761bdd4b9425] received 2024-05-24T23:04:49.451440731Z [2024-05-24 23:04:49,451: INFO/ForkPoolWorker-15] [25a1b55a-3778-4c88-ab9f-761bdd4b9425] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:04:49.747495683Z [2024-05-24 23:04:49,744: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:04:50.792395100Z [2024-05-24 23:04:50,791: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:04:50.795931562Z [2024-05-24 23:04:50,795: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:04:50.819947019Z [2024-05-24 23:04:50,819: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:04:50.821606405Z [2024-05-24 23:04:50,821: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:04:50.821825346Z [2024-05-24 23:04:50,821: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:04:50.822035451Z [2024-05-24 23:04:50,821: INFO/ForkPoolWorker-15] Read VIM ecec2318-e808-4328-be1c-1c2aff703fb0 (basic01_985978) 2024-05-24T23:04:50.822357025Z [2024-05-24 23:04:50,822: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ecec2318-e808-4328-be1c-1c2aff703fb0', 'name': 'basic01_985978', 'vim_type': 'openstack'}] 2024-05-24T23:04:50.822585562Z [2024-05-24 23:04:50,822: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:04:50.823087625Z [2024-05-24 23:04:50,822: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:04:50.823294419Z [2024-05-24 23:04:50,823: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:04:50.831822086Z [2024-05-24 23:04:50,831: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 2024-05-24T23:04:50.908513981Z [2024-05-24 23:04:50,908: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:04:51.454034659Z [2024-05-24 23:04:51,453: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[25a1b55a-3778-4c88-ab9f-761bdd4b9425] succeeded in 2.0130986839999423s: None 2024-05-24T23:04:52.384995334Z [2024-05-24 23:04:52,384: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3c6be5d-4a9b-4c1b-9eb0-059ba131cc0a] received 2024-05-24T23:04:52.399430712Z [2024-05-24 23:04:52,399: INFO/ForkPoolWorker-15] [d3c6be5d-4a9b-4c1b-9eb0-059ba131cc0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', 'split_metrics', 'scheduled__2024-05-24T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:04:52.734468566Z [2024-05-24 23:04:52,731: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:04:53.835359041Z [2024-05-24 23:04:53,835: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:04:53.838605382Z [2024-05-24 23:04:53,838: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:04:53.901692261Z [2024-05-24 23:04:53,898: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:04:53.901702431Z [2024-05-24 23:04:53,900: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:04:53.901705998Z [2024-05-24 23:04:53,900: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:04:53.901708834Z [2024-05-24 23:04:53,900: INFO/ForkPoolWorker-15] Read VIM ecec2318-e808-4328-be1c-1c2aff703fb0 (basic01_985978) 2024-05-24T23:04:53.901727404Z [2024-05-24 23:04:53,900: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'ecec2318-e808-4328-be1c-1c2aff703fb0', 'name': 'basic01_985978', 'vim_type': 'openstack'}] 2024-05-24T23:04:53.901731013Z [2024-05-24 23:04:53,900: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:04:53.901733961Z [2024-05-24 23:04:53,900: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:04:53.901736692Z [2024-05-24 23:04:53,900: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:04:53.907162786Z [2024-05-24 23:04:53,906: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0 2024-05-24T23:04:54.005795882Z [2024-05-24 23:04:54,005: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:04:54.715694476Z [2024-05-24 23:04:54,715: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d3c6be5d-4a9b-4c1b-9eb0-059ba131cc0a] succeeded in 2.3263338409999506s: None 2024-05-24T23:04:55.754429789Z [2024-05-24 23:04:55,754: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a371d461-42b1-4373-995d-bf073059a254] received 2024-05-24T23:04:55.760773866Z [2024-05-24 23:04:55,760: INFO/ForkPoolWorker-15] [a371d461-42b1-4373-995d-bf073059a254] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', 'collect_metrics', 'scheduled__2024-05-24T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:04:56.029418828Z [2024-05-24 23:04:56,021: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:04:57.228882652Z [2024-05-24 23:04:57,228: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:04:57.232265748Z [2024-05-24 23:04:57,231: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:04:57.255394573Z [2024-05-24 23:04:57,255: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:04:57.256588575Z [2024-05-24 23:04:57,256: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:04:57.256718960Z [2024-05-24 23:04:57,256: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:04:57.257745642Z [2024-05-24 23:04:57,256: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:04:57.257915282Z [2024-05-24 23:04:57,257: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:04:57.258297633Z [2024-05-24 23:04:57,258: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:04:57.258464530Z [2024-05-24 23:04:57,258: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:04:57.267552357Z [2024-05-24 23:04:57,267: WARNING/ForkPoolWorker-15] Dag 'vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:04:57.270826820Z [2024-05-24 23:04:57,268: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:04:57.270845353Z [2024-05-24 23:04:57,270: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:04:57.275505835Z [2024-05-24 23:04:57,274: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:04:57.298339325Z [2024-05-24 23:04:57,298: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:04:57.304391924Z [2024-05-24 23:04:57,303: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:04:57.304406557Z [2024-05-24 23:04:57,303: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:04:57.304411512Z [2024-05-24 23:04:57,303: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:04:57.304415876Z [2024-05-24 23:04:57,303: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:04:57.304419506Z [2024-05-24 23:04:57,303: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:04:57.304423355Z [2024-05-24 23:04:57,303: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:04:57.309080756Z [2024-05-24 23:04:57,308: ERROR/ForkPoolWorker-15] [a371d461-42b1-4373-995d-bf073059a254] Failed to execute task Dag 'vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0' could not be found; either it does not exist or it failed to parse.. 2024-05-24T23:04:57.309103148Z Traceback (most recent call last): 2024-05-24T23:04:57.309108517Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-24T23:04:57.309112864Z args.func(args) 2024-05-24T23:04:57.309117556Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-24T23:04:57.309121711Z return func(*args, **kwargs) 2024-05-24T23:04:57.309125374Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-24T23:04:57.309129099Z return f(*args, **kwargs) 2024-05-24T23:04:57.309132681Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-24T23:04:57.309136562Z dag = get_dag(args.subdir, args.dag_id) 2024-05-24T23:04:57.309140304Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-24T23:04:57.309144003Z raise AirflowException( 2024-05-24T23:04:57.309148165Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0' could not be found; either it does not exist or it failed to parse. 2024-05-24T23:04:57.363475201Z [2024-05-24 23:04:57,362: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a371d461-42b1-4373-995d-bf073059a254] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id a371d461-42b1-4373-995d-bf073059a254') 2024-05-24T23:04:57.363529028Z Traceback (most recent call last): 2024-05-24T23:04:57.363544242Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-24T23:04:57.363592631Z R = retval = fun(*args, **kwargs) 2024-05-24T23:04:57.363609899Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-24T23:04:57.363623592Z return self.run(*args, **kwargs) 2024-05-24T23:04:57.363637250Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-24T23:04:57.363650652Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-24T23:04:57.363662832Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-24T23:04:57.363678685Z raise AirflowException(msg) 2024-05-24T23:04:57.363694771Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id a371d461-42b1-4373-995d-bf073059a254 2024-05-24T23:05:00.889961293Z [2024-05-24 23:05:00,889: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b55a231-21a1-468b-abd8-daca2f40771e] received 2024-05-24T23:05:00.896141189Z [2024-05-24 23:05:00,895: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d436a0c1-fa0f-4784-8d83-076ef93d16d2] received 2024-05-24T23:05:00.899205235Z [2024-05-24 23:05:00,898: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6126622d-365f-466a-9b18-6c0de581c557] received 2024-05-24T23:05:00.904072345Z [2024-05-24 23:05:00,903: INFO/ForkPoolWorker-15] [0b55a231-21a1-468b-abd8-daca2f40771e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:05:00.905747771Z [2024-05-24 23:05:00,905: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6fcdf50a-1db3-4123-8991-d54fb86aa092] received 2024-05-24T23:05:00.911109772Z [2024-05-24 23:05:00,910: INFO/ForkPoolWorker-16] [d436a0c1-fa0f-4784-8d83-076ef93d16d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:05:00.911582644Z [2024-05-24 23:05:00,911: INFO/ForkPoolWorker-1] [6126622d-365f-466a-9b18-6c0de581c557] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:05:00.915229022Z [2024-05-24 23:05:00,914: INFO/ForkPoolWorker-2] [6fcdf50a-1db3-4123-8991-d54fb86aa092] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:05:00.915990568Z [2024-05-24 23:05:00,910: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5452d7c9-898a-46f1-a7c4-dbb73f55cf12] received 2024-05-24T23:05:00.917637520Z [2024-05-24 23:05:00,917: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8dc20b89-7b51-49f7-8186-77b024c60e5b] received 2024-05-24T23:05:00.924523881Z [2024-05-24 23:05:00,924: INFO/ForkPoolWorker-3] [5452d7c9-898a-46f1-a7c4-dbb73f55cf12] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:05:00.929801871Z [2024-05-24 23:05:00,929: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5f202d0-54d7-4407-86fc-49413f9cea8f] received 2024-05-24T23:05:00.936551568Z [2024-05-24 23:05:00,936: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2849749e-d9d8-4da1-aea0-81a7c068ffb8] received 2024-05-24T23:05:00.990191467Z [2024-05-24 23:05:00,989: INFO/ForkPoolWorker-5] [d5f202d0-54d7-4407-86fc-49413f9cea8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:05:00.999804905Z [2024-05-24 23:05:00,999: INFO/ForkPoolWorker-6] [2849749e-d9d8-4da1-aea0-81a7c068ffb8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:05:01.027156413Z [2024-05-24 23:05:01,026: INFO/ForkPoolWorker-4] [8dc20b89-7b51-49f7-8186-77b024c60e5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:05:01.291075501Z [2024-05-24 23:05:01,287: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:05:01.397379790Z [2024-05-24 23:05:01,391: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:05:01.531746747Z [2024-05-24 23:05:01,528: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:05:01.607885024Z [2024-05-24 23:05:01,602: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:05:01.737759509Z [2024-05-24 23:05:01,720: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:05:01.855835378Z [2024-05-24 23:05:01,852: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:05:01.995833316Z [2024-05-24 23:05:01,991: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:05:02.288235892Z [2024-05-24 23:05:02,279: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:05:02.430650690Z [2024-05-24 23:05:02,430: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e7d3dc4-413a-45e7-a188-89e03ceef79c] received 2024-05-24T23:05:02.485153421Z [2024-05-24 23:05:02,484: INFO/ForkPoolWorker-7] [8e7d3dc4-413a-45e7-a188-89e03ceef79c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:05:02.589360160Z [2024-05-24 23:05:02,588: INFO/ForkPoolWorker-5] Getting SDNC list 2024-05-24T23:05:02.593667541Z [2024-05-24 23:05:02,593: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:05:02.674947573Z [2024-05-24 23:05:02,674: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-05-24T23:05:02.680181106Z [2024-05-24 23:05:02,679: INFO/ForkPoolWorker-5] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:05:02.681057993Z [2024-05-24 23:05:02,680: INFO/ForkPoolWorker-5] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:05:02.681848576Z [2024-05-24 23:05:02,681: INFO/ForkPoolWorker-5] Getting SDNC list OK 2024-05-24T23:05:02.682191165Z [2024-05-24 23:05:02,682: INFO/ForkPoolWorker-5] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:05:02.834186209Z [2024-05-24 23:05:02,833: INFO/ForkPoolWorker-5] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:05:03.007826195Z [2024-05-24 23:05:03,002: INFO/ForkPoolWorker-7] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:05:04.357784474Z [2024-05-24 23:05:04,357: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:05:04.361048233Z [2024-05-24 23:05:04,360: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:05:04.381817870Z [2024-05-24 23:05:04,381: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:05:04.385318478Z [2024-05-24 23:05:04,384: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:05:04.423785865Z [2024-05-24 23:05:04,423: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:05:04.423799054Z [2024-05-24 23:05:04,423: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:05:04.427506497Z [2024-05-24 23:05:04,427: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:05:04.427548549Z [2024-05-24 23:05:04,427: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:05:04.427668174Z [2024-05-24 23:05:04,427: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:05:04.427677797Z [2024-05-24 23:05:04,427: INFO/ForkPoolWorker-1] Read VIM befa9b24-0cfb-4fc8-ac45-393bad6a5f0b (basic01_838921) 2024-05-24T23:05:04.427799942Z [2024-05-24 23:05:04,427: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:05:04.427912564Z [2024-05-24 23:05:04,427: INFO/ForkPoolWorker-15] Read VIM befa9b24-0cfb-4fc8-ac45-393bad6a5f0b (basic01_838921) 2024-05-24T23:05:04.428015814Z [2024-05-24 23:05:04,427: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'name': 'basic01_838921', 'vim_type': 'openstack'}] 2024-05-24T23:05:04.428099316Z [2024-05-24 23:05:04,428: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:05:04.428112364Z [2024-05-24 23:05:04,427: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'name': 'basic01_838921', 'vim_type': 'openstack'}] 2024-05-24T23:05:04.428231931Z [2024-05-24 23:05:04,428: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:05:04.428773542Z [2024-05-24 23:05:04,428: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:05:04.428883041Z [2024-05-24 23:05:04,428: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:05:04.428934261Z [2024-05-24 23:05:04,428: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:05:04.429031528Z [2024-05-24 23:05:04,428: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:05:04.436902401Z [2024-05-24 23:05:04,436: INFO/ForkPoolWorker-1] Creating DAG vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b 2024-05-24T23:05:04.437030262Z [2024-05-24 23:05:04,436: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b 2024-05-24T23:05:04.562903959Z [2024-05-24 23:05:04,562: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:05:04.588283348Z [2024-05-24 23:05:04,587: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[d5f202d0-54d7-4407-86fc-49413f9cea8f] succeeded in 3.656181181999955s: None 2024-05-24T23:05:04.703619821Z [2024-05-24 23:05:04,703: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:05:05.154122176Z [2024-05-24 23:05:05,153: INFO/ForkPoolWorker-4] Getting VIM list 2024-05-24T23:05:05.169565654Z [2024-05-24 23:05:05,169: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:05:05.215866833Z [2024-05-24 23:05:05,215: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:05:05.219366071Z [2024-05-24 23:05:05,218: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:05:05.302615590Z [2024-05-24 23:05:05,302: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-05-24T23:05:05.307705552Z [2024-05-24 23:05:05,306: INFO/ForkPoolWorker-4] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:05:05.307852459Z [2024-05-24 23:05:05,307: INFO/ForkPoolWorker-4] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:05:05.308138538Z [2024-05-24 23:05:05,308: INFO/ForkPoolWorker-4] Read VIM befa9b24-0cfb-4fc8-ac45-393bad6a5f0b (basic01_838921) 2024-05-24T23:05:05.308359821Z [2024-05-24 23:05:05,308: INFO/ForkPoolWorker-4] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'name': 'basic01_838921', 'vim_type': 'openstack'}] 2024-05-24T23:05:05.308570796Z [2024-05-24 23:05:05,308: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-05-24T23:05:05.308830178Z [2024-05-24 23:05:05,308: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:05:05.308887935Z [2024-05-24 23:05:05,308: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:05:05.314411337Z [2024-05-24 23:05:05,314: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b 2024-05-24T23:05:05.352222976Z [2024-05-24 23:05:05,351: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:05:05.356797998Z [2024-05-24 23:05:05,356: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:05:05.356818998Z [2024-05-24 23:05:05,356: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:05:05.356895094Z [2024-05-24 23:05:05,356: INFO/ForkPoolWorker-16] Read VIM befa9b24-0cfb-4fc8-ac45-393bad6a5f0b (basic01_838921) 2024-05-24T23:05:05.357044713Z [2024-05-24 23:05:05,356: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'name': 'basic01_838921', 'vim_type': 'openstack'}] 2024-05-24T23:05:05.357102750Z [2024-05-24 23:05:05,357: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:05:05.357359356Z [2024-05-24 23:05:05,357: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:05:05.357434589Z [2024-05-24 23:05:05,357: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:05:05.362797569Z [2024-05-24 23:05:05,362: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b 2024-05-24T23:05:05.375950646Z [2024-05-24 23:05:05,375: WARNING/ForkPoolWorker-16] Dag 'vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:05:05.376712679Z [2024-05-24 23:05:05,376: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:05:05.381852117Z [2024-05-24 23:05:05,381: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:05:05.388726392Z [2024-05-24 23:05:05,388: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:05:05.438357010Z [2024-05-24 23:05:05,438: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:05:05.510292123Z [2024-05-24 23:05:05,510: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:05:05.514937726Z [2024-05-24 23:05:05,514: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:05:05.515002014Z [2024-05-24 23:05:05,514: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:05:05.515011693Z [2024-05-24 23:05:05,514: INFO/ForkPoolWorker-16] Read VIM befa9b24-0cfb-4fc8-ac45-393bad6a5f0b (basic01_838921) 2024-05-24T23:05:05.515222435Z [2024-05-24 23:05:05,514: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'name': 'basic01_838921', 'vim_type': 'openstack'}] 2024-05-24T23:05:05.515381306Z [2024-05-24 23:05:05,515: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:05:05.515714799Z [2024-05-24 23:05:05,515: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:05:05.515887833Z [2024-05-24 23:05:05,515: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:05:05.521338740Z [2024-05-24 23:05:05,521: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b 2024-05-24T23:05:05.524094096Z [2024-05-24 23:05:05,523: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0b55a231-21a1-468b-abd8-daca2f40771e] succeeded in 4.6300843260000875s: None 2024-05-24T23:05:05.526900845Z [2024-05-24 23:05:05,526: ERROR/ForkPoolWorker-16] [d436a0c1-fa0f-4784-8d83-076ef93d16d2] Failed to execute task Dag 'vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0' could not be found; either it does not exist or it failed to parse.. 2024-05-24T23:05:05.526924926Z Traceback (most recent call last): 2024-05-24T23:05:05.526929309Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-24T23:05:05.526933024Z args.func(args) 2024-05-24T23:05:05.526939784Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-24T23:05:05.526943641Z return func(*args, **kwargs) 2024-05-24T23:05:05.526946883Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-24T23:05:05.526949784Z return f(*args, **kwargs) 2024-05-24T23:05:05.526952869Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-24T23:05:05.526956166Z dag = get_dag(args.subdir, args.dag_id) 2024-05-24T23:05:05.526959115Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-24T23:05:05.526961948Z raise AirflowException( 2024-05-24T23:05:05.526966646Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0' could not be found; either it does not exist or it failed to parse. 2024-05-24T23:05:05.721834061Z [2024-05-24 23:05:05,721: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d436a0c1-fa0f-4784-8d83-076ef93d16d2] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d436a0c1-fa0f-4784-8d83-076ef93d16d2') 2024-05-24T23:05:05.721858597Z Traceback (most recent call last): 2024-05-24T23:05:05.721863186Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-24T23:05:05.721866381Z R = retval = fun(*args, **kwargs) 2024-05-24T23:05:05.721869733Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-24T23:05:05.721872756Z return self.run(*args, **kwargs) 2024-05-24T23:05:05.721876599Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-24T23:05:05.721887408Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-24T23:05:05.721890966Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-24T23:05:05.721894855Z raise AirflowException(msg) 2024-05-24T23:05:05.721899190Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d436a0c1-fa0f-4784-8d83-076ef93d16d2 2024-05-24T23:05:05.875293554Z [2024-05-24 23:05:05,875: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ecfa1dea-cf89-4c56-9327-f80aa37ba39d] received 2024-05-24T23:05:05.889538244Z [2024-05-24 23:05:05,889: INFO/ForkPoolWorker-15] [ecfa1dea-cf89-4c56-9327-f80aa37ba39d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:05:06.008023251Z [2024-05-24 23:05:06,007: INFO/ForkPoolWorker-6] Getting VIM list 2024-05-24T23:05:06.012889610Z [2024-05-24 23:05:06,012: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:05:06.090750598Z [2024-05-24 23:05:06,088: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:05:06.101790193Z [2024-05-24 23:05:06,100: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:05:06.113161823Z [2024-05-24 23:05:06,112: INFO/ForkPoolWorker-6] Connected to database osm version 1.2 2024-05-24T23:05:06.118306694Z [2024-05-24 23:05:06,118: INFO/ForkPoolWorker-6] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:05:06.118491903Z [2024-05-24 23:05:06,118: INFO/ForkPoolWorker-6] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:05:06.118635193Z [2024-05-24 23:05:06,118: INFO/ForkPoolWorker-6] Read VIM befa9b24-0cfb-4fc8-ac45-393bad6a5f0b (basic01_838921) 2024-05-24T23:05:06.118831798Z [2024-05-24 23:05:06,118: INFO/ForkPoolWorker-6] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'name': 'basic01_838921', 'vim_type': 'openstack'}] 2024-05-24T23:05:06.118969484Z [2024-05-24 23:05:06,118: INFO/ForkPoolWorker-6] Getting VIM list OK 2024-05-24T23:05:06.119309364Z [2024-05-24 23:05:06,119: INFO/ForkPoolWorker-6] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:05:06.119467172Z [2024-05-24 23:05:06,119: INFO/ForkPoolWorker-6] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:05:06.123823320Z [2024-05-24 23:05:06,123: INFO/ForkPoolWorker-6] Creating DAG vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b 2024-05-24T23:05:06.232666390Z [2024-05-24 23:05:06,232: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-24T23:05:06.234053590Z [2024-05-24 23:05:06,233: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:05:06.245467303Z [2024-05-24 23:05:06,245: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:05:06.245600823Z [2024-05-24 23:05:06,245: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:05:06.245682071Z [2024-05-24 23:05:06,245: INFO/ForkPoolWorker-2] Read VIM befa9b24-0cfb-4fc8-ac45-393bad6a5f0b (basic01_838921) 2024-05-24T23:05:06.245868616Z [2024-05-24 23:05:06,245: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'name': 'basic01_838921', 'vim_type': 'openstack'}] 2024-05-24T23:05:06.245984460Z [2024-05-24 23:05:06,245: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:05:06.246326589Z [2024-05-24 23:05:06,246: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:05:06.247977189Z [2024-05-24 23:05:06,246: INFO/ForkPoolWorker-2] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:05:06.255110935Z [2024-05-24 23:05:06,254: INFO/ForkPoolWorker-2] Creating DAG vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b 2024-05-24T23:05:06.258512991Z [2024-05-24 23:05:06,258: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:05:06.261450594Z [2024-05-24 23:05:06,261: WARNING/ForkPoolWorker-2] Dag 'vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:05:06.265019872Z [2024-05-24 23:05:06,264: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:05:06.266073641Z [2024-05-24 23:05:06,265: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:05:06.272104071Z [2024-05-24 23:05:06,271: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:05:06.342311443Z [2024-05-24 23:05:06,340: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:05:06.347606213Z [2024-05-24 23:05:06,347: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:05:06.347623996Z [2024-05-24 23:05:06,347: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:05:06.347666317Z [2024-05-24 23:05:06,347: INFO/ForkPoolWorker-2] Read VIM befa9b24-0cfb-4fc8-ac45-393bad6a5f0b (basic01_838921) 2024-05-24T23:05:06.347811027Z [2024-05-24 23:05:06,347: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'name': 'basic01_838921', 'vim_type': 'openstack'}] 2024-05-24T23:05:06.347846536Z [2024-05-24 23:05:06,347: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:05:06.349068857Z [2024-05-24 23:05:06,348: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-24T23:05:06.350970297Z [2024-05-24 23:05:06,350: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:05:06.350986414Z [2024-05-24 23:05:06,350: INFO/ForkPoolWorker-2] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:05:06.351910248Z [2024-05-24 23:05:06,351: INFO/ForkPoolWorker-3] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:05:06.352086587Z [2024-05-24 23:05:06,351: INFO/ForkPoolWorker-3] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:05:06.352189077Z [2024-05-24 23:05:06,352: INFO/ForkPoolWorker-3] Read VIM befa9b24-0cfb-4fc8-ac45-393bad6a5f0b (basic01_838921) 2024-05-24T23:05:06.352370740Z [2024-05-24 23:05:06,352: INFO/ForkPoolWorker-3] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'name': 'basic01_838921', 'vim_type': 'openstack'}] 2024-05-24T23:05:06.352507707Z [2024-05-24 23:05:06,352: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-24T23:05:06.352785002Z [2024-05-24 23:05:06,352: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:05:06.352895818Z [2024-05-24 23:05:06,352: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:05:06.354188505Z [2024-05-24 23:05:06,353: INFO/ForkPoolWorker-2] Creating DAG vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b 2024-05-24T23:05:06.357583415Z [2024-05-24 23:05:06,357: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b 2024-05-24T23:05:06.358933582Z [2024-05-24 23:05:06,358: ERROR/ForkPoolWorker-2] [6fcdf50a-1db3-4123-8991-d54fb86aa092] Failed to execute task Dag 'vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0' could not be found; either it does not exist or it failed to parse.. 2024-05-24T23:05:06.358944735Z Traceback (most recent call last): 2024-05-24T23:05:06.358948808Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-24T23:05:06.358952577Z args.func(args) 2024-05-24T23:05:06.358955978Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-24T23:05:06.358959285Z return func(*args, **kwargs) 2024-05-24T23:05:06.358962693Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-24T23:05:06.358965458Z return f(*args, **kwargs) 2024-05-24T23:05:06.358968229Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-24T23:05:06.358970892Z dag = get_dag(args.subdir, args.dag_id) 2024-05-24T23:05:06.358973693Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-24T23:05:06.358976430Z raise AirflowException( 2024-05-24T23:05:06.358986999Z airflow.exceptions.AirflowException: Dag 'vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0' could not be found; either it does not exist or it failed to parse. 2024-05-24T23:05:06.362991372Z [2024-05-24 23:05:06,361: WARNING/ForkPoolWorker-3] Dag 'vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:05:06.363005500Z [2024-05-24 23:05:06,361: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:05:06.365004209Z [2024-05-24 23:05:06,364: INFO/ForkPoolWorker-6] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:05:06.374488978Z [2024-05-24 23:05:06,374: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-24T23:05:06.385774458Z [2024-05-24 23:05:06,385: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:05:06.420885368Z [2024-05-24 23:05:06,420: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6fcdf50a-1db3-4123-8991-d54fb86aa092] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6fcdf50a-1db3-4123-8991-d54fb86aa092') 2024-05-24T23:05:06.420917356Z Traceback (most recent call last): 2024-05-24T23:05:06.420921559Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-24T23:05:06.420924551Z R = retval = fun(*args, **kwargs) 2024-05-24T23:05:06.420927466Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-24T23:05:06.420930349Z return self.run(*args, **kwargs) 2024-05-24T23:05:06.420933951Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-24T23:05:06.420938046Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-24T23:05:06.420941498Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-24T23:05:06.420945093Z raise AirflowException(msg) 2024-05-24T23:05:06.420949307Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6fcdf50a-1db3-4123-8991-d54fb86aa092 2024-05-24T23:05:06.469635628Z [2024-05-24 23:05:06,469: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-24T23:05:06.472202142Z [2024-05-24 23:05:06,471: INFO/ForkPoolWorker-3] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:05:06.472424513Z [2024-05-24 23:05:06,472: INFO/ForkPoolWorker-3] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:05:06.472635639Z [2024-05-24 23:05:06,472: INFO/ForkPoolWorker-3] Read VIM befa9b24-0cfb-4fc8-ac45-393bad6a5f0b (basic01_838921) 2024-05-24T23:05:06.472896854Z [2024-05-24 23:05:06,472: INFO/ForkPoolWorker-3] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'name': 'basic01_838921', 'vim_type': 'openstack'}] 2024-05-24T23:05:06.473112092Z [2024-05-24 23:05:06,472: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-24T23:05:06.473517088Z [2024-05-24 23:05:06,473: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:05:06.474024981Z [2024-05-24 23:05:06,473: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:05:06.476204361Z [2024-05-24 23:05:06,476: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b 2024-05-24T23:05:06.483130884Z [2024-05-24 23:05:06,482: ERROR/ForkPoolWorker-3] [5452d7c9-898a-46f1-a7c4-dbb73f55cf12] Failed to execute task Dag 'vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0' could not be found; either it does not exist or it failed to parse.. 2024-05-24T23:05:06.483152752Z Traceback (most recent call last): 2024-05-24T23:05:06.483156969Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-24T23:05:06.483160471Z args.func(args) 2024-05-24T23:05:06.483163832Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-24T23:05:06.483167275Z return func(*args, **kwargs) 2024-05-24T23:05:06.483170555Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-24T23:05:06.483173688Z return f(*args, **kwargs) 2024-05-24T23:05:06.483176616Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-24T23:05:06.483180166Z dag = get_dag(args.subdir, args.dag_id) 2024-05-24T23:05:06.483183130Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-24T23:05:06.483195584Z raise AirflowException( 2024-05-24T23:05:06.483199349Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0' could not be found; either it does not exist or it failed to parse. 2024-05-24T23:05:06.533611214Z [2024-05-24 23:05:06,523: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[5452d7c9-898a-46f1-a7c4-dbb73f55cf12] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 5452d7c9-898a-46f1-a7c4-dbb73f55cf12') 2024-05-24T23:05:06.533636268Z Traceback (most recent call last): 2024-05-24T23:05:06.533648187Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-24T23:05:06.533651980Z R = retval = fun(*args, **kwargs) 2024-05-24T23:05:06.533655082Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-24T23:05:06.533658009Z return self.run(*args, **kwargs) 2024-05-24T23:05:06.533662045Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-24T23:05:06.533665572Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-24T23:05:06.533668739Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-24T23:05:06.533672533Z raise AirflowException(msg) 2024-05-24T23:05:06.533676062Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 5452d7c9-898a-46f1-a7c4-dbb73f55cf12 2024-05-24T23:05:06.863011928Z [2024-05-24 23:05:06,860: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:05:07.005840278Z [2024-05-24 23:05:07,005: INFO/ForkPoolWorker-7] Getting VIM list 2024-05-24T23:05:07.009082746Z [2024-05-24 23:05:07,008: INFO/ForkPoolWorker-7] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:05:07.039510436Z [2024-05-24 23:05:07,039: INFO/ForkPoolWorker-7] Connected to database osm version 1.2 2024-05-24T23:05:07.041827585Z [2024-05-24 23:05:07,041: INFO/ForkPoolWorker-7] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:05:07.041845324Z [2024-05-24 23:05:07,041: INFO/ForkPoolWorker-7] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:05:07.041922451Z [2024-05-24 23:05:07,041: INFO/ForkPoolWorker-7] Read VIM befa9b24-0cfb-4fc8-ac45-393bad6a5f0b (basic01_838921) 2024-05-24T23:05:07.042082848Z [2024-05-24 23:05:07,041: INFO/ForkPoolWorker-7] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'name': 'basic01_838921', 'vim_type': 'openstack'}] 2024-05-24T23:05:07.042136133Z [2024-05-24 23:05:07,042: INFO/ForkPoolWorker-7] Getting VIM list OK 2024-05-24T23:05:07.042370017Z [2024-05-24 23:05:07,042: INFO/ForkPoolWorker-7] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:05:07.042422791Z [2024-05-24 23:05:07,042: INFO/ForkPoolWorker-7] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:05:07.048620053Z [2024-05-24 23:05:07,048: INFO/ForkPoolWorker-7] Creating DAG vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b 2024-05-24T23:05:07.211865227Z [2024-05-24 23:05:07,211: INFO/ForkPoolWorker-7] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:05:07.337929355Z [2024-05-24 23:05:07,337: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6126622d-365f-466a-9b18-6c0de581c557] succeeded in 6.4366144260000056s: None 2024-05-24T23:05:08.127070320Z [2024-05-24 23:05:08,126: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[8dc20b89-7b51-49f7-8186-77b024c60e5b] succeeded in 7.206606304999923s: None 2024-05-24T23:05:08.137187353Z [2024-05-24 23:05:08,136: INFO/ForkPoolWorker-6] Task airflow.executors.celery_executor.execute_command[2849749e-d9d8-4da1-aea0-81a7c068ffb8] succeeded in 7.194745559000012s: None 2024-05-24T23:05:08.405328085Z [2024-05-24 23:05:08,404: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:05:08.408925731Z [2024-05-24 23:05:08,408: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:05:08.430804512Z [2024-05-24 23:05:08,430: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:05:08.432215960Z [2024-05-24 23:05:08,431: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:05:08.432460557Z [2024-05-24 23:05:08,432: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:05:08.432640667Z [2024-05-24 23:05:08,432: INFO/ForkPoolWorker-15] Read VIM befa9b24-0cfb-4fc8-ac45-393bad6a5f0b (basic01_838921) 2024-05-24T23:05:08.432888418Z [2024-05-24 23:05:08,432: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'name': 'basic01_838921', 'vim_type': 'openstack'}] 2024-05-24T23:05:08.433064301Z [2024-05-24 23:05:08,432: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:05:08.433434461Z [2024-05-24 23:05:08,433: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:05:08.433635679Z [2024-05-24 23:05:08,433: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:05:08.439521787Z [2024-05-24 23:05:08,439: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b 2024-05-24T23:05:08.489953855Z [2024-05-24 23:05:08,489: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef407ab3-ebd4-4595-b0f5-f7bb922cbf24] received 2024-05-24T23:05:08.500258782Z [2024-05-24 23:05:08,499: INFO/ForkPoolWorker-16] [ef407ab3-ebd4-4595-b0f5-f7bb922cbf24] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', 'collect_metrics', 'scheduled__2024-05-24T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:05:08.518869618Z [2024-05-24 23:05:08,518: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:05:08.814394381Z [2024-05-24 23:05:08,811: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:05:09.150694765Z [2024-05-24 23:05:09,150: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ecfa1dea-cf89-4c56-9327-f80aa37ba39d] succeeded in 3.272235468999952s: None 2024-05-24T23:05:09.171246060Z [2024-05-24 23:05:09,170: INFO/ForkPoolWorker-7] Task airflow.executors.celery_executor.execute_command[8e7d3dc4-413a-45e7-a188-89e03ceef79c] succeeded in 6.737738614999898s: None 2024-05-24T23:05:09.838335037Z [2024-05-24 23:05:09,837: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74c3fac2-4e37-4ff1-8ca6-b7ab3e901054] received 2024-05-24T23:05:09.851969840Z [2024-05-24 23:05:09,851: INFO/ForkPoolWorker-15] [74c3fac2-4e37-4ff1-8ca6-b7ab3e901054] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:05:09.963946511Z [2024-05-24 23:05:09,963: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:05:09.967059757Z [2024-05-24 23:05:09,966: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:05:09.985204059Z [2024-05-24 23:05:09,984: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:05:09.987025341Z [2024-05-24 23:05:09,986: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:05:09.987194893Z [2024-05-24 23:05:09,986: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:05:09.987369249Z [2024-05-24 23:05:09,987: INFO/ForkPoolWorker-16] Read VIM befa9b24-0cfb-4fc8-ac45-393bad6a5f0b (basic01_838921) 2024-05-24T23:05:09.987563814Z [2024-05-24 23:05:09,987: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'name': 'basic01_838921', 'vim_type': 'openstack'}] 2024-05-24T23:05:09.987664275Z [2024-05-24 23:05:09,987: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:05:09.987976094Z [2024-05-24 23:05:09,987: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:05:09.988149690Z [2024-05-24 23:05:09,988: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:05:09.993881174Z [2024-05-24 23:05:09,993: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b 2024-05-24T23:05:09.997995439Z [2024-05-24 23:05:09,997: WARNING/ForkPoolWorker-16] Dag 'vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:05:09.998680875Z [2024-05-24 23:05:09,998: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:05:09.999568358Z [2024-05-24 23:05:09,999: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:05:10.004916463Z [2024-05-24 23:05:10,004: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:05:10.018693476Z [2024-05-24 23:05:10,018: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:05:10.019809822Z [2024-05-24 23:05:10,019: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:05:10.019825557Z [2024-05-24 23:05:10,019: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:05:10.020016676Z [2024-05-24 23:05:10,019: INFO/ForkPoolWorker-16] Read VIM befa9b24-0cfb-4fc8-ac45-393bad6a5f0b (basic01_838921) 2024-05-24T23:05:10.020127897Z [2024-05-24 23:05:10,019: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'name': 'basic01_838921', 'vim_type': 'openstack'}] 2024-05-24T23:05:10.020212912Z [2024-05-24 23:05:10,020: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:05:10.020658661Z [2024-05-24 23:05:10,020: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:05:10.020670225Z [2024-05-24 23:05:10,020: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:05:10.023275535Z [2024-05-24 23:05:10,023: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b 2024-05-24T23:05:10.026906077Z [2024-05-24 23:05:10,026: ERROR/ForkPoolWorker-16] [ef407ab3-ebd4-4595-b0f5-f7bb922cbf24] Failed to execute task Dag 'vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0' could not be found; either it does not exist or it failed to parse.. 2024-05-24T23:05:10.026918697Z Traceback (most recent call last): 2024-05-24T23:05:10.026939167Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-24T23:05:10.026942808Z args.func(args) 2024-05-24T23:05:10.026946960Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-24T23:05:10.026950775Z return func(*args, **kwargs) 2024-05-24T23:05:10.026954558Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-24T23:05:10.026957670Z return f(*args, **kwargs) 2024-05-24T23:05:10.026960577Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-24T23:05:10.026963938Z dag = get_dag(args.subdir, args.dag_id) 2024-05-24T23:05:10.026979331Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-24T23:05:10.026982378Z raise AirflowException( 2024-05-24T23:05:10.026988154Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0' could not be found; either it does not exist or it failed to parse. 2024-05-24T23:05:10.061991478Z [2024-05-24 23:05:10,061: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ef407ab3-ebd4-4595-b0f5-f7bb922cbf24] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id ef407ab3-ebd4-4595-b0f5-f7bb922cbf24') 2024-05-24T23:05:10.062011770Z Traceback (most recent call last): 2024-05-24T23:05:10.062016332Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-24T23:05:10.062019975Z R = retval = fun(*args, **kwargs) 2024-05-24T23:05:10.062023486Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-24T23:05:10.062027140Z return self.run(*args, **kwargs) 2024-05-24T23:05:10.062031262Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-24T23:05:10.062048973Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-24T23:05:10.062052467Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-24T23:05:10.062056549Z raise AirflowException(msg) 2024-05-24T23:05:10.062061497Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id ef407ab3-ebd4-4595-b0f5-f7bb922cbf24 2024-05-24T23:05:10.121329820Z [2024-05-24 23:05:10,118: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:05:11.200088513Z [2024-05-24 23:05:11,199: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:05:11.203717068Z [2024-05-24 23:05:11,203: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:05:11.234334541Z [2024-05-24 23:05:11,234: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:05:11.235579642Z [2024-05-24 23:05:11,235: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:05:11.235717230Z [2024-05-24 23:05:11,235: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:05:11.235746981Z [2024-05-24 23:05:11,235: INFO/ForkPoolWorker-15] Read VIM befa9b24-0cfb-4fc8-ac45-393bad6a5f0b (basic01_838921) 2024-05-24T23:05:11.235975475Z [2024-05-24 23:05:11,235: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'name': 'basic01_838921', 'vim_type': 'openstack'}] 2024-05-24T23:05:11.235997509Z [2024-05-24 23:05:11,235: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:05:11.236349219Z [2024-05-24 23:05:11,236: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:05:11.236359376Z [2024-05-24 23:05:11,236: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:05:11.241967515Z [2024-05-24 23:05:11,241: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b 2024-05-24T23:05:11.331787297Z [2024-05-24 23:05:11,331: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:05:11.943801113Z [2024-05-24 23:05:11,943: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[74c3fac2-4e37-4ff1-8ca6-b7ab3e901054] succeeded in 2.100223018999941s: None 2024-05-24T23:05:12.164803635Z [2024-05-24 23:05:12,164: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6523dac9-4516-4803-8b0a-2276ee259f92] received 2024-05-24T23:05:12.183208860Z [2024-05-24 23:05:12,182: INFO/ForkPoolWorker-15] [6523dac9-4516-4803-8b0a-2276ee259f92] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:05:12.565493189Z [2024-05-24 23:05:12,561: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:05:13.709536504Z [2024-05-24 23:05:13,708: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:05:13.712836318Z [2024-05-24 23:05:13,712: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:05:13.736209834Z [2024-05-24 23:05:13,734: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:05:13.739005171Z [2024-05-24 23:05:13,738: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:05:13.739310811Z [2024-05-24 23:05:13,739: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:05:13.739514790Z [2024-05-24 23:05:13,739: INFO/ForkPoolWorker-15] Read VIM befa9b24-0cfb-4fc8-ac45-393bad6a5f0b (basic01_838921) 2024-05-24T23:05:13.739935350Z [2024-05-24 23:05:13,739: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'name': 'basic01_838921', 'vim_type': 'openstack'}] 2024-05-24T23:05:13.740295979Z [2024-05-24 23:05:13,740: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:05:13.741072460Z [2024-05-24 23:05:13,740: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:05:13.741491592Z [2024-05-24 23:05:13,741: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:05:13.754632710Z [2024-05-24 23:05:13,754: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b 2024-05-24T23:05:13.860994281Z [2024-05-24 23:05:13,857: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:05:14.510826075Z [2024-05-24 23:05:14,509: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6523dac9-4516-4803-8b0a-2276ee259f92] succeeded in 2.3427765019998787s: None 2024-05-24T23:05:16.971796793Z [2024-05-24 23:05:16,971: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[080da041-2f32-4306-93bb-bb80f7ce839e] received 2024-05-24T23:05:16.985500157Z [2024-05-24 23:05:16,985: INFO/ForkPoolWorker-15] [080da041-2f32-4306-93bb-bb80f7ce839e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:05:17.265867976Z [2024-05-24 23:05:17,262: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:05:17.592236887Z [2024-05-24 23:05:17,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fcc56adb-e572-4875-8d44-07ea7dc88119] received 2024-05-24T23:05:17.600999477Z [2024-05-24 23:05:17,600: INFO/ForkPoolWorker-16] [fcc56adb-e572-4875-8d44-07ea7dc88119] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:05:17.609829391Z [2024-05-24 23:05:17,609: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f23cd8d-5683-4faf-a62f-b346763cb977] received 2024-05-24T23:05:17.616097365Z [2024-05-24 23:05:17,615: INFO/ForkPoolWorker-1] [0f23cd8d-5683-4faf-a62f-b346763cb977] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:05:17.948585772Z [2024-05-24 23:05:17,945: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:05:17.954844284Z [2024-05-24 23:05:17,945: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:05:18.488160817Z [2024-05-24 23:05:18,487: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:05:18.491795650Z [2024-05-24 23:05:18,491: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:05:18.520038484Z [2024-05-24 23:05:18,519: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:05:18.522007906Z [2024-05-24 23:05:18,521: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:05:18.522222125Z [2024-05-24 23:05:18,522: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:05:18.522524339Z [2024-05-24 23:05:18,522: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:05:18.522709833Z [2024-05-24 23:05:18,522: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:05:18.523087903Z [2024-05-24 23:05:18,522: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:05:18.524172237Z [2024-05-24 23:05:18,523: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:05:18.532146640Z [2024-05-24 23:05:18,531: WARNING/ForkPoolWorker-15] Dag 'vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:05:18.533026248Z [2024-05-24 23:05:18,532: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:05:18.534056717Z [2024-05-24 23:05:18,533: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:05:18.538256022Z [2024-05-24 23:05:18,537: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:05:18.558181403Z [2024-05-24 23:05:18,557: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:05:18.559254594Z [2024-05-24 23:05:18,559: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:05:18.559361197Z [2024-05-24 23:05:18,559: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:05:18.559499181Z [2024-05-24 23:05:18,559: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:05:18.559573798Z [2024-05-24 23:05:18,559: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:05:18.559793807Z [2024-05-24 23:05:18,559: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:05:18.559872608Z [2024-05-24 23:05:18,559: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:05:18.563709139Z [2024-05-24 23:05:18,563: ERROR/ForkPoolWorker-15] [080da041-2f32-4306-93bb-bb80f7ce839e] Failed to execute task Dag 'vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0' could not be found; either it does not exist or it failed to parse.. 2024-05-24T23:05:18.563720809Z Traceback (most recent call last): 2024-05-24T23:05:18.563738369Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-24T23:05:18.563743518Z args.func(args) 2024-05-24T23:05:18.563748389Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-24T23:05:18.563753144Z return func(*args, **kwargs) 2024-05-24T23:05:18.563757499Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-24T23:05:18.563762197Z return f(*args, **kwargs) 2024-05-24T23:05:18.563766796Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-24T23:05:18.563771239Z dag = get_dag(args.subdir, args.dag_id) 2024-05-24T23:05:18.563775573Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-24T23:05:18.563780156Z raise AirflowException( 2024-05-24T23:05:18.563789109Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_ecec2318-e808-4328-be1c-1c2aff703fb0' could not be found; either it does not exist or it failed to parse. 2024-05-24T23:05:18.598766910Z [2024-05-24 23:05:18,598: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[080da041-2f32-4306-93bb-bb80f7ce839e] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 080da041-2f32-4306-93bb-bb80f7ce839e') 2024-05-24T23:05:18.598794976Z Traceback (most recent call last): 2024-05-24T23:05:18.598802934Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-24T23:05:18.598809521Z R = retval = fun(*args, **kwargs) 2024-05-24T23:05:18.598815814Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-24T23:05:18.598822606Z return self.run(*args, **kwargs) 2024-05-24T23:05:18.598830006Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-24T23:05:18.598840085Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-24T23:05:18.598846790Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-24T23:05:18.598854222Z raise AirflowException(msg) 2024-05-24T23:05:18.598861633Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 080da041-2f32-4306-93bb-bb80f7ce839e 2024-05-24T23:05:19.081326568Z [2024-05-24 23:05:19,080: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:05:19.084232885Z [2024-05-24 23:05:19,083: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:05:19.100920852Z [2024-05-24 23:05:19,100: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:05:19.102224803Z [2024-05-24 23:05:19,102: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:05:19.102239076Z [2024-05-24 23:05:19,102: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:05:19.102340395Z [2024-05-24 23:05:19,102: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:05:19.102348966Z [2024-05-24 23:05:19,102: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:05:19.102553364Z [2024-05-24 23:05:19,102: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:05:19.102561941Z [2024-05-24 23:05:19,102: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:05:19.108460821Z [2024-05-24 23:05:19,108: WARNING/ForkPoolWorker-1] Dag 'vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:05:19.109066516Z [2024-05-24 23:05:19,108: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:05:19.109812817Z [2024-05-24 23:05:19,109: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:05:19.112689593Z [2024-05-24 23:05:19,112: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:05:19.124055459Z [2024-05-24 23:05:19,123: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:05:19.125356725Z [2024-05-24 23:05:19,125: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:05:19.125373107Z [2024-05-24 23:05:19,125: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:05:19.125529699Z [2024-05-24 23:05:19,125: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:05:19.125540086Z [2024-05-24 23:05:19,125: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:05:19.125739007Z [2024-05-24 23:05:19,125: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:05:19.125750518Z [2024-05-24 23:05:19,125: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:05:19.129152739Z [2024-05-24 23:05:19,128: ERROR/ForkPoolWorker-1] [0f23cd8d-5683-4faf-a62f-b346763cb977] Failed to execute task Dag 'vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0' could not be found; either it does not exist or it failed to parse.. 2024-05-24T23:05:19.129176104Z Traceback (most recent call last): 2024-05-24T23:05:19.129186859Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-24T23:05:19.129196864Z args.func(args) 2024-05-24T23:05:19.129270846Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-24T23:05:19.129282213Z return func(*args, **kwargs) 2024-05-24T23:05:19.129288312Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-24T23:05:19.129310178Z return f(*args, **kwargs) 2024-05-24T23:05:19.129316297Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-24T23:05:19.129322189Z dag = get_dag(args.subdir, args.dag_id) 2024-05-24T23:05:19.129328062Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-24T23:05:19.129333905Z raise AirflowException( 2024-05-24T23:05:19.129340768Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0' could not be found; either it does not exist or it failed to parse. 2024-05-24T23:05:19.142917591Z [2024-05-24 23:05:19,142: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:05:19.146189567Z [2024-05-24 23:05:19,145: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:05:19.166048465Z [2024-05-24 23:05:19,165: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0f23cd8d-5683-4faf-a62f-b346763cb977] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0f23cd8d-5683-4faf-a62f-b346763cb977') 2024-05-24T23:05:19.166057701Z Traceback (most recent call last): 2024-05-24T23:05:19.166062183Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-24T23:05:19.166065352Z R = retval = fun(*args, **kwargs) 2024-05-24T23:05:19.166068499Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-24T23:05:19.166072079Z return self.run(*args, **kwargs) 2024-05-24T23:05:19.166075976Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-24T23:05:19.166079575Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-24T23:05:19.166082726Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-24T23:05:19.166086527Z raise AirflowException(msg) 2024-05-24T23:05:19.166105947Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0f23cd8d-5683-4faf-a62f-b346763cb977 2024-05-24T23:05:19.167115377Z [2024-05-24 23:05:19,166: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:05:19.168556893Z [2024-05-24 23:05:19,168: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:05:19.168716317Z [2024-05-24 23:05:19,168: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:05:19.168946131Z [2024-05-24 23:05:19,168: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:05:19.169086220Z [2024-05-24 23:05:19,168: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:05:19.169447609Z [2024-05-24 23:05:19,169: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:05:19.169643954Z [2024-05-24 23:05:19,169: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:05:19.175472170Z [2024-05-24 23:05:19,175: WARNING/ForkPoolWorker-16] Dag 'vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:05:19.176282175Z [2024-05-24 23:05:19,175: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:05:19.177148575Z [2024-05-24 23:05:19,176: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:05:19.179878409Z [2024-05-24 23:05:19,179: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:05:19.191588342Z [2024-05-24 23:05:19,191: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:05:19.192842275Z [2024-05-24 23:05:19,192: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:05:19.193024680Z [2024-05-24 23:05:19,192: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:05:19.193268149Z [2024-05-24 23:05:19,192: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:05:19.193449798Z [2024-05-24 23:05:19,193: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:05:19.193693679Z [2024-05-24 23:05:19,193: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:05:19.193906204Z [2024-05-24 23:05:19,193: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:05:19.197543236Z [2024-05-24 23:05:19,196: ERROR/ForkPoolWorker-16] [fcc56adb-e572-4875-8d44-07ea7dc88119] Failed to execute task Dag 'vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0' could not be found; either it does not exist or it failed to parse.. 2024-05-24T23:05:19.197555045Z Traceback (most recent call last): 2024-05-24T23:05:19.197558879Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-24T23:05:19.197562654Z args.func(args) 2024-05-24T23:05:19.197582772Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-24T23:05:19.197587102Z return func(*args, **kwargs) 2024-05-24T23:05:19.197590138Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-24T23:05:19.197593122Z return f(*args, **kwargs) 2024-05-24T23:05:19.197596206Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-24T23:05:19.197599300Z dag = get_dag(args.subdir, args.dag_id) 2024-05-24T23:05:19.197602290Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-24T23:05:19.197605177Z raise AirflowException( 2024-05-24T23:05:19.197611762Z airflow.exceptions.AirflowException: Dag 'vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0' could not be found; either it does not exist or it failed to parse. 2024-05-24T23:05:19.245625680Z [2024-05-24 23:05:19,244: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fcc56adb-e572-4875-8d44-07ea7dc88119] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fcc56adb-e572-4875-8d44-07ea7dc88119') 2024-05-24T23:05:19.245662835Z Traceback (most recent call last): 2024-05-24T23:05:19.245673230Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-24T23:05:19.245707674Z R = retval = fun(*args, **kwargs) 2024-05-24T23:05:19.245716325Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-24T23:05:19.245724580Z return self.run(*args, **kwargs) 2024-05-24T23:05:19.245733662Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-24T23:05:19.245743612Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-24T23:05:19.245751902Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-24T23:05:19.245761181Z raise AirflowException(msg) 2024-05-24T23:05:19.245770611Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fcc56adb-e572-4875-8d44-07ea7dc88119 2024-05-24T23:06:01.320104514Z [2024-05-24 23:06:01,319: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7370cde-3965-4af6-9d79-fc1c07249493] received 2024-05-24T23:06:01.321803976Z [2024-05-24 23:06:01,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0108171c-02c6-424a-b0f2-565a751e24e2] received 2024-05-24T23:06:01.329929792Z [2024-05-24 23:06:01,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89558b05-2521-480a-978b-eecb4c0e19ee] received 2024-05-24T23:06:01.344099945Z [2024-05-24 23:06:01,335: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0370c47-e5b0-4139-9faa-721279f6ae9f] received 2024-05-24T23:06:01.344122544Z [2024-05-24 23:06:01,336: INFO/ForkPoolWorker-16] [0108171c-02c6-424a-b0f2-565a751e24e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:06:01.344128088Z [2024-05-24 23:06:01,338: INFO/ForkPoolWorker-15] [c7370cde-3965-4af6-9d79-fc1c07249493] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:06:01.344131454Z [2024-05-24 23:06:01,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a2bd1a0-9938-4ccc-bf1e-3ecca8b8e81e] received 2024-05-24T23:06:01.353379736Z [2024-05-24 23:06:01,345: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db22c72d-2d6d-4042-aad0-5acd846000d8] received 2024-05-24T23:06:01.353402058Z [2024-05-24 23:06:01,349: INFO/ForkPoolWorker-1] [89558b05-2521-480a-978b-eecb4c0e19ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:06:01.357324574Z [2024-05-24 23:06:01,353: INFO/ForkPoolWorker-2] [b0370c47-e5b0-4139-9faa-721279f6ae9f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:06:01.357342538Z [2024-05-24 23:06:01,354: INFO/ForkPoolWorker-4] [db22c72d-2d6d-4042-aad0-5acd846000d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:06:01.360136645Z [2024-05-24 23:06:01,358: INFO/ForkPoolWorker-3] [0a2bd1a0-9938-4ccc-bf1e-3ecca8b8e81e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:06:01.361548464Z [2024-05-24 23:06:01,360: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2320c7b-566d-448e-8810-a4fbf032c8a4] received 2024-05-24T23:06:01.363355886Z [2024-05-24 23:06:01,362: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[249bd0cc-f9c3-48cd-b17f-72a20a000306] received 2024-05-24T23:06:01.374026118Z [2024-05-24 23:06:01,373: INFO/ForkPoolWorker-5] [d2320c7b-566d-448e-8810-a4fbf032c8a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:06:01.374483338Z [2024-05-24 23:06:01,374: INFO/ForkPoolWorker-6] [249bd0cc-f9c3-48cd-b17f-72a20a000306] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:06:01.758147899Z [2024-05-24 23:06:01,754: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:06:01.814587283Z [2024-05-24 23:06:01,810: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:06:02.049123355Z [2024-05-24 23:06:02,045: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:06:02.064529296Z [2024-05-24 23:06:02,045: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:06:02.100919993Z [2024-05-24 23:06:02,097: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:06:02.273326311Z [2024-05-24 23:06:02,272: INFO/ForkPoolWorker-4] Getting SDNC list 2024-05-24T23:06:02.277852479Z [2024-05-24 23:06:02,277: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:06:02.341944873Z [2024-05-24 23:06:02,334: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:06:02.366733738Z [2024-05-24 23:06:02,366: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-05-24T23:06:02.370272368Z [2024-05-24 23:06:02,370: INFO/ForkPoolWorker-4] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:06:02.370624603Z [2024-05-24 23:06:02,370: INFO/ForkPoolWorker-4] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:06:02.370905939Z [2024-05-24 23:06:02,370: INFO/ForkPoolWorker-4] Getting SDNC list OK 2024-05-24T23:06:02.371592741Z [2024-05-24 23:06:02,371: INFO/ForkPoolWorker-4] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:06:02.454748641Z [2024-05-24 23:06:02,450: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:06:02.607978734Z [2024-05-24 23:06:02,607: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:06:02.638161422Z [2024-05-24 23:06:02,625: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:06:02.867050963Z [2024-05-24 23:06:02,866: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:06:03.992377082Z [2024-05-24 23:06:03,991: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[db22c72d-2d6d-4042-aad0-5acd846000d8] succeeded in 2.645010874000036s: None 2024-05-24T23:06:04.129477338Z [2024-05-24 23:06:04,125: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c7370cde-3965-4af6-9d79-fc1c07249493] succeeded in 2.802644611000005s: None 2024-05-24T23:06:04.395690401Z [2024-05-24 23:06:04,395: INFO/ForkPoolWorker-5] Getting VIM list 2024-05-24T23:06:04.403862053Z [2024-05-24 23:06:04,403: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:06:04.450037542Z [2024-05-24 23:06:04,449: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-05-24T23:06:04.453698377Z [2024-05-24 23:06:04,453: INFO/ForkPoolWorker-5] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:06:04.453795761Z [2024-05-24 23:06:04,453: INFO/ForkPoolWorker-5] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:06:04.454021747Z [2024-05-24 23:06:04,453: INFO/ForkPoolWorker-5] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:06:04.454143315Z [2024-05-24 23:06:04,454: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-05-24T23:06:04.454440170Z [2024-05-24 23:06:04,454: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:06:04.454502167Z [2024-05-24 23:06:04,454: INFO/ForkPoolWorker-5] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:06:04.567985104Z [2024-05-24 23:06:04,567: INFO/ForkPoolWorker-5] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:06:04.793510317Z [2024-05-24 23:06:04,793: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-24T23:06:04.796842556Z [2024-05-24 23:06:04,796: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:06:04.856878510Z [2024-05-24 23:06:04,856: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-24T23:06:04.859608268Z [2024-05-24 23:06:04,859: INFO/ForkPoolWorker-3] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:06:04.859621249Z [2024-05-24 23:06:04,859: INFO/ForkPoolWorker-3] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:06:04.859696841Z [2024-05-24 23:06:04,859: INFO/ForkPoolWorker-3] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:06:04.859723283Z [2024-05-24 23:06:04,859: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-24T23:06:04.860010952Z [2024-05-24 23:06:04,859: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:06:04.860117645Z [2024-05-24 23:06:04,859: INFO/ForkPoolWorker-3] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:06:04.872290930Z [2024-05-24 23:06:04,872: WARNING/ForkPoolWorker-3] Dag 'vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:06:04.873643316Z [2024-05-24 23:06:04,872: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:06:04.877884225Z [2024-05-24 23:06:04,877: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-24T23:06:04.885045455Z [2024-05-24 23:06:04,884: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:06:04.922572548Z [2024-05-24 23:06:04,922: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-24T23:06:04.926733083Z [2024-05-24 23:06:04,926: INFO/ForkPoolWorker-3] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:06:04.926753380Z [2024-05-24 23:06:04,926: INFO/ForkPoolWorker-3] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:06:04.926905978Z [2024-05-24 23:06:04,926: INFO/ForkPoolWorker-3] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:06:04.926953039Z [2024-05-24 23:06:04,926: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-24T23:06:04.927214147Z [2024-05-24 23:06:04,927: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:06:04.927264064Z [2024-05-24 23:06:04,927: INFO/ForkPoolWorker-3] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:06:04.931769379Z [2024-05-24 23:06:04,931: ERROR/ForkPoolWorker-3] [0a2bd1a0-9938-4ccc-bf1e-3ecca8b8e81e] Failed to execute task Dag 'vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0' could not be found; either it does not exist or it failed to parse.. 2024-05-24T23:06:04.931785424Z Traceback (most recent call last): 2024-05-24T23:06:04.931789277Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-24T23:06:04.931792914Z args.func(args) 2024-05-24T23:06:04.931796427Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-24T23:06:04.931799902Z return func(*args, **kwargs) 2024-05-24T23:06:04.931802911Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-24T23:06:04.931806203Z return f(*args, **kwargs) 2024-05-24T23:06:04.931809079Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-24T23:06:04.931811968Z dag = get_dag(args.subdir, args.dag_id) 2024-05-24T23:06:04.931814908Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-24T23:06:04.931831849Z raise AirflowException( 2024-05-24T23:06:04.931835621Z airflow.exceptions.AirflowException: Dag 'vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0' could not be found; either it does not exist or it failed to parse. 2024-05-24T23:06:05.056936258Z [2024-05-24 23:06:05,056: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:06:05.060624368Z [2024-05-24 23:06:05,060: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:06:05.110027558Z [2024-05-24 23:06:05,106: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[0a2bd1a0-9938-4ccc-bf1e-3ecca8b8e81e] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0a2bd1a0-9938-4ccc-bf1e-3ecca8b8e81e') 2024-05-24T23:06:05.110046754Z Traceback (most recent call last): 2024-05-24T23:06:05.110050831Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-24T23:06:05.110053918Z R = retval = fun(*args, **kwargs) 2024-05-24T23:06:05.110056883Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-24T23:06:05.110060511Z return self.run(*args, **kwargs) 2024-05-24T23:06:05.110064041Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-24T23:06:05.110067764Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-24T23:06:05.110070631Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-24T23:06:05.110074139Z raise AirflowException(msg) 2024-05-24T23:06:05.110083054Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0a2bd1a0-9938-4ccc-bf1e-3ecca8b8e81e 2024-05-24T23:06:05.126382754Z [2024-05-24 23:06:05,126: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:06:05.130433049Z [2024-05-24 23:06:05,130: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:06:05.130453520Z [2024-05-24 23:06:05,130: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:06:05.130600262Z [2024-05-24 23:06:05,130: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:06:05.130653017Z [2024-05-24 23:06:05,130: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:06:05.130927710Z [2024-05-24 23:06:05,130: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:06:05.130988181Z [2024-05-24 23:06:05,130: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:06:05.140603613Z [2024-05-24 23:06:05,140: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:06:05.141678652Z [2024-05-24 23:06:05,140: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:06:05.142428381Z [2024-05-24 23:06:05,142: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:06:05.148532434Z [2024-05-24 23:06:05,148: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:06:05.203664392Z [2024-05-24 23:06:05,203: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:06:05.212686158Z [2024-05-24 23:06:05,212: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:06:05.213584547Z [2024-05-24 23:06:05,213: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:06:05.221994061Z [2024-05-24 23:06:05,221: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:06:05.222010042Z [2024-05-24 23:06:05,221: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:06:05.222095265Z [2024-05-24 23:06:05,221: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:06:05.222123385Z [2024-05-24 23:06:05,222: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:06:05.222322724Z [2024-05-24 23:06:05,222: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:06:05.222346989Z [2024-05-24 23:06:05,222: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:06:05.225501014Z [2024-05-24 23:06:05,224: ERROR/ForkPoolWorker-16] [0108171c-02c6-424a-b0f2-565a751e24e2] Failed to execute task Dag 'vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0' could not be found; either it does not exist or it failed to parse.. 2024-05-24T23:06:05.225515210Z Traceback (most recent call last): 2024-05-24T23:06:05.225519397Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-24T23:06:05.225523081Z args.func(args) 2024-05-24T23:06:05.225526488Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-24T23:06:05.225530232Z return func(*args, **kwargs) 2024-05-24T23:06:05.225533163Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-24T23:06:05.225536034Z return f(*args, **kwargs) 2024-05-24T23:06:05.225538965Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-24T23:06:05.225542197Z dag = get_dag(args.subdir, args.dag_id) 2024-05-24T23:06:05.225545070Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-24T23:06:05.225547892Z raise AirflowException( 2024-05-24T23:06:05.225551686Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0' could not be found; either it does not exist or it failed to parse. 2024-05-24T23:06:05.290235430Z [2024-05-24 23:06:05,289: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:06:05.294870978Z [2024-05-24 23:06:05,293: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:06:05.313893105Z [2024-05-24 23:06:05,313: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0108171c-02c6-424a-b0f2-565a751e24e2] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0108171c-02c6-424a-b0f2-565a751e24e2') 2024-05-24T23:06:05.313904844Z Traceback (most recent call last): 2024-05-24T23:06:05.313908548Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-24T23:06:05.313911783Z R = retval = fun(*args, **kwargs) 2024-05-24T23:06:05.313914695Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-24T23:06:05.313917886Z return self.run(*args, **kwargs) 2024-05-24T23:06:05.313921364Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-24T23:06:05.313925290Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-24T23:06:05.313928378Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-24T23:06:05.313931860Z raise AirflowException(msg) 2024-05-24T23:06:05.313935553Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0108171c-02c6-424a-b0f2-565a751e24e2 2024-05-24T23:06:05.318082652Z [2024-05-24 23:06:05,317: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:06:05.320734396Z [2024-05-24 23:06:05,320: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:06:05.320881342Z [2024-05-24 23:06:05,320: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:06:05.321249527Z [2024-05-24 23:06:05,320: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:06:05.321385465Z [2024-05-24 23:06:05,321: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:06:05.322098918Z [2024-05-24 23:06:05,321: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:06:05.322243805Z [2024-05-24 23:06:05,322: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:06:05.334338393Z [2024-05-24 23:06:05,334: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:06:05.336817437Z [2024-05-24 23:06:05,336: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:06:05.336857496Z [2024-05-24 23:06:05,336: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:06:05.337029303Z [2024-05-24 23:06:05,336: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:06:05.337093587Z [2024-05-24 23:06:05,337: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:06:05.337397528Z [2024-05-24 23:06:05,337: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:06:05.337454698Z [2024-05-24 23:06:05,337: INFO/ForkPoolWorker-2] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:06:05.347213282Z [2024-05-24 23:06:05,346: WARNING/ForkPoolWorker-2] Dag 'vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:06:05.348208855Z [2024-05-24 23:06:05,347: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:06:05.349462812Z [2024-05-24 23:06:05,349: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:06:05.352216088Z [2024-05-24 23:06:05,351: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:06:05.375965739Z [2024-05-24 23:06:05,375: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:06:05.377519544Z [2024-05-24 23:06:05,377: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:06:05.377534940Z [2024-05-24 23:06:05,377: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:06:05.377709831Z [2024-05-24 23:06:05,377: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:06:05.377756381Z [2024-05-24 23:06:05,377: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:06:05.378137033Z [2024-05-24 23:06:05,377: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:06:05.378192055Z [2024-05-24 23:06:05,378: INFO/ForkPoolWorker-2] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:06:05.381877010Z [2024-05-24 23:06:05,381: ERROR/ForkPoolWorker-2] [b0370c47-e5b0-4139-9faa-721279f6ae9f] Failed to execute task Dag 'vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b' could not be found; either it does not exist or it failed to parse.. 2024-05-24T23:06:05.381889069Z Traceback (most recent call last): 2024-05-24T23:06:05.381893400Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-24T23:06:05.381896900Z args.func(args) 2024-05-24T23:06:05.381900098Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-24T23:06:05.381903448Z return func(*args, **kwargs) 2024-05-24T23:06:05.381906220Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-24T23:06:05.381908939Z return f(*args, **kwargs) 2024-05-24T23:06:05.381912589Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-24T23:06:05.381915927Z dag = get_dag(args.subdir, args.dag_id) 2024-05-24T23:06:05.381918726Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-24T23:06:05.381921460Z raise AirflowException( 2024-05-24T23:06:05.381924695Z airflow.exceptions.AirflowException: Dag 'vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b' could not be found; either it does not exist or it failed to parse. 2024-05-24T23:06:05.442458956Z [2024-05-24 23:06:05,442: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:06:05.450279932Z [2024-05-24 23:06:05,449: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b0370c47-e5b0-4139-9faa-721279f6ae9f] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id b0370c47-e5b0-4139-9faa-721279f6ae9f') 2024-05-24T23:06:05.450309694Z Traceback (most recent call last): 2024-05-24T23:06:05.450314052Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-24T23:06:05.450317125Z R = retval = fun(*args, **kwargs) 2024-05-24T23:06:05.450320095Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-24T23:06:05.450322993Z return self.run(*args, **kwargs) 2024-05-24T23:06:05.450326473Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-24T23:06:05.450330285Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-24T23:06:05.450336840Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-24T23:06:05.450340712Z raise AirflowException(msg) 2024-05-24T23:06:05.450344344Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id b0370c47-e5b0-4139-9faa-721279f6ae9f 2024-05-24T23:06:05.710244560Z [2024-05-24 23:06:05,709: INFO/ForkPoolWorker-6] Getting VIM list 2024-05-24T23:06:05.714932972Z [2024-05-24 23:06:05,714: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:06:05.745351503Z [2024-05-24 23:06:05,745: INFO/ForkPoolWorker-6] Connected to database osm version 1.2 2024-05-24T23:06:05.746633616Z [2024-05-24 23:06:05,746: INFO/ForkPoolWorker-6] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:06:05.746780137Z [2024-05-24 23:06:05,746: INFO/ForkPoolWorker-6] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:06:05.746967624Z [2024-05-24 23:06:05,746: INFO/ForkPoolWorker-6] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:06:05.747094458Z [2024-05-24 23:06:05,746: INFO/ForkPoolWorker-6] Getting VIM list OK 2024-05-24T23:06:05.747399267Z [2024-05-24 23:06:05,747: INFO/ForkPoolWorker-6] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:06:05.747506933Z [2024-05-24 23:06:05,747: INFO/ForkPoolWorker-6] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:06:05.754487592Z [2024-05-24 23:06:05,754: WARNING/ForkPoolWorker-6] Dag 'vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:06:05.755419192Z [2024-05-24 23:06:05,754: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:06:05.756291140Z [2024-05-24 23:06:05,756: INFO/ForkPoolWorker-6] Getting VIM list 2024-05-24T23:06:05.759054876Z [2024-05-24 23:06:05,758: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:06:05.793548341Z [2024-05-24 23:06:05,793: INFO/ForkPoolWorker-6] Connected to database osm version 1.2 2024-05-24T23:06:05.796714588Z [2024-05-24 23:06:05,796: INFO/ForkPoolWorker-6] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:06:05.797073089Z [2024-05-24 23:06:05,796: INFO/ForkPoolWorker-6] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:06:05.797535029Z [2024-05-24 23:06:05,797: INFO/ForkPoolWorker-6] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:06:05.797786234Z [2024-05-24 23:06:05,797: INFO/ForkPoolWorker-6] Getting VIM list OK 2024-05-24T23:06:05.798300425Z [2024-05-24 23:06:05,798: INFO/ForkPoolWorker-6] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:06:05.798574276Z [2024-05-24 23:06:05,798: INFO/ForkPoolWorker-6] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:06:05.808187773Z [2024-05-24 23:06:05,807: ERROR/ForkPoolWorker-6] [249bd0cc-f9c3-48cd-b17f-72a20a000306] Failed to execute task Dag 'vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b' could not be found; either it does not exist or it failed to parse.. 2024-05-24T23:06:05.808204700Z Traceback (most recent call last): 2024-05-24T23:06:05.808208733Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-24T23:06:05.808212524Z args.func(args) 2024-05-24T23:06:05.808216294Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-24T23:06:05.808219959Z return func(*args, **kwargs) 2024-05-24T23:06:05.808223349Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-24T23:06:05.808226366Z return f(*args, **kwargs) 2024-05-24T23:06:05.808229430Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-24T23:06:05.808232681Z dag = get_dag(args.subdir, args.dag_id) 2024-05-24T23:06:05.808235730Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-24T23:06:05.808238743Z raise AirflowException( 2024-05-24T23:06:05.808242318Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b' could not be found; either it does not exist or it failed to parse. 2024-05-24T23:06:05.868176057Z [2024-05-24 23:06:05,867: ERROR/ForkPoolWorker-6] Task airflow.executors.celery_executor.execute_command[249bd0cc-f9c3-48cd-b17f-72a20a000306] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 249bd0cc-f9c3-48cd-b17f-72a20a000306') 2024-05-24T23:06:05.868203037Z Traceback (most recent call last): 2024-05-24T23:06:05.868210195Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-24T23:06:05.868215878Z R = retval = fun(*args, **kwargs) 2024-05-24T23:06:05.868221443Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-24T23:06:05.868226966Z return self.run(*args, **kwargs) 2024-05-24T23:06:05.868233407Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-24T23:06:05.868239810Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-24T23:06:05.868245585Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-24T23:06:05.868251852Z raise AirflowException(msg) 2024-05-24T23:06:05.868258179Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 249bd0cc-f9c3-48cd-b17f-72a20a000306 2024-05-24T23:06:06.461394993Z [2024-05-24 23:06:06,460: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[d2320c7b-566d-448e-8810-a4fbf032c8a4] succeeded in 5.097457399000177s: None 2024-05-24T23:06:07.304668377Z [2024-05-24 23:06:07,304: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[89558b05-2521-480a-978b-eecb4c0e19ee] succeeded in 5.965537635999908s: None 2024-05-24T23:06:16.166315778Z [2024-05-24 23:06:16,165: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b1711a4-a72a-43c5-973a-ebe811fca475] received 2024-05-24T23:06:16.169060777Z [2024-05-24 23:06:16,168: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59345422-fcd7-4419-9809-fa376e201510] received 2024-05-24T23:06:16.176994218Z [2024-05-24 23:06:16,176: INFO/ForkPoolWorker-15] [1b1711a4-a72a-43c5-973a-ebe811fca475] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:06:16.179867191Z [2024-05-24 23:06:16,179: INFO/ForkPoolWorker-16] [59345422-fcd7-4419-9809-fa376e201510] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:06:16.412385551Z [2024-05-24 23:06:16,412: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd67eab7-07e3-4008-87cd-e5aeb5638585] received 2024-05-24T23:06:16.418811814Z [2024-05-24 23:06:16,418: INFO/ForkPoolWorker-1] [cd67eab7-07e3-4008-87cd-e5aeb5638585] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:06:16.437998539Z [2024-05-24 23:06:16,437: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[784eb042-aa89-4e6b-a589-91aae54714ba] received 2024-05-24T23:06:16.447522155Z [2024-05-24 23:06:16,447: INFO/ForkPoolWorker-2] [784eb042-aa89-4e6b-a589-91aae54714ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:06:16.509715534Z [2024-05-24 23:06:16,493: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:06:16.547756877Z [2024-05-24 23:06:16,544: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:06:16.817736004Z [2024-05-24 23:06:16,814: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:06:16.846530749Z [2024-05-24 23:06:16,843: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:06:17.711483634Z [2024-05-24 23:06:17,711: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:06:17.714751803Z [2024-05-24 23:06:17,714: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:06:17.758890840Z [2024-05-24 23:06:17,758: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:06:17.769485823Z [2024-05-24 23:06:17,763: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:06:17.769500217Z [2024-05-24 23:06:17,763: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:06:17.769503964Z [2024-05-24 23:06:17,764: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:06:17.769507589Z [2024-05-24 23:06:17,764: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:06:17.769510632Z [2024-05-24 23:06:17,764: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:06:17.769513591Z [2024-05-24 23:06:17,764: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:06:17.789060099Z [2024-05-24 23:06:17,788: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:06:17.790380938Z [2024-05-24 23:06:17,788: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:06:17.791359260Z [2024-05-24 23:06:17,791: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:06:17.794748826Z [2024-05-24 23:06:17,794: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:06:17.840733964Z [2024-05-24 23:06:17,840: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:06:17.843581841Z [2024-05-24 23:06:17,843: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:06:17.843613414Z [2024-05-24 23:06:17,843: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:06:17.843707554Z [2024-05-24 23:06:17,843: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:06:17.843752663Z [2024-05-24 23:06:17,843: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:06:17.844014163Z [2024-05-24 23:06:17,843: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:06:17.844096247Z [2024-05-24 23:06:17,843: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:06:17.847131013Z [2024-05-24 23:06:17,846: ERROR/ForkPoolWorker-15] [1b1711a4-a72a-43c5-973a-ebe811fca475] Failed to execute task Dag 'vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0' could not be found; either it does not exist or it failed to parse.. 2024-05-24T23:06:17.847145494Z Traceback (most recent call last): 2024-05-24T23:06:17.847149999Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-24T23:06:17.847153952Z args.func(args) 2024-05-24T23:06:17.847157802Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-24T23:06:17.847161908Z return func(*args, **kwargs) 2024-05-24T23:06:17.847164976Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-24T23:06:17.847179836Z return f(*args, **kwargs) 2024-05-24T23:06:17.847183018Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-24T23:06:17.847185897Z dag = get_dag(args.subdir, args.dag_id) 2024-05-24T23:06:17.847188882Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-24T23:06:17.847192023Z raise AirflowException( 2024-05-24T23:06:17.847197086Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_ecec2318-e808-4328-be1c-1c2aff703fb0' could not be found; either it does not exist or it failed to parse. 2024-05-24T23:06:17.880461312Z [2024-05-24 23:06:17,879: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1b1711a4-a72a-43c5-973a-ebe811fca475] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1b1711a4-a72a-43c5-973a-ebe811fca475') 2024-05-24T23:06:17.880474886Z Traceback (most recent call last): 2024-05-24T23:06:17.880478804Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-24T23:06:17.880482114Z R = retval = fun(*args, **kwargs) 2024-05-24T23:06:17.880485109Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-24T23:06:17.880488694Z return self.run(*args, **kwargs) 2024-05-24T23:06:17.880492080Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-24T23:06:17.880496865Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-24T23:06:17.880499990Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-24T23:06:17.880509890Z raise AirflowException(msg) 2024-05-24T23:06:17.880515384Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1b1711a4-a72a-43c5-973a-ebe811fca475 2024-05-24T23:06:17.904984978Z [2024-05-24 23:06:17,904: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:06:17.908158725Z [2024-05-24 23:06:17,907: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:06:17.928665533Z [2024-05-24 23:06:17,928: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:06:17.934687158Z [2024-05-24 23:06:17,934: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:06:17.938390629Z [2024-05-24 23:06:17,938: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:06:17.943027368Z [2024-05-24 23:06:17,942: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:06:17.943105696Z [2024-05-24 23:06:17,942: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:06:17.943290096Z [2024-05-24 23:06:17,943: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:06:17.943379382Z [2024-05-24 23:06:17,943: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:06:17.943715885Z [2024-05-24 23:06:17,943: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:06:17.943806163Z [2024-05-24 23:06:17,943: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:06:17.953992383Z [2024-05-24 23:06:17,953: WARNING/ForkPoolWorker-16] Dag 'vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:06:17.955121993Z [2024-05-24 23:06:17,954: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:06:17.956063996Z [2024-05-24 23:06:17,955: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:06:17.959244581Z [2024-05-24 23:06:17,959: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:06:17.965494605Z [2024-05-24 23:06:17,965: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:06:17.966912491Z [2024-05-24 23:06:17,966: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:06:17.967182885Z [2024-05-24 23:06:17,966: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:06:17.968397292Z [2024-05-24 23:06:17,967: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:06:17.968402432Z [2024-05-24 23:06:17,967: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:06:17.968406344Z [2024-05-24 23:06:17,967: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:06:17.968409606Z [2024-05-24 23:06:17,967: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:06:17.975591023Z [2024-05-24 23:06:17,975: WARNING/ForkPoolWorker-1] Dag 'vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:06:17.981302068Z [2024-05-24 23:06:17,975: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:06:17.981319869Z [2024-05-24 23:06:17,977: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:06:17.981324203Z [2024-05-24 23:06:17,979: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:06:17.990540726Z [2024-05-24 23:06:17,990: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:06:17.993318683Z [2024-05-24 23:06:17,992: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:06:17.993386284Z [2024-05-24 23:06:17,992: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:06:17.993391261Z [2024-05-24 23:06:17,993: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:06:17.993418642Z [2024-05-24 23:06:17,993: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:06:17.993501483Z [2024-05-24 23:06:17,993: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:06:17.993807773Z [2024-05-24 23:06:17,993: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:06:17.993843409Z [2024-05-24 23:06:17,993: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:06:17.994615500Z [2024-05-24 23:06:17,994: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:06:17.995796377Z [2024-05-24 23:06:17,995: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:06:17.995808208Z [2024-05-24 23:06:17,995: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:06:17.995814386Z [2024-05-24 23:06:17,995: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:06:17.995817509Z [2024-05-24 23:06:17,995: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:06:17.995820330Z [2024-05-24 23:06:17,995: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:06:17.998345652Z [2024-05-24 23:06:17,997: ERROR/ForkPoolWorker-16] [59345422-fcd7-4419-9809-fa376e201510] Failed to execute task Dag 'vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b' could not be found; either it does not exist or it failed to parse.. 2024-05-24T23:06:17.998358166Z Traceback (most recent call last): 2024-05-24T23:06:17.998361997Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-24T23:06:17.998366305Z args.func(args) 2024-05-24T23:06:17.998369832Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-24T23:06:17.998373734Z return func(*args, **kwargs) 2024-05-24T23:06:17.998376725Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-24T23:06:17.998379730Z return f(*args, **kwargs) 2024-05-24T23:06:17.998389885Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-24T23:06:17.998392964Z dag = get_dag(args.subdir, args.dag_id) 2024-05-24T23:06:17.998395933Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-24T23:06:17.998398873Z raise AirflowException( 2024-05-24T23:06:17.998403114Z airflow.exceptions.AirflowException: Dag 'vim_status_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b' could not be found; either it does not exist or it failed to parse. 2024-05-24T23:06:18.000488049Z [2024-05-24 23:06:17,999: ERROR/ForkPoolWorker-1] [cd67eab7-07e3-4008-87cd-e5aeb5638585] Failed to execute task Dag 'vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0' could not be found; either it does not exist or it failed to parse.. 2024-05-24T23:06:18.000501075Z Traceback (most recent call last): 2024-05-24T23:06:18.000505023Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-24T23:06:18.000509278Z args.func(args) 2024-05-24T23:06:18.000512670Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-24T23:06:18.000517124Z return func(*args, **kwargs) 2024-05-24T23:06:18.000520098Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-24T23:06:18.000540957Z return f(*args, **kwargs) 2024-05-24T23:06:18.000544040Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-24T23:06:18.000547179Z dag = get_dag(args.subdir, args.dag_id) 2024-05-24T23:06:18.000550077Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-24T23:06:18.000552982Z raise AirflowException( 2024-05-24T23:06:18.000558707Z airflow.exceptions.AirflowException: Dag 'vim_status_ecec2318-e808-4328-be1c-1c2aff703fb0' could not be found; either it does not exist or it failed to parse. 2024-05-24T23:06:18.060091630Z [2024-05-24 23:06:18,057: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cd67eab7-07e3-4008-87cd-e5aeb5638585] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id cd67eab7-07e3-4008-87cd-e5aeb5638585') 2024-05-24T23:06:18.060110401Z Traceback (most recent call last): 2024-05-24T23:06:18.060133333Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-24T23:06:18.060137324Z R = retval = fun(*args, **kwargs) 2024-05-24T23:06:18.060140429Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-24T23:06:18.060143584Z return self.run(*args, **kwargs) 2024-05-24T23:06:18.060147609Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-24T23:06:18.060151775Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-24T23:06:18.060154957Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-24T23:06:18.060159511Z raise AirflowException(msg) 2024-05-24T23:06:18.060165602Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id cd67eab7-07e3-4008-87cd-e5aeb5638585 2024-05-24T23:06:18.061526590Z [2024-05-24 23:06:18,060: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[59345422-fcd7-4419-9809-fa376e201510] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 59345422-fcd7-4419-9809-fa376e201510') 2024-05-24T23:06:18.061541239Z Traceback (most recent call last): 2024-05-24T23:06:18.061545378Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-24T23:06:18.061548383Z R = retval = fun(*args, **kwargs) 2024-05-24T23:06:18.061551191Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-24T23:06:18.061554283Z return self.run(*args, **kwargs) 2024-05-24T23:06:18.061558311Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-24T23:06:18.061561854Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-24T23:06:18.061564824Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-24T23:06:18.061568545Z raise AirflowException(msg) 2024-05-24T23:06:18.061571805Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 59345422-fcd7-4419-9809-fa376e201510 2024-05-24T23:06:18.255270068Z [2024-05-24 23:06:18,254: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:06:18.265624052Z [2024-05-24 23:06:18,257: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:06:18.280864239Z [2024-05-24 23:06:18,280: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:06:18.282080665Z [2024-05-24 23:06:18,281: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:06:18.282104168Z [2024-05-24 23:06:18,282: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:06:18.282321005Z [2024-05-24 23:06:18,282: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:06:18.282333959Z [2024-05-24 23:06:18,282: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:06:18.282512083Z [2024-05-24 23:06:18,282: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:06:18.282532693Z [2024-05-24 23:06:18,282: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:06:18.289308452Z [2024-05-24 23:06:18,289: WARNING/ForkPoolWorker-2] Dag 'vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:06:18.290179694Z [2024-05-24 23:06:18,289: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:06:18.290918384Z [2024-05-24 23:06:18,290: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:06:18.293682055Z [2024-05-24 23:06:18,293: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:06:18.307581431Z [2024-05-24 23:06:18,307: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:06:18.308717642Z [2024-05-24 23:06:18,308: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:06:18.308731014Z [2024-05-24 23:06:18,308: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:06:18.308855684Z [2024-05-24 23:06:18,308: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:06:18.308868412Z [2024-05-24 23:06:18,308: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:06:18.309070150Z [2024-05-24 23:06:18,308: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:06:18.309082126Z [2024-05-24 23:06:18,308: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:06:18.312325809Z [2024-05-24 23:06:18,311: ERROR/ForkPoolWorker-2] [784eb042-aa89-4e6b-a589-91aae54714ba] Failed to execute task Dag 'vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b' could not be found; either it does not exist or it failed to parse.. 2024-05-24T23:06:18.312353960Z Traceback (most recent call last): 2024-05-24T23:06:18.312363180Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-24T23:06:18.312391742Z args.func(args) 2024-05-24T23:06:18.312400598Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-24T23:06:18.312409301Z return func(*args, **kwargs) 2024-05-24T23:06:18.312416930Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-24T23:06:18.312445175Z return f(*args, **kwargs) 2024-05-24T23:06:18.312453138Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-24T23:06:18.312460749Z dag = get_dag(args.subdir, args.dag_id) 2024-05-24T23:06:18.312468317Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-24T23:06:18.312475852Z raise AirflowException( 2024-05-24T23:06:18.312492187Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_befa9b24-0cfb-4fc8-ac45-393bad6a5f0b' could not be found; either it does not exist or it failed to parse. 2024-05-24T23:06:18.349376165Z [2024-05-24 23:06:18,348: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[784eb042-aa89-4e6b-a589-91aae54714ba] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 784eb042-aa89-4e6b-a589-91aae54714ba') 2024-05-24T23:06:18.349403452Z Traceback (most recent call last): 2024-05-24T23:06:18.349411210Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-24T23:06:18.349416688Z R = retval = fun(*args, **kwargs) 2024-05-24T23:06:18.349421993Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-24T23:06:18.349427320Z return self.run(*args, **kwargs) 2024-05-24T23:06:18.349433925Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-24T23:06:18.349440795Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-24T23:06:18.349446045Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-24T23:06:18.349453204Z raise AirflowException(msg) 2024-05-24T23:06:18.349459056Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 784eb042-aa89-4e6b-a589-91aae54714ba 2024-05-24T23:07:00.353956017Z [2024-05-24 23:07:00,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37afaeef-8452-482e-a2af-b1256f26598c] received 2024-05-24T23:07:00.359649292Z [2024-05-24 23:07:00,359: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b24d645-e74a-49b6-a1cd-f23c31201e0e] received 2024-05-24T23:07:00.363502756Z [2024-05-24 23:07:00,362: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59ebe640-832c-4400-9b84-1efaee6b928f] received 2024-05-24T23:07:00.368385487Z [2024-05-24 23:07:00,368: INFO/ForkPoolWorker-15] [37afaeef-8452-482e-a2af-b1256f26598c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:07:00.372656386Z [2024-05-24 23:07:00,372: INFO/ForkPoolWorker-1] [59ebe640-832c-4400-9b84-1efaee6b928f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:07:00.373006829Z [2024-05-24 23:07:00,372: INFO/ForkPoolWorker-16] [2b24d645-e74a-49b6-a1cd-f23c31201e0e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:07:00.676515332Z [2024-05-24 23:07:00,673: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:07:00.688220070Z [2024-05-24 23:07:00,685: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:07:00.699467037Z [2024-05-24 23:07:00,694: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:07:00.838996056Z [2024-05-24 23:07:00,838: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-24T23:07:00.845394821Z [2024-05-24 23:07:00,844: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:07:00.876935072Z [2024-05-24 23:07:00,876: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:07:00.878170265Z [2024-05-24 23:07:00,877: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:07:00.878356000Z [2024-05-24 23:07:00,878: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:07:00.878506280Z [2024-05-24 23:07:00,878: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-24T23:07:00.878824270Z [2024-05-24 23:07:00,878: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:07:01.010471802Z [2024-05-24 23:07:01,010: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:07:01.589554957Z [2024-05-24 23:07:01,589: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[59ebe640-832c-4400-9b84-1efaee6b928f] succeeded in 1.2235932769999636s: None 2024-05-24T23:07:01.871572192Z [2024-05-24 23:07:01,871: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:07:01.874913175Z [2024-05-24 23:07:01,874: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:07:01.898457623Z [2024-05-24 23:07:01,898: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:07:01.900544688Z [2024-05-24 23:07:01,900: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:07:01.900730173Z [2024-05-24 23:07:01,900: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:07:01.900978327Z [2024-05-24 23:07:01,900: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:07:01.901130893Z [2024-05-24 23:07:01,901: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:07:01.901970147Z [2024-05-24 23:07:01,901: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:07:01.902126387Z [2024-05-24 23:07:01,902: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:07:01.980276004Z [2024-05-24 23:07:01,979: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:07:01.983460160Z [2024-05-24 23:07:01,983: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:07:01.988603641Z [2024-05-24 23:07:01,988: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:07:02.022960910Z [2024-05-24 23:07:02,022: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:07:02.027090389Z [2024-05-24 23:07:02,026: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:07:02.027548005Z [2024-05-24 23:07:02,027: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:07:02.027990008Z [2024-05-24 23:07:02,027: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:07:02.028282327Z [2024-05-24 23:07:02,028: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:07:02.028803620Z [2024-05-24 23:07:02,028: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:07:02.028914108Z [2024-05-24 23:07:02,028: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:07:02.134598830Z [2024-05-24 23:07:02,134: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:07:03.715201054Z [2024-05-24 23:07:03,714: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[37afaeef-8452-482e-a2af-b1256f26598c] succeeded in 3.3590332090000175s: None 2024-05-24T23:07:03.903674052Z [2024-05-24 23:07:03,902: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2b24d645-e74a-49b6-a1cd-f23c31201e0e] succeeded in 3.5417848520000916s: None 2024-05-24T23:08:00.815405101Z [2024-05-24 23:08:00,814: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b20886a-e3ee-45f0-8c1b-5b3594046bb3] received 2024-05-24T23:08:00.818412857Z [2024-05-24 23:08:00,818: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d9a62a9-ac5f-4312-9e20-14ab3f789f8c] received 2024-05-24T23:08:00.820301203Z [2024-05-24 23:08:00,820: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1fb4da1d-21d2-4e98-b3fc-d44cdf5874e5] received 2024-05-24T23:08:00.830587565Z [2024-05-24 23:08:00,830: INFO/ForkPoolWorker-16] [5d9a62a9-ac5f-4312-9e20-14ab3f789f8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:08:00.832093322Z [2024-05-24 23:08:00,831: INFO/ForkPoolWorker-15] [0b20886a-e3ee-45f0-8c1b-5b3594046bb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:08:00.833074443Z [2024-05-24 23:08:00,832: INFO/ForkPoolWorker-1] [1fb4da1d-21d2-4e98-b3fc-d44cdf5874e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:08:00.836437802Z [2024-05-24 23:08:00,836: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48fb34bb-c6d7-47fe-a727-4d6ec9bd7250] received 2024-05-24T23:08:00.858687511Z [2024-05-24 23:08:00,858: INFO/ForkPoolWorker-2] [48fb34bb-c6d7-47fe-a727-4d6ec9bd7250] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:08:01.125164083Z [2024-05-24 23:08:01,121: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:08:01.200591856Z [2024-05-24 23:08:01,196: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:08:01.265044869Z [2024-05-24 23:08:01,259: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:08:01.290206348Z [2024-05-24 23:08:01,289: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-24T23:08:01.294404455Z [2024-05-24 23:08:01,293: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:08:01.302838108Z [2024-05-24 23:08:01,299: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:08:01.319321853Z [2024-05-24 23:08:01,319: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:08:01.320861429Z [2024-05-24 23:08:01,320: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:08:01.321263157Z [2024-05-24 23:08:01,320: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:08:01.321491548Z [2024-05-24 23:08:01,321: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-24T23:08:01.321854347Z [2024-05-24 23:08:01,321: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:08:01.462625752Z [2024-05-24 23:08:01,462: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:08:01.704137794Z [2024-05-24 23:08:01,703: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:08:02.093161694Z [2024-05-24 23:08:02,092: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5d9a62a9-ac5f-4312-9e20-14ab3f789f8c] succeeded in 1.270921129000044s: None 2024-05-24T23:08:02.495915643Z [2024-05-24 23:08:02,495: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0b20886a-e3ee-45f0-8c1b-5b3594046bb3] succeeded in 1.6778914760000134s: None 2024-05-24T23:08:02.678172171Z [2024-05-24 23:08:02,677: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:08:02.681833439Z [2024-05-24 23:08:02,681: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:08:02.706671838Z [2024-05-24 23:08:02,706: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:08:02.707902658Z [2024-05-24 23:08:02,707: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:08:02.708066631Z [2024-05-24 23:08:02,707: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:08:02.708315545Z [2024-05-24 23:08:02,708: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:08:02.708447834Z [2024-05-24 23:08:02,708: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:08:02.708803797Z [2024-05-24 23:08:02,708: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:08:02.708925378Z [2024-05-24 23:08:02,708: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:08:02.744883036Z [2024-05-24 23:08:02,744: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:08:02.748323849Z [2024-05-24 23:08:02,747: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:08:02.778006805Z [2024-05-24 23:08:02,777: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:08:02.779262610Z [2024-05-24 23:08:02,779: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:08:02.779406529Z [2024-05-24 23:08:02,779: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:08:02.779756786Z [2024-05-24 23:08:02,779: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:08:02.779885330Z [2024-05-24 23:08:02,779: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:08:02.780176915Z [2024-05-24 23:08:02,780: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:08:02.780357389Z [2024-05-24 23:08:02,780: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:08:02.819131964Z [2024-05-24 23:08:02,818: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:08:02.871338538Z [2024-05-24 23:08:02,870: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:08:04.512257382Z [2024-05-24 23:08:04,511: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1fb4da1d-21d2-4e98-b3fc-d44cdf5874e5] succeeded in 3.6870649830000275s: None 2024-05-24T23:08:04.992984624Z [2024-05-24 23:08:04,991: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[48fb34bb-c6d7-47fe-a727-4d6ec9bd7250] succeeded in 4.151669480999999s: None 2024-05-24T23:09:00.408698305Z [2024-05-24 23:09:00,408: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e29323ed-1fe5-4cea-8ed0-d563c321c2b2] received 2024-05-24T23:09:00.417361436Z [2024-05-24 23:09:00,414: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68d6c60b-7171-4998-8403-fb26ebf8f9ac] received 2024-05-24T23:09:00.421657772Z [2024-05-24 23:09:00,421: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d43fe0b-b7d3-4ba3-a1bb-1aa1b6e399fe] received 2024-05-24T23:09:00.437471151Z [2024-05-24 23:09:00,437: INFO/ForkPoolWorker-16] [68d6c60b-7171-4998-8403-fb26ebf8f9ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:09:00.438349066Z [2024-05-24 23:09:00,438: INFO/ForkPoolWorker-1] [7d43fe0b-b7d3-4ba3-a1bb-1aa1b6e399fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:09:00.439425395Z [2024-05-24 23:09:00,437: INFO/ForkPoolWorker-15] [e29323ed-1fe5-4cea-8ed0-d563c321c2b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:09:00.745163106Z [2024-05-24 23:09:00,742: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:09:00.753107218Z [2024-05-24 23:09:00,747: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:09:00.867643965Z [2024-05-24 23:09:00,864: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:09:00.969733035Z [2024-05-24 23:09:00,965: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-24T23:09:00.976231357Z [2024-05-24 23:09:00,975: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:09:01.062266788Z [2024-05-24 23:09:01,055: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:09:01.062278581Z [2024-05-24 23:09:01,057: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:09:01.062282442Z [2024-05-24 23:09:01,058: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:09:01.062298613Z [2024-05-24 23:09:01,058: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-24T23:09:01.062302490Z [2024-05-24 23:09:01,058: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:09:01.177230515Z [2024-05-24 23:09:01,176: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:09:02.766478710Z [2024-05-24 23:09:02,766: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[68d6c60b-7171-4998-8403-fb26ebf8f9ac] succeeded in 2.349462119000009s: None 2024-05-24T23:09:03.855082176Z [2024-05-24 23:09:03,854: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:09:03.869611576Z [2024-05-24 23:09:03,868: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:09:03.952239734Z [2024-05-24 23:09:03,947: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:09:03.962693476Z [2024-05-24 23:09:03,956: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:09:03.962713023Z [2024-05-24 23:09:03,960: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:09:03.968000499Z [2024-05-24 23:09:03,960: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:09:03.968020593Z [2024-05-24 23:09:03,963: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:09:03.969570350Z [2024-05-24 23:09:03,966: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:09:03.980269786Z [2024-05-24 23:09:03,969: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:09:04.368366958Z [2024-05-24 23:09:04,368: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:09:04.531187701Z [2024-05-24 23:09:04,528: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:09:04.532449436Z [2024-05-24 23:09:04,532: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:09:04.593277553Z [2024-05-24 23:09:04,590: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:09:04.593300821Z [2024-05-24 23:09:04,592: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:09:04.593305810Z [2024-05-24 23:09:04,592: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:09:04.593310851Z [2024-05-24 23:09:04,592: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:09:04.593316049Z [2024-05-24 23:09:04,593: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:09:04.597311701Z [2024-05-24 23:09:04,593: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:09:04.597327187Z [2024-05-24 23:09:04,593: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:09:04.727185288Z [2024-05-24 23:09:04,726: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:09:06.681430803Z [2024-05-24 23:09:06,679: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7d43fe0b-b7d3-4ba3-a1bb-1aa1b6e399fe] succeeded in 6.255352500000072s: None 2024-05-24T23:09:06.729486551Z [2024-05-24 23:09:06,728: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e29323ed-1fe5-4cea-8ed0-d563c321c2b2] succeeded in 6.318224213000121s: None 2024-05-24T23:10:01.098659819Z [2024-05-24 23:10:01,098: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c823bfd-2637-46ec-ab8d-5409497009e3] received 2024-05-24T23:10:01.103080397Z [2024-05-24 23:10:01,102: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[49f1cb43-0708-4982-a765-c48cdbaa5361] received 2024-05-24T23:10:01.105961600Z [2024-05-24 23:10:01,105: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[746754cf-e53c-4e78-a965-95f856e89975] received 2024-05-24T23:10:01.109695308Z [2024-05-24 23:10:01,109: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61934afb-ba29-4ff9-bbaf-bb16d6ffa91d] received 2024-05-24T23:10:01.115398555Z [2024-05-24 23:10:01,115: INFO/ForkPoolWorker-15] [9c823bfd-2637-46ec-ab8d-5409497009e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:10:01.116095718Z [2024-05-24 23:10:01,115: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12d01a40-c56e-4b08-a568-09cac86ba611] received 2024-05-24T23:10:01.121987293Z [2024-05-24 23:10:01,121: INFO/ForkPoolWorker-16] [49f1cb43-0708-4982-a765-c48cdbaa5361] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:10:01.125861374Z [2024-05-24 23:10:01,125: INFO/ForkPoolWorker-1] [746754cf-e53c-4e78-a965-95f856e89975] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:10:01.134330991Z [2024-05-24 23:10:01,133: INFO/ForkPoolWorker-3] [12d01a40-c56e-4b08-a568-09cac86ba611] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:10:01.139794103Z [2024-05-24 23:10:01,137: INFO/ForkPoolWorker-2] [61934afb-ba29-4ff9-bbaf-bb16d6ffa91d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:10:01.546852924Z [2024-05-24 23:10:01,542: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:10:01.874158243Z [2024-05-24 23:10:01,867: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:10:01.918981525Z [2024-05-24 23:10:01,914: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:10:02.011665921Z [2024-05-24 23:10:02,001: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:10:02.052248415Z [2024-05-24 23:10:02,048: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:10:02.146200216Z [2024-05-24 23:10:02,145: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-24T23:10:02.151175425Z [2024-05-24 23:10:02,150: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:10:02.177178969Z [2024-05-24 23:10:02,176: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:10:02.182476110Z [2024-05-24 23:10:02,181: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:10:02.182495560Z [2024-05-24 23:10:02,182: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:10:02.182500230Z [2024-05-24 23:10:02,182: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-24T23:10:02.182708051Z [2024-05-24 23:10:02,182: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:10:02.499385650Z [2024-05-24 23:10:02,496: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:10:02.527173509Z [2024-05-24 23:10:02,526: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:10:03.641279953Z [2024-05-24 23:10:03,640: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[746754cf-e53c-4e78-a965-95f856e89975] succeeded in 2.5325976250001077s: None 2024-05-24T23:10:03.771651644Z [2024-05-24 23:10:03,771: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9c823bfd-2637-46ec-ab8d-5409497009e3] succeeded in 2.6702647650001836s: None 2024-05-24T23:10:04.169703576Z [2024-05-24 23:10:04,169: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:10:04.173595198Z [2024-05-24 23:10:04,172: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:10:04.235662856Z [2024-05-24 23:10:04,235: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:10:04.256138689Z [2024-05-24 23:10:04,255: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:10:04.256403668Z [2024-05-24 23:10:04,256: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:10:04.256869448Z [2024-05-24 23:10:04,256: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:10:04.256926819Z [2024-05-24 23:10:04,256: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:10:04.257428009Z [2024-05-24 23:10:04,257: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:10:04.257626084Z [2024-05-24 23:10:04,257: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:10:04.409918923Z [2024-05-24 23:10:04,409: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-24T23:10:04.424764071Z [2024-05-24 23:10:04,424: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:10:04.514098596Z [2024-05-24 23:10:04,513: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-24T23:10:04.515384739Z [2024-05-24 23:10:04,515: INFO/ForkPoolWorker-3] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:10:04.515467927Z [2024-05-24 23:10:04,515: INFO/ForkPoolWorker-3] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:10:04.515648962Z [2024-05-24 23:10:04,515: INFO/ForkPoolWorker-3] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:10:04.515756980Z [2024-05-24 23:10:04,515: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-24T23:10:04.516295582Z [2024-05-24 23:10:04,516: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:10:04.516359726Z [2024-05-24 23:10:04,516: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:10:04.523679750Z [2024-05-24 23:10:04,523: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:10:04.615561793Z [2024-05-24 23:10:04,615: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:10:04.656552699Z [2024-05-24 23:10:04,656: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:10:04.660984298Z [2024-05-24 23:10:04,660: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:10:04.684451329Z [2024-05-24 23:10:04,684: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:10:04.686019976Z [2024-05-24 23:10:04,685: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:10:04.686189797Z [2024-05-24 23:10:04,685: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:10:04.686712083Z [2024-05-24 23:10:04,686: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:10:04.686989723Z [2024-05-24 23:10:04,686: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:10:04.687503671Z [2024-05-24 23:10:04,687: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:10:04.687809170Z [2024-05-24 23:10:04,687: INFO/ForkPoolWorker-2] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:10:04.866887815Z [2024-05-24 23:10:04,866: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:10:05.364797863Z [2024-05-24 23:10:05,364: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[49f1cb43-0708-4982-a765-c48cdbaa5361] succeeded in 4.259356140999898s: None 2024-05-24T23:10:05.788106429Z [2024-05-24 23:10:05,787: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[697c4722-87be-4d24-8173-90380de99021] received 2024-05-24T23:10:05.795827469Z [2024-05-24 23:10:05,795: INFO/ForkPoolWorker-15] [697c4722-87be-4d24-8173-90380de99021] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:10:06.107431802Z [2024-05-24 23:10:06,104: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:10:06.493557616Z [2024-05-24 23:10:06,493: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[12d01a40-c56e-4b08-a568-09cac86ba611] succeeded in 5.375153196000156s: None 2024-05-24T23:10:07.304160330Z [2024-05-24 23:10:07,303: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:10:07.307781222Z [2024-05-24 23:10:07,307: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:10:07.332277789Z [2024-05-24 23:10:07,332: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:10:07.333612425Z [2024-05-24 23:10:07,333: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:10:07.333629506Z [2024-05-24 23:10:07,333: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:10:07.333818372Z [2024-05-24 23:10:07,333: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:10:07.333872590Z [2024-05-24 23:10:07,333: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:10:07.334135884Z [2024-05-24 23:10:07,333: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:10:07.334144385Z [2024-05-24 23:10:07,334: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:10:07.452426494Z [2024-05-24 23:10:07,452: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:10:07.642848931Z [2024-05-24 23:10:07,642: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[61934afb-ba29-4ff9-bbaf-bb16d6ffa91d] succeeded in 6.527784677999989s: None 2024-05-24T23:10:08.526890878Z [2024-05-24 23:10:08,526: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[697c4722-87be-4d24-8173-90380de99021] succeeded in 2.7361629219999486s: None 2024-05-24T23:10:09.173445788Z [2024-05-24 23:10:09,173: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3258f169-3f1d-4bd2-9532-dc3e83d9a2e7] received 2024-05-24T23:10:09.184518978Z [2024-05-24 23:10:09,184: INFO/ForkPoolWorker-15] [3258f169-3f1d-4bd2-9532-dc3e83d9a2e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:10:09.489979563Z [2024-05-24 23:10:09,487: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:10:10.575654706Z [2024-05-24 23:10:10,575: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:10:10.579194704Z [2024-05-24 23:10:10,578: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:10:10.604372667Z [2024-05-24 23:10:10,604: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:10:10.605914741Z [2024-05-24 23:10:10,605: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:10:10.605967603Z [2024-05-24 23:10:10,605: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:10:10.606193974Z [2024-05-24 23:10:10,605: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:10:10.606238412Z [2024-05-24 23:10:10,606: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:10:10.606780621Z [2024-05-24 23:10:10,606: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:10:10.606982333Z [2024-05-24 23:10:10,606: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:10:10.714435811Z [2024-05-24 23:10:10,714: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:10:11.369116950Z [2024-05-24 23:10:11,368: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3258f169-3f1d-4bd2-9532-dc3e83d9a2e7] succeeded in 2.1930778969999665s: None 2024-05-24T23:10:11.562956670Z [2024-05-24 23:10:11,562: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[349e44c4-7fcd-42fa-b1d1-9e61b11c418c] received 2024-05-24T23:10:11.569443200Z [2024-05-24 23:10:11,569: INFO/ForkPoolWorker-15] [349e44c4-7fcd-42fa-b1d1-9e61b11c418c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:10:11.849995438Z [2024-05-24 23:10:11,846: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:10:13.226655570Z [2024-05-24 23:10:13,226: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:10:13.236534850Z [2024-05-24 23:10:13,232: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:10:13.265748916Z [2024-05-24 23:10:13,265: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:10:13.267163542Z [2024-05-24 23:10:13,266: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:10:13.267476700Z [2024-05-24 23:10:13,267: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:10:13.267967444Z [2024-05-24 23:10:13,267: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:10:13.268219365Z [2024-05-24 23:10:13,267: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:10:13.268798910Z [2024-05-24 23:10:13,268: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:10:13.269045891Z [2024-05-24 23:10:13,268: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:10:13.379246609Z [2024-05-24 23:10:13,378: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:10:14.084174607Z [2024-05-24 23:10:14,083: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[349e44c4-7fcd-42fa-b1d1-9e61b11c418c] succeeded in 2.5182631129998754s: None 2024-05-24T23:11:01.274302273Z [2024-05-24 23:11:01,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0321c924-ca28-4933-9f70-bc7429f518a8] received 2024-05-24T23:11:01.286722238Z [2024-05-24 23:11:01,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9674eb56-9080-4fc0-9aa1-05200aeaec96] received 2024-05-24T23:11:01.292726210Z [2024-05-24 23:11:01,292: INFO/ForkPoolWorker-15] [0321c924-ca28-4933-9f70-bc7429f518a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:11:01.293019472Z [2024-05-24 23:11:01,292: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71c22375-5cb0-4506-8f6c-2eb53411aa4e] received 2024-05-24T23:11:01.302920773Z [2024-05-24 23:11:01,302: INFO/ForkPoolWorker-16] [9674eb56-9080-4fc0-9aa1-05200aeaec96] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:11:01.310153735Z [2024-05-24 23:11:01,309: INFO/ForkPoolWorker-1] [71c22375-5cb0-4506-8f6c-2eb53411aa4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:11:01.643669603Z [2024-05-24 23:11:01,639: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:11:01.651116044Z [2024-05-24 23:11:01,647: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:11:01.681491360Z [2024-05-24 23:11:01,677: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:11:01.841230787Z [2024-05-24 23:11:01,840: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-24T23:11:01.846875149Z [2024-05-24 23:11:01,845: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:11:01.871875942Z [2024-05-24 23:11:01,871: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:11:01.872910586Z [2024-05-24 23:11:01,872: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:11:01.872989927Z [2024-05-24 23:11:01,872: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:11:01.873019929Z [2024-05-24 23:11:01,872: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-24T23:11:01.873186944Z [2024-05-24 23:11:01,873: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:11:01.984891153Z [2024-05-24 23:11:01,984: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:11:02.634926350Z [2024-05-24 23:11:02,634: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9674eb56-9080-4fc0-9aa1-05200aeaec96] succeeded in 1.3453745199999503s: None 2024-05-24T23:11:02.899247884Z [2024-05-24 23:11:02,898: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:11:02.902453325Z [2024-05-24 23:11:02,902: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:11:02.942356709Z [2024-05-24 23:11:02,942: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:11:02.944155451Z [2024-05-24 23:11:02,943: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:11:02.944468631Z [2024-05-24 23:11:02,944: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:11:02.944682799Z [2024-05-24 23:11:02,944: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:11:02.944796565Z [2024-05-24 23:11:02,944: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:11:02.945154611Z [2024-05-24 23:11:02,944: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:11:02.945356749Z [2024-05-24 23:11:02,945: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:11:03.052123088Z [2024-05-24 23:11:03,051: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:11:03.094153078Z [2024-05-24 23:11:03,093: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:11:03.102751752Z [2024-05-24 23:11:03,102: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:11:03.132026894Z [2024-05-24 23:11:03,131: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:11:03.133513257Z [2024-05-24 23:11:03,133: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:11:03.133705901Z [2024-05-24 23:11:03,133: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:11:03.133911945Z [2024-05-24 23:11:03,133: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:11:03.134026908Z [2024-05-24 23:11:03,133: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:11:03.134330192Z [2024-05-24 23:11:03,134: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:11:03.134812598Z [2024-05-24 23:11:03,134: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:11:03.255961622Z [2024-05-24 23:11:03,255: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:11:04.786327314Z [2024-05-24 23:11:04,785: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[71c22375-5cb0-4506-8f6c-2eb53411aa4e] succeeded in 3.4904194239998105s: None 2024-05-24T23:11:05.254789877Z [2024-05-24 23:11:05,254: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0321c924-ca28-4933-9f70-bc7429f518a8] succeeded in 3.9769003929998235s: None 2024-05-24T23:12:01.048114049Z [2024-05-24 23:12:01,047: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d1f9577-dfd2-4c72-9e9b-73a3189d3e7c] received 2024-05-24T23:12:01.060633100Z [2024-05-24 23:12:01,060: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5581f59a-39fb-4097-afc7-7d4751aef2ae] received 2024-05-24T23:12:01.061470255Z [2024-05-24 23:12:01,060: INFO/ForkPoolWorker-15] [0d1f9577-dfd2-4c72-9e9b-73a3189d3e7c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:12:01.062431245Z [2024-05-24 23:12:01,062: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb3e81c3-c383-4fe9-9761-ca4baf7996cc] received 2024-05-24T23:12:01.071590741Z [2024-05-24 23:12:01,069: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6873ac85-6389-487c-aa0a-8e034fbd4804] received 2024-05-24T23:12:01.085176170Z [2024-05-24 23:12:01,084: INFO/ForkPoolWorker-16] [5581f59a-39fb-4097-afc7-7d4751aef2ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:12:01.087131292Z [2024-05-24 23:12:01,086: INFO/ForkPoolWorker-1] [eb3e81c3-c383-4fe9-9761-ca4baf7996cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:12:01.094548190Z [2024-05-24 23:12:01,094: INFO/ForkPoolWorker-2] [6873ac85-6389-487c-aa0a-8e034fbd4804] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:12:01.419036367Z [2024-05-24 23:12:01,410: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:12:01.427692462Z [2024-05-24 23:12:01,424: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:12:01.434188456Z [2024-05-24 23:12:01,430: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:12:01.550444465Z [2024-05-24 23:12:01,546: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:12:01.703726040Z [2024-05-24 23:12:01,703: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:12:01.779513195Z [2024-05-24 23:12:01,779: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-24T23:12:01.784397623Z [2024-05-24 23:12:01,783: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:12:01.826986697Z [2024-05-24 23:12:01,826: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:12:01.829546762Z [2024-05-24 23:12:01,829: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:12:01.829700437Z [2024-05-24 23:12:01,829: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:12:01.829815059Z [2024-05-24 23:12:01,829: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-24T23:12:01.830133732Z [2024-05-24 23:12:01,829: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:12:01.921624390Z [2024-05-24 23:12:01,921: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:12:02.284546645Z [2024-05-24 23:12:02,284: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0d1f9577-dfd2-4c72-9e9b-73a3189d3e7c] succeeded in 1.2342691770002148s: None 2024-05-24T23:12:02.623260491Z [2024-05-24 23:12:02,622: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eb3e81c3-c383-4fe9-9761-ca4baf7996cc] succeeded in 1.5535522300001503s: None 2024-05-24T23:12:02.789166626Z [2024-05-24 23:12:02,788: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:12:02.793552876Z [2024-05-24 23:12:02,793: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:12:02.795730070Z [2024-05-24 23:12:02,795: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:12:02.799016462Z [2024-05-24 23:12:02,798: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:12:02.817073143Z [2024-05-24 23:12:02,816: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:12:02.818736705Z [2024-05-24 23:12:02,818: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:12:02.819252262Z [2024-05-24 23:12:02,819: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:12:02.819494773Z [2024-05-24 23:12:02,819: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:12:02.819637076Z [2024-05-24 23:12:02,819: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:12:02.819983928Z [2024-05-24 23:12:02,819: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:12:02.820234005Z [2024-05-24 23:12:02,820: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:12:02.822639843Z [2024-05-24 23:12:02,822: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:12:02.824165319Z [2024-05-24 23:12:02,823: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:12:02.824348237Z [2024-05-24 23:12:02,824: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:12:02.824541917Z [2024-05-24 23:12:02,824: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:12:02.824699139Z [2024-05-24 23:12:02,824: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:12:02.824971648Z [2024-05-24 23:12:02,824: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:12:02.825071904Z [2024-05-24 23:12:02,824: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:12:02.905009229Z [2024-05-24 23:12:02,904: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:12:02.906639763Z [2024-05-24 23:12:02,906: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:12:04.622251843Z [2024-05-24 23:12:04,620: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5581f59a-39fb-4097-afc7-7d4751aef2ae] succeeded in 3.5570618360000026s: None 2024-05-24T23:12:04.979434833Z [2024-05-24 23:12:04,978: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6873ac85-6389-487c-aa0a-8e034fbd4804] succeeded in 3.9049231929998314s: None 2024-05-24T23:13:00.545948243Z [2024-05-24 23:13:00,545: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c011c0a-1765-4169-86dd-268eadc8ca33] received 2024-05-24T23:13:00.552011604Z [2024-05-24 23:13:00,551: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2b08c41-8257-4c0e-ba5d-1aaa38917314] received 2024-05-24T23:13:00.558897580Z [2024-05-24 23:13:00,558: INFO/ForkPoolWorker-15] [6c011c0a-1765-4169-86dd-268eadc8ca33] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:13:00.563458693Z [2024-05-24 23:13:00,563: INFO/ForkPoolWorker-16] [c2b08c41-8257-4c0e-ba5d-1aaa38917314] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:13:00.563696123Z [2024-05-24 23:13:00,563: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56bbf6b8-a531-4f7e-ac53-22ed82eb4a8f] received 2024-05-24T23:13:00.571996258Z [2024-05-24 23:13:00,571: INFO/ForkPoolWorker-1] [56bbf6b8-a531-4f7e-ac53-22ed82eb4a8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:13:00.828953062Z [2024-05-24 23:13:00,825: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:13:00.882338785Z [2024-05-24 23:13:00,878: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:13:00.885475359Z [2024-05-24 23:13:00,881: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:13:01.060171514Z [2024-05-24 23:13:01,059: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-24T23:13:01.064291301Z [2024-05-24 23:13:01,063: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:13:01.095693419Z [2024-05-24 23:13:01,095: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:13:01.096812210Z [2024-05-24 23:13:01,096: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:13:01.096956906Z [2024-05-24 23:13:01,096: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:13:01.097023375Z [2024-05-24 23:13:01,096: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-24T23:13:01.097336911Z [2024-05-24 23:13:01,097: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:13:01.197053709Z [2024-05-24 23:13:01,196: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:13:01.864485991Z [2024-05-24 23:13:01,864: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[56bbf6b8-a531-4f7e-ac53-22ed82eb4a8f] succeeded in 1.2980984389998866s: None 2024-05-24T23:13:02.013292682Z [2024-05-24 23:13:02,012: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:13:02.016543958Z [2024-05-24 23:13:02,016: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:13:02.039389132Z [2024-05-24 23:13:02,039: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:13:02.040857852Z [2024-05-24 23:13:02,040: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:13:02.040903238Z [2024-05-24 23:13:02,040: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:13:02.041051042Z [2024-05-24 23:13:02,040: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:13:02.041069370Z [2024-05-24 23:13:02,040: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:13:02.041332463Z [2024-05-24 23:13:02,041: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:13:02.041351525Z [2024-05-24 23:13:02,041: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:13:02.135322301Z [2024-05-24 23:13:02,134: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:13:02.336176727Z [2024-05-24 23:13:02,335: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:13:02.342726735Z [2024-05-24 23:13:02,342: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:13:02.363171079Z [2024-05-24 23:13:02,362: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:13:02.364511205Z [2024-05-24 23:13:02,364: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:13:02.364531216Z [2024-05-24 23:13:02,364: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:13:02.364679201Z [2024-05-24 23:13:02,364: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:13:02.364693470Z [2024-05-24 23:13:02,364: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:13:02.364989657Z [2024-05-24 23:13:02,364: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:13:02.364998192Z [2024-05-24 23:13:02,364: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:13:02.468084703Z [2024-05-24 23:13:02,467: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:13:05.338526831Z [2024-05-24 23:13:05,338: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c2b08c41-8257-4c0e-ba5d-1aaa38917314] succeeded in 4.784411318000139s: None 2024-05-24T23:13:05.356566263Z [2024-05-24 23:13:05,355: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6c011c0a-1765-4169-86dd-268eadc8ca33] succeeded in 4.807133596000085s: None 2024-05-24T23:14:00.463316484Z [2024-05-24 23:14:00,462: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[657bfd35-c289-49a4-8f04-bb83408a50a6] received 2024-05-24T23:14:00.467253409Z [2024-05-24 23:14:00,466: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb2822ba-824b-431f-b0c1-094d45497995] received 2024-05-24T23:14:00.481370883Z [2024-05-24 23:14:00,479: INFO/ForkPoolWorker-15] [657bfd35-c289-49a4-8f04-bb83408a50a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:14:00.482343455Z [2024-05-24 23:14:00,481: INFO/ForkPoolWorker-16] [fb2822ba-824b-431f-b0c1-094d45497995] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:14:00.501316061Z [2024-05-24 23:14:00,501: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6fcc312d-1ebd-44ce-9a79-52e518158b2c] received 2024-05-24T23:14:00.503619571Z [2024-05-24 23:14:00,503: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68eb8671-8bf2-423e-9cc0-7e1c662f0aed] received 2024-05-24T23:14:00.523756518Z [2024-05-24 23:14:00,523: INFO/ForkPoolWorker-2] [68eb8671-8bf2-423e-9cc0-7e1c662f0aed] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:14:00.524454374Z [2024-05-24 23:14:00,524: INFO/ForkPoolWorker-1] [6fcc312d-1ebd-44ce-9a79-52e518158b2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:14:00.807225542Z [2024-05-24 23:14:00,803: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:14:00.928533381Z [2024-05-24 23:14:00,924: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:14:00.988383021Z [2024-05-24 23:14:00,976: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:14:01.002208463Z [2024-05-24 23:14:00,980: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:14:01.261202570Z [2024-05-24 23:14:01,260: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-24T23:14:01.265601605Z [2024-05-24 23:14:01,265: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:14:01.312913640Z [2024-05-24 23:14:01,312: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:14:01.314502739Z [2024-05-24 23:14:01,314: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:14:01.314818049Z [2024-05-24 23:14:01,314: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:14:01.315388840Z [2024-05-24 23:14:01,314: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-24T23:14:01.316216953Z [2024-05-24 23:14:01,315: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:14:01.517423570Z [2024-05-24 23:14:01,517: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:14:01.604029227Z [2024-05-24 23:14:01,603: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:14:02.477525094Z [2024-05-24 23:14:02,477: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:14:02.481203533Z [2024-05-24 23:14:02,480: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:14:02.555337524Z [2024-05-24 23:14:02,555: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:14:02.560088621Z [2024-05-24 23:14:02,559: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:14:02.560201472Z [2024-05-24 23:14:02,559: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:14:02.560410307Z [2024-05-24 23:14:02,560: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:14:02.560509122Z [2024-05-24 23:14:02,560: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:14:02.560734179Z [2024-05-24 23:14:02,560: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:14:02.560752366Z [2024-05-24 23:14:02,560: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:14:02.742543598Z [2024-05-24 23:14:02,742: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:14:02.910142290Z [2024-05-24 23:14:02,909: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:14:02.914338037Z [2024-05-24 23:14:02,913: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:14:02.945996845Z [2024-05-24 23:14:02,945: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:14:02.955505064Z [2024-05-24 23:14:02,955: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:14:02.956024840Z [2024-05-24 23:14:02,955: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:14:02.956329177Z [2024-05-24 23:14:02,956: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:14:02.957498328Z [2024-05-24 23:14:02,956: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:14:02.957855179Z [2024-05-24 23:14:02,957: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:14:02.957975067Z [2024-05-24 23:14:02,957: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:14:03.115590108Z [2024-05-24 23:14:03,115: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[657bfd35-c289-49a4-8f04-bb83408a50a6] succeeded in 2.645771570999841s: None 2024-05-24T23:14:03.208690870Z [2024-05-24 23:14:03,208: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[68eb8671-8bf2-423e-9cc0-7e1c662f0aed] succeeded in 2.700987187999999s: None 2024-05-24T23:14:03.219362119Z [2024-05-24 23:14:03,219: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:14:05.774704973Z [2024-05-24 23:14:05,774: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6fcc312d-1ebd-44ce-9a79-52e518158b2c] succeeded in 5.270856244000015s: None 2024-05-24T23:14:06.144139450Z [2024-05-24 23:14:06,143: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fb2822ba-824b-431f-b0c1-094d45497995] succeeded in 5.673413913000104s: None 2024-05-24T23:15:00.436665910Z [2024-05-24 23:15:00,436: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a60a5c9e-e9bc-49b3-8149-cc4d34c749ed] received 2024-05-24T23:15:00.442218761Z [2024-05-24 23:15:00,441: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[696c5af0-7479-4d30-a0e0-0e23a9cfd202] received 2024-05-24T23:15:00.447158444Z [2024-05-24 23:15:00,446: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad573d67-cd6c-4c1a-90a1-8ddb8703f4bc] received 2024-05-24T23:15:00.449840545Z [2024-05-24 23:15:00,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8634883a-5ba5-45e4-8925-1f83239a466d] received 2024-05-24T23:15:00.463911351Z [2024-05-24 23:15:00,463: INFO/ForkPoolWorker-15] [a60a5c9e-e9bc-49b3-8149-cc4d34c749ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:15:00.464519021Z [2024-05-24 23:15:00,464: INFO/ForkPoolWorker-16] [696c5af0-7479-4d30-a0e0-0e23a9cfd202] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:15:00.465751349Z [2024-05-24 23:15:00,465: INFO/ForkPoolWorker-2] [8634883a-5ba5-45e4-8925-1f83239a466d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:15:00.470786597Z [2024-05-24 23:15:00,470: INFO/ForkPoolWorker-1] [ad573d67-cd6c-4c1a-90a1-8ddb8703f4bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:15:00.800734202Z [2024-05-24 23:15:00,797: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:15:00.813846551Z [2024-05-24 23:15:00,810: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:15:00.924668973Z [2024-05-24 23:15:00,921: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:15:00.937285271Z [2024-05-24 23:15:00,933: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:15:00.981301656Z [2024-05-24 23:15:00,980: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-24T23:15:00.989300129Z [2024-05-24 23:15:00,988: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:15:01.050762194Z [2024-05-24 23:15:01,050: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:15:01.052153142Z [2024-05-24 23:15:01,051: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:15:01.052413253Z [2024-05-24 23:15:01,052: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:15:01.052584512Z [2024-05-24 23:15:01,052: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-24T23:15:01.052881285Z [2024-05-24 23:15:01,052: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:15:01.153645389Z [2024-05-24 23:15:01,153: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:15:01.749994406Z [2024-05-24 23:15:01,749: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[696c5af0-7479-4d30-a0e0-0e23a9cfd202] succeeded in 1.3049580439999318s: None 2024-05-24T23:15:02.182584678Z [2024-05-24 23:15:02,181: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:15:02.189325455Z [2024-05-24 23:15:02,185: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:15:02.229137970Z [2024-05-24 23:15:02,210: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:15:02.229162201Z [2024-05-24 23:15:02,211: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:15:02.229166612Z [2024-05-24 23:15:02,212: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:15:02.229169957Z [2024-05-24 23:15:02,212: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:15:02.229173815Z [2024-05-24 23:15:02,213: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:15:02.229177577Z [2024-05-24 23:15:02,213: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:15:02.229180737Z [2024-05-24 23:15:02,213: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:15:02.229183749Z [2024-05-24 23:15:02,213: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:15:02.229189930Z [2024-05-24 23:15:02,214: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:15:02.291353768Z [2024-05-24 23:15:02,291: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:15:02.292532263Z [2024-05-24 23:15:02,292: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:15:02.302090960Z [2024-05-24 23:15:02,301: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:15:02.304140054Z [2024-05-24 23:15:02,303: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:15:02.304357704Z [2024-05-24 23:15:02,304: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:15:02.304537448Z [2024-05-24 23:15:02,304: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:15:02.304604392Z [2024-05-24 23:15:02,304: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:15:02.304854758Z [2024-05-24 23:15:02,304: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:15:02.305730218Z [2024-05-24 23:15:02,305: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:15:02.314022256Z [2024-05-24 23:15:02,313: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:15:02.374902095Z [2024-05-24 23:15:02,374: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:15:02.382539150Z [2024-05-24 23:15:02,382: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:15:02.382607755Z [2024-05-24 23:15:02,382: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:15:02.382714233Z [2024-05-24 23:15:02,382: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:15:02.382796821Z [2024-05-24 23:15:02,382: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:15:02.383106370Z [2024-05-24 23:15:02,382: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:15:02.383182635Z [2024-05-24 23:15:02,383: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:15:02.402354637Z [2024-05-24 23:15:02,402: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:15:02.470772439Z [2024-05-24 23:15:02,470: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:15:02.984702583Z [2024-05-24 23:15:02,983: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a60a5c9e-e9bc-49b3-8149-cc4d34c749ed] succeeded in 2.5438361460001033s: None 2024-05-24T23:15:03.245749827Z [2024-05-24 23:15:03,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7ecb9c9-9300-43e1-94ef-429dcf017b63] received 2024-05-24T23:15:03.271102839Z [2024-05-24 23:15:03,270: INFO/ForkPoolWorker-15] [a7ecb9c9-9300-43e1-94ef-429dcf017b63] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:15:03.589228587Z [2024-05-24 23:15:03,586: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:15:03.827674195Z [2024-05-24 23:15:03,827: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ad573d67-cd6c-4c1a-90a1-8ddb8703f4bc] succeeded in 3.3747371219999422s: None 2024-05-24T23:15:05.003070288Z [2024-05-24 23:15:05,002: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:15:05.006526253Z [2024-05-24 23:15:05,006: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:15:05.027387103Z [2024-05-24 23:15:05,027: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:15:05.028806332Z [2024-05-24 23:15:05,028: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:15:05.029078546Z [2024-05-24 23:15:05,028: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:15:05.029361318Z [2024-05-24 23:15:05,029: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:15:05.029516515Z [2024-05-24 23:15:05,029: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:15:05.029825898Z [2024-05-24 23:15:05,029: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:15:05.029980661Z [2024-05-24 23:15:05,029: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:15:05.128676410Z [2024-05-24 23:15:05,128: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:15:05.619100931Z [2024-05-24 23:15:05,618: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8634883a-5ba5-45e4-8925-1f83239a466d] succeeded in 5.162969096000097s: None 2024-05-24T23:15:05.871357294Z [2024-05-24 23:15:05,870: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a7ecb9c9-9300-43e1-94ef-429dcf017b63] succeeded in 2.623627044999921s: None 2024-05-24T23:15:06.536555623Z [2024-05-24 23:15:06,536: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca6bd57c-4acc-43a6-993a-ddbd1efe5782] received 2024-05-24T23:15:06.557635142Z [2024-05-24 23:15:06,557: INFO/ForkPoolWorker-15] [ca6bd57c-4acc-43a6-993a-ddbd1efe5782] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:15:06.855839269Z [2024-05-24 23:15:06,852: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:15:08.372023419Z [2024-05-24 23:15:08,371: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:15:08.378272240Z [2024-05-24 23:15:08,377: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:15:08.474034023Z [2024-05-24 23:15:08,473: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:15:08.479728340Z [2024-05-24 23:15:08,479: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:15:08.479748467Z [2024-05-24 23:15:08,479: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:15:08.479885184Z [2024-05-24 23:15:08,479: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:15:08.479905922Z [2024-05-24 23:15:08,479: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:15:08.480199963Z [2024-05-24 23:15:08,480: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:15:08.480231171Z [2024-05-24 23:15:08,480: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:15:08.590503043Z [2024-05-24 23:15:08,590: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:15:09.481601073Z [2024-05-24 23:15:09,481: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ca6bd57c-4acc-43a6-993a-ddbd1efe5782] succeeded in 2.933559506999927s: None 2024-05-24T23:15:10.402690542Z [2024-05-24 23:15:10,402: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e77e0d1f-f1a7-489e-870c-9bde9e217358] received 2024-05-24T23:15:10.413860519Z [2024-05-24 23:15:10,413: INFO/ForkPoolWorker-15] [e77e0d1f-f1a7-489e-870c-9bde9e217358] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:15:10.664380716Z [2024-05-24 23:15:10,661: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:15:11.692882740Z [2024-05-24 23:15:11,692: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:15:11.696551431Z [2024-05-24 23:15:11,695: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:15:11.720138109Z [2024-05-24 23:15:11,719: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:15:11.721764675Z [2024-05-24 23:15:11,721: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:15:11.721943701Z [2024-05-24 23:15:11,721: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:15:11.722200959Z [2024-05-24 23:15:11,721: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:15:11.722438955Z [2024-05-24 23:15:11,722: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:15:11.722830833Z [2024-05-24 23:15:11,722: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:15:11.722973873Z [2024-05-24 23:15:11,722: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:15:11.826746915Z [2024-05-24 23:15:11,826: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:15:12.443175536Z [2024-05-24 23:15:12,442: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e77e0d1f-f1a7-489e-870c-9bde9e217358] succeeded in 2.035259521999933s: None 2024-05-24T23:16:00.293851442Z [2024-05-24 23:16:00,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23f662a2-8d59-4bca-a73f-59885006478f] received 2024-05-24T23:16:00.301591133Z [2024-05-24 23:16:00,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc1f73f9-aef5-4ba0-ba06-3f82d2d806ad] received 2024-05-24T23:16:00.303849991Z [2024-05-24 23:16:00,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28ae591a-d3a4-4fd8-baec-0338ba3fde59] received 2024-05-24T23:16:00.307866668Z [2024-05-24 23:16:00,307: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b29f428c-1170-49d1-ac7a-f60a8ae1f4f9] received 2024-05-24T23:16:00.318712065Z [2024-05-24 23:16:00,318: INFO/ForkPoolWorker-16] [bc1f73f9-aef5-4ba0-ba06-3f82d2d806ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:16:00.320679320Z [2024-05-24 23:16:00,320: INFO/ForkPoolWorker-2] [b29f428c-1170-49d1-ac7a-f60a8ae1f4f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:16:00.321499668Z [2024-05-24 23:16:00,321: INFO/ForkPoolWorker-1] [28ae591a-d3a4-4fd8-baec-0338ba3fde59] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:16:00.332048277Z [2024-05-24 23:16:00,331: INFO/ForkPoolWorker-15] [23f662a2-8d59-4bca-a73f-59885006478f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:16:00.616223084Z [2024-05-24 23:16:00,613: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:16:00.658465392Z [2024-05-24 23:16:00,655: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:16:00.671469776Z [2024-05-24 23:16:00,667: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:16:00.699963034Z [2024-05-24 23:16:00,696: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:16:00.777486188Z [2024-05-24 23:16:00,777: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-24T23:16:00.781183155Z [2024-05-24 23:16:00,780: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:16:00.837018572Z [2024-05-24 23:16:00,836: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:16:00.842116158Z [2024-05-24 23:16:00,841: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:16:00.842252185Z [2024-05-24 23:16:00,842: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:16:00.842341595Z [2024-05-24 23:16:00,842: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-24T23:16:00.843215215Z [2024-05-24 23:16:00,843: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:16:00.952517234Z [2024-05-24 23:16:00,952: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:16:01.127930856Z [2024-05-24 23:16:01,127: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:16:01.662076407Z [2024-05-24 23:16:01,661: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b29f428c-1170-49d1-ac7a-f60a8ae1f4f9] succeeded in 1.3514276170001267s: None 2024-05-24T23:16:01.859261964Z [2024-05-24 23:16:01,858: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bc1f73f9-aef5-4ba0-ba06-3f82d2d806ad] succeeded in 1.5526184949999333s: None 2024-05-24T23:16:02.091374642Z [2024-05-24 23:16:02,090: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:16:02.094670048Z [2024-05-24 23:16:02,094: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:16:02.127171131Z [2024-05-24 23:16:02,126: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:16:02.128951644Z [2024-05-24 23:16:02,128: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:16:02.129098160Z [2024-05-24 23:16:02,128: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:16:02.129445368Z [2024-05-24 23:16:02,129: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:16:02.129652638Z [2024-05-24 23:16:02,129: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:16:02.129997927Z [2024-05-24 23:16:02,129: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:16:02.130528603Z [2024-05-24 23:16:02,130: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:16:02.223399156Z [2024-05-24 23:16:02,221: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:16:02.291777422Z [2024-05-24 23:16:02,291: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:16:02.297403242Z [2024-05-24 23:16:02,296: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:16:02.341990547Z [2024-05-24 23:16:02,341: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:16:02.344587954Z [2024-05-24 23:16:02,344: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:16:02.344719374Z [2024-05-24 23:16:02,344: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:16:02.344940881Z [2024-05-24 23:16:02,344: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:16:02.345101394Z [2024-05-24 23:16:02,344: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:16:02.345528727Z [2024-05-24 23:16:02,345: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:16:02.345727641Z [2024-05-24 23:16:02,345: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:16:02.438138496Z [2024-05-24 23:16:02,437: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:16:03.971075271Z [2024-05-24 23:16:03,970: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[23f662a2-8d59-4bca-a73f-59885006478f] succeeded in 3.673145330999887s: None 2024-05-24T23:16:04.096891698Z [2024-05-24 23:16:04,096: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[28ae591a-d3a4-4fd8-baec-0338ba3fde59] succeeded in 3.7910469060000196s: None 2024-05-24T23:17:01.019049473Z [2024-05-24 23:17:01,018: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a412afcd-4007-4743-ba4f-2dc077049cfe] received 2024-05-24T23:17:01.022222863Z [2024-05-24 23:17:01,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2add8ea-3e35-42e5-901c-4d2e5635c10a] received 2024-05-24T23:17:01.027965379Z [2024-05-24 23:17:01,027: INFO/ForkPoolWorker-15] [a412afcd-4007-4743-ba4f-2dc077049cfe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:17:01.030340751Z [2024-05-24 23:17:01,030: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e86efee5-00d6-44b1-b622-50452e0cb88d] received 2024-05-24T23:17:01.031752519Z [2024-05-24 23:17:01,031: INFO/ForkPoolWorker-16] [e2add8ea-3e35-42e5-901c-4d2e5635c10a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:17:01.043470853Z [2024-05-24 23:17:01,043: INFO/ForkPoolWorker-1] [e86efee5-00d6-44b1-b622-50452e0cb88d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:17:01.369392676Z [2024-05-24 23:17:01,363: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:17:01.429775716Z [2024-05-24 23:17:01,421: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:17:01.433586708Z [2024-05-24 23:17:01,428: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:17:01.541703911Z [2024-05-24 23:17:01,540: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-24T23:17:01.546496651Z [2024-05-24 23:17:01,546: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:17:01.596631204Z [2024-05-24 23:17:01,596: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:17:01.598216519Z [2024-05-24 23:17:01,597: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:17:01.598342943Z [2024-05-24 23:17:01,598: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:17:01.598394181Z [2024-05-24 23:17:01,598: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-24T23:17:01.598639722Z [2024-05-24 23:17:01,598: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:17:01.718488067Z [2024-05-24 23:17:01,718: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:17:02.354824090Z [2024-05-24 23:17:02,354: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e2add8ea-3e35-42e5-901c-4d2e5635c10a] succeeded in 1.3309032459999344s: None 2024-05-24T23:17:02.762911918Z [2024-05-24 23:17:02,762: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:17:02.766493111Z [2024-05-24 23:17:02,765: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:17:02.775799760Z [2024-05-24 23:17:02,775: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:17:02.779727856Z [2024-05-24 23:17:02,779: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:17:02.792745844Z [2024-05-24 23:17:02,792: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:17:02.796155306Z [2024-05-24 23:17:02,795: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:17:02.796505025Z [2024-05-24 23:17:02,796: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:17:02.797136593Z [2024-05-24 23:17:02,796: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:17:02.797570675Z [2024-05-24 23:17:02,797: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:17:02.798552410Z [2024-05-24 23:17:02,797: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:17:02.799169340Z [2024-05-24 23:17:02,798: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:17:02.804387391Z [2024-05-24 23:17:02,804: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:17:02.805887451Z [2024-05-24 23:17:02,805: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:17:02.806009378Z [2024-05-24 23:17:02,805: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:17:02.806266083Z [2024-05-24 23:17:02,806: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:17:02.806325392Z [2024-05-24 23:17:02,806: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:17:02.806556747Z [2024-05-24 23:17:02,806: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:17:02.806609169Z [2024-05-24 23:17:02,806: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:17:02.901520294Z [2024-05-24 23:17:02,901: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:17:02.936402084Z [2024-05-24 23:17:02,936: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:17:04.968290403Z [2024-05-24 23:17:04,967: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a412afcd-4007-4743-ba4f-2dc077049cfe] succeeded in 3.946922332999975s: None 2024-05-24T23:17:05.442894658Z [2024-05-24 23:17:05,442: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e86efee5-00d6-44b1-b622-50452e0cb88d] succeeded in 4.409728300000097s: None 2024-05-24T23:18:00.322172545Z [2024-05-24 23:18:00,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28bdf595-fe45-406f-87db-117aeb4357a4] received 2024-05-24T23:18:00.329721530Z [2024-05-24 23:18:00,329: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cf671fa-1bec-49ca-baee-f4315b2a6678] received 2024-05-24T23:18:00.334526573Z [2024-05-24 23:18:00,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9127535d-dfb4-452e-9c50-5197a89cff11] received 2024-05-24T23:18:00.342342064Z [2024-05-24 23:18:00,342: INFO/ForkPoolWorker-15] [28bdf595-fe45-406f-87db-117aeb4357a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:18:00.343201639Z [2024-05-24 23:18:00,343: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3624c60-4ec3-4e09-8c74-bb726ebfd96d] received 2024-05-24T23:18:00.359132633Z [2024-05-24 23:18:00,358: INFO/ForkPoolWorker-2] [f3624c60-4ec3-4e09-8c74-bb726ebfd96d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:18:00.360370497Z [2024-05-24 23:18:00,360: INFO/ForkPoolWorker-16] [4cf671fa-1bec-49ca-baee-f4315b2a6678] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:18:00.361465851Z [2024-05-24 23:18:00,361: INFO/ForkPoolWorker-1] [9127535d-dfb4-452e-9c50-5197a89cff11] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:18:00.695959698Z [2024-05-24 23:18:00,692: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:18:00.708044996Z [2024-05-24 23:18:00,704: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:18:00.716873993Z [2024-05-24 23:18:00,712: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:18:00.770957544Z [2024-05-24 23:18:00,763: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:18:00.924668801Z [2024-05-24 23:18:00,923: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-24T23:18:00.935546223Z [2024-05-24 23:18:00,934: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:18:01.020734294Z [2024-05-24 23:18:01,020: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:18:01.028108569Z [2024-05-24 23:18:01,027: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:18:01.028691568Z [2024-05-24 23:18:01,028: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:18:01.028888913Z [2024-05-24 23:18:01,028: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:18:01.029008082Z [2024-05-24 23:18:01,028: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-24T23:18:01.029326999Z [2024-05-24 23:18:01,029: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:18:01.133636362Z [2024-05-24 23:18:01,133: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:18:01.717859209Z [2024-05-24 23:18:01,717: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[28bdf595-fe45-406f-87db-117aeb4357a4] succeeded in 1.3926512769999135s: None 2024-05-24T23:18:01.813596423Z [2024-05-24 23:18:01,812: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f3624c60-4ec3-4e09-8c74-bb726ebfd96d] succeeded in 1.465256730999954s: None 2024-05-24T23:18:02.181436869Z [2024-05-24 23:18:02,180: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:18:02.201888325Z [2024-05-24 23:18:02,201: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:18:02.261400047Z [2024-05-24 23:18:02,259: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:18:02.264195661Z [2024-05-24 23:18:02,263: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:18:02.271458977Z [2024-05-24 23:18:02,271: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:18:02.282087774Z [2024-05-24 23:18:02,281: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:18:02.282185297Z [2024-05-24 23:18:02,281: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:18:02.282334971Z [2024-05-24 23:18:02,282: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:18:02.282400880Z [2024-05-24 23:18:02,282: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:18:02.282752335Z [2024-05-24 23:18:02,282: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:18:02.282762688Z [2024-05-24 23:18:02,282: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:18:02.337971543Z [2024-05-24 23:18:02,337: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:18:02.349088525Z [2024-05-24 23:18:02,348: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:18:02.349908091Z [2024-05-24 23:18:02,348: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:18:02.350518410Z [2024-05-24 23:18:02,349: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:18:02.350699985Z [2024-05-24 23:18:02,350: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:18:02.350957476Z [2024-05-24 23:18:02,350: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:18:02.351083538Z [2024-05-24 23:18:02,350: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:18:02.409169157Z [2024-05-24 23:18:02,408: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:18:02.449506906Z [2024-05-24 23:18:02,449: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:18:03.893992057Z [2024-05-24 23:18:03,891: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9127535d-dfb4-452e-9c50-5197a89cff11] succeeded in 3.5530682129999605s: None 2024-05-24T23:18:04.428873642Z [2024-05-24 23:18:04,427: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4cf671fa-1bec-49ca-baee-f4315b2a6678] succeeded in 4.095021052999982s: None 2024-05-24T23:18:51.982430553Z [2024-05-24 23:18:51,982: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9af87557-3c49-489b-9417-9e39c4e018fa] received 2024-05-24T23:18:51.994154401Z [2024-05-24 23:18:51,993: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42fc2321-ea7d-4e62-8d0e-7b9f55585c0e] received 2024-05-24T23:18:51.996163880Z [2024-05-24 23:18:51,995: INFO/ForkPoolWorker-15] [9af87557-3c49-489b-9417-9e39c4e018fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:18:52.014264642Z [2024-05-24 23:18:52,013: INFO/ForkPoolWorker-16] [42fc2321-ea7d-4e62-8d0e-7b9f55585c0e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:18:52.266263640Z [2024-05-24 23:18:52,262: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:18:52.353330637Z [2024-05-24 23:18:52,347: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:18:53.416114749Z [2024-05-24 23:18:53,415: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:18:53.419457106Z [2024-05-24 23:18:53,419: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:18:53.444429501Z [2024-05-24 23:18:53,444: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:18:53.446613912Z [2024-05-24 23:18:53,446: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:18:53.446783097Z [2024-05-24 23:18:53,446: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:18:53.446923364Z [2024-05-24 23:18:53,446: INFO/ForkPoolWorker-16] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:18:53.447167265Z [2024-05-24 23:18:53,446: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:18:53.447275629Z [2024-05-24 23:18:53,447: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:18:53.447700492Z [2024-05-24 23:18:53,447: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:18:53.447908850Z [2024-05-24 23:18:53,447: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:18:53.453114369Z [2024-05-24 23:18:53,452: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:18:53.509784492Z [2024-05-24 23:18:53,509: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:18:53.514204824Z [2024-05-24 23:18:53,513: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:18:53.535345855Z [2024-05-24 23:18:53,535: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:18:53.537066013Z [2024-05-24 23:18:53,536: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:18:53.537430365Z [2024-05-24 23:18:53,536: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:18:53.537669388Z [2024-05-24 23:18:53,537: INFO/ForkPoolWorker-15] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:18:53.538014450Z [2024-05-24 23:18:53,537: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:18:53.538267945Z [2024-05-24 23:18:53,537: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:18:53.538680423Z [2024-05-24 23:18:53,538: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:18:53.539209456Z [2024-05-24 23:18:53,538: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:18:53.545294520Z [2024-05-24 23:18:53,545: INFO/ForkPoolWorker-15] Creating DAG vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:18:53.547893309Z [2024-05-24 23:18:53,547: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:18:53.608792994Z [2024-05-24 23:18:53,608: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:18:55.061791045Z [2024-05-24 23:18:55,060: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9af87557-3c49-489b-9417-9e39c4e018fa] succeeded in 3.0763277139999445s: None 2024-05-24T23:18:55.347745835Z [2024-05-24 23:18:55,346: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[42fc2321-ea7d-4e62-8d0e-7b9f55585c0e] succeeded in 3.351334688000179s: None 2024-05-24T23:19:00.898058916Z [2024-05-24 23:19:00,897: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce53961f-342b-4ff0-9947-1733426feeea] received 2024-05-24T23:19:00.899787010Z [2024-05-24 23:19:00,899: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ede8410-8756-4988-a53d-1636f1a9b474] received 2024-05-24T23:19:00.906529817Z [2024-05-24 23:19:00,906: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2dcdf9f-5491-4da4-8df2-f48bff50b21a] received 2024-05-24T23:19:00.908461103Z [2024-05-24 23:19:00,908: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4749136b-a734-4a9e-aab7-edf6fdf5f20a] received 2024-05-24T23:19:00.910149365Z [2024-05-24 23:19:00,909: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87fcbd21-4f79-43b7-993c-923aaf7a4419] received 2024-05-24T23:19:00.910557980Z [2024-05-24 23:19:00,910: INFO/ForkPoolWorker-15] [ce53961f-342b-4ff0-9947-1733426feeea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:19:00.922397458Z [2024-05-24 23:19:00,920: INFO/ForkPoolWorker-16] [6ede8410-8756-4988-a53d-1636f1a9b474] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:19:00.924574492Z [2024-05-24 23:19:00,924: INFO/ForkPoolWorker-1] [c2dcdf9f-5491-4da4-8df2-f48bff50b21a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:19:00.925302832Z [2024-05-24 23:19:00,924: INFO/ForkPoolWorker-2] [4749136b-a734-4a9e-aab7-edf6fdf5f20a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:19:00.927520960Z [2024-05-24 23:19:00,927: INFO/ForkPoolWorker-3] [87fcbd21-4f79-43b7-993c-923aaf7a4419] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:19:01.276078795Z [2024-05-24 23:19:01,272: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:19:01.357343059Z [2024-05-24 23:19:01,353: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:19:01.395195759Z [2024-05-24 23:19:01,368: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:19:01.444669525Z [2024-05-24 23:19:01,444: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-24T23:19:01.448418108Z [2024-05-24 23:19:01,448: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:19:01.459347169Z [2024-05-24 23:19:01,455: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:19:01.507158865Z [2024-05-24 23:19:01,502: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:19:01.510942644Z [2024-05-24 23:19:01,510: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-24T23:19:01.513949200Z [2024-05-24 23:19:01,513: INFO/ForkPoolWorker-3] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:19:01.514043251Z [2024-05-24 23:19:01,513: INFO/ForkPoolWorker-3] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:19:01.514051718Z [2024-05-24 23:19:01,513: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-24T23:19:01.514239094Z [2024-05-24 23:19:01,514: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:19:01.661241187Z [2024-05-24 23:19:01,660: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:19:02.590323757Z [2024-05-24 23:19:02,589: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[87fcbd21-4f79-43b7-993c-923aaf7a4419] succeeded in 1.6770057260000613s: None 2024-05-24T23:19:02.866341235Z [2024-05-24 23:19:02,865: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:19:02.869859787Z [2024-05-24 23:19:02,869: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:19:02.930553370Z [2024-05-24 23:19:02,930: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:19:02.931801673Z [2024-05-24 23:19:02,931: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:19:02.931880746Z [2024-05-24 23:19:02,931: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:19:02.931969517Z [2024-05-24 23:19:02,931: INFO/ForkPoolWorker-16] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:19:02.932122100Z [2024-05-24 23:19:02,931: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:19:02.932220472Z [2024-05-24 23:19:02,932: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:19:02.932505838Z [2024-05-24 23:19:02,932: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:19:02.932579083Z [2024-05-24 23:19:02,932: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:19:02.934693252Z [2024-05-24 23:19:02,934: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:19:02.937175382Z [2024-05-24 23:19:02,936: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:19:02.943810718Z [2024-05-24 23:19:02,937: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:19:02.966129264Z [2024-05-24 23:19:02,965: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:19:02.970277525Z [2024-05-24 23:19:02,970: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:19:02.970322991Z [2024-05-24 23:19:02,970: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:19:02.970335987Z [2024-05-24 23:19:02,970: INFO/ForkPoolWorker-2] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:19:02.970433708Z [2024-05-24 23:19:02,970: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:19:02.970472129Z [2024-05-24 23:19:02,970: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:19:02.970707178Z [2024-05-24 23:19:02,970: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:19:02.970844671Z [2024-05-24 23:19:02,970: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:19:02.975402235Z [2024-05-24 23:19:02,975: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:19:03.019165143Z [2024-05-24 23:19:03,018: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:19:03.106039637Z [2024-05-24 23:19:03,105: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:19:03.120237575Z [2024-05-24 23:19:03,119: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:19:03.129971713Z [2024-05-24 23:19:03,129: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:19:03.165913963Z [2024-05-24 23:19:03,165: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:19:03.170084661Z [2024-05-24 23:19:03,169: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:19:03.170279973Z [2024-05-24 23:19:03,170: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:19:03.170440933Z [2024-05-24 23:19:03,170: INFO/ForkPoolWorker-1] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:19:03.170659793Z [2024-05-24 23:19:03,170: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:19:03.170813485Z [2024-05-24 23:19:03,170: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:19:03.171117461Z [2024-05-24 23:19:03,170: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:19:03.171275839Z [2024-05-24 23:19:03,171: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:19:03.175781306Z [2024-05-24 23:19:03,175: INFO/ForkPoolWorker-1] Creating DAG vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:19:03.278137461Z [2024-05-24 23:19:03,277: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:19:03.354324766Z [2024-05-24 23:19:03,353: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:19:03.358176272Z [2024-05-24 23:19:03,357: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:19:03.385648962Z [2024-05-24 23:19:03,385: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:19:03.386958128Z [2024-05-24 23:19:03,386: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:19:03.387109780Z [2024-05-24 23:19:03,386: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:19:03.387264097Z [2024-05-24 23:19:03,387: INFO/ForkPoolWorker-15] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:19:03.387473135Z [2024-05-24 23:19:03,387: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:19:03.387612795Z [2024-05-24 23:19:03,387: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:19:03.387912661Z [2024-05-24 23:19:03,387: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:19:03.388358548Z [2024-05-24 23:19:03,388: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:19:03.393419214Z [2024-05-24 23:19:03,393: INFO/ForkPoolWorker-15] Creating DAG vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:19:03.482462603Z [2024-05-24 23:19:03,482: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:19:05.360011783Z [2024-05-24 23:19:05,358: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6ede8410-8756-4988-a53d-1636f1a9b474] succeeded in 4.453177415000027s: None 2024-05-24T23:19:05.389608616Z [2024-05-24 23:19:05,389: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c2dcdf9f-5491-4da4-8df2-f48bff50b21a] succeeded in 4.480456602999993s: None 2024-05-24T23:19:05.390151072Z [2024-05-24 23:19:05,389: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ce53961f-342b-4ff0-9947-1733426feeea] succeeded in 4.488524503000008s: None 2024-05-24T23:19:05.680311873Z [2024-05-24 23:19:05,679: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4749136b-a734-4a9e-aab7-edf6fdf5f20a] succeeded in 4.767301252999914s: None 2024-05-24T23:19:09.866876116Z [2024-05-24 23:19:09,866: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5bd720ee-2ddd-40b0-8f56-a7d0a5400723] received 2024-05-24T23:19:09.885176158Z [2024-05-24 23:19:09,884: INFO/ForkPoolWorker-15] [5bd720ee-2ddd-40b0-8f56-a7d0a5400723] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:19:10.157671067Z [2024-05-24 23:19:10,154: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:19:11.141187984Z [2024-05-24 23:19:11,140: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:19:11.144197832Z [2024-05-24 23:19:11,143: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:19:11.165725920Z [2024-05-24 23:19:11,165: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:19:11.167211818Z [2024-05-24 23:19:11,166: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:19:11.167235460Z [2024-05-24 23:19:11,167: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:19:11.167242852Z [2024-05-24 23:19:11,167: INFO/ForkPoolWorker-15] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:19:11.167281660Z [2024-05-24 23:19:11,167: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:19:11.167361123Z [2024-05-24 23:19:11,167: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:19:11.167584539Z [2024-05-24 23:19:11,167: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:19:11.167594319Z [2024-05-24 23:19:11,167: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:19:11.173742124Z [2024-05-24 23:19:11,173: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:19:11.260088295Z [2024-05-24 23:19:11,259: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:19:11.862041703Z [2024-05-24 23:19:11,861: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5bd720ee-2ddd-40b0-8f56-a7d0a5400723] succeeded in 1.990359645000126s: None 2024-05-24T23:19:12.160814477Z [2024-05-24 23:19:12,160: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9f786de-1f0d-4228-8276-8350b3bbf222] received 2024-05-24T23:19:12.167528747Z [2024-05-24 23:19:12,167: INFO/ForkPoolWorker-15] [c9f786de-1f0d-4228-8276-8350b3bbf222] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'split_metrics', 'scheduled__2024-05-24T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:19:12.493337712Z [2024-05-24 23:19:12,490: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:19:13.602892974Z [2024-05-24 23:19:13,602: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:19:13.607128049Z [2024-05-24 23:19:13,605: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:19:13.630569431Z [2024-05-24 23:19:13,630: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:19:13.632610739Z [2024-05-24 23:19:13,632: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:19:13.632786585Z [2024-05-24 23:19:13,632: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:19:13.632868098Z [2024-05-24 23:19:13,632: INFO/ForkPoolWorker-15] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:19:13.633152671Z [2024-05-24 23:19:13,632: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:19:13.633336955Z [2024-05-24 23:19:13,633: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:19:13.633841619Z [2024-05-24 23:19:13,633: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:19:13.633935607Z [2024-05-24 23:19:13,633: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:19:13.642504580Z [2024-05-24 23:19:13,642: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:19:13.749996534Z [2024-05-24 23:19:13,749: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:19:14.468081030Z [2024-05-24 23:19:14,467: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c9f786de-1f0d-4228-8276-8350b3bbf222] succeeded in 2.3049342689998866s: None 2024-05-24T23:19:14.943259656Z [2024-05-24 23:19:14,942: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7ad6ff8-ad39-4a4b-9ebd-b1df9048aa63] received 2024-05-24T23:19:14.954538469Z [2024-05-24 23:19:14,953: INFO/ForkPoolWorker-15] [e7ad6ff8-ad39-4a4b-9ebd-b1df9048aa63] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'collect_metrics', 'scheduled__2024-05-24T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:19:15.273427316Z [2024-05-24 23:19:15,270: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:19:16.315405956Z [2024-05-24 23:19:16,314: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:19:16.318898188Z [2024-05-24 23:19:16,318: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:19:16.354379304Z [2024-05-24 23:19:16,354: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:19:16.356326683Z [2024-05-24 23:19:16,355: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:19:16.356393924Z [2024-05-24 23:19:16,356: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:19:16.356418686Z [2024-05-24 23:19:16,356: INFO/ForkPoolWorker-15] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:19:16.356752659Z [2024-05-24 23:19:16,356: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:19:16.356771756Z [2024-05-24 23:19:16,356: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:19:16.357322906Z [2024-05-24 23:19:16,357: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:19:16.357349260Z [2024-05-24 23:19:16,357: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:19:16.366058178Z [2024-05-24 23:19:16,365: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:19:16.467137400Z [2024-05-24 23:19:16,466: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:19:17.086597471Z [2024-05-24 23:19:17,086: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e7ad6ff8-ad39-4a4b-9ebd-b1df9048aa63] succeeded in 2.1408804130001045s: None 2024-05-24T23:19:17.318969113Z [2024-05-24 23:19:17,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88214c94-2efb-435c-aa6b-d665db261cb2] received 2024-05-24T23:19:17.333108567Z [2024-05-24 23:19:17,332: INFO/ForkPoolWorker-15] [88214c94-2efb-435c-aa6b-d665db261cb2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'send_prometheus', 'scheduled__2024-05-24T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:19:17.598371310Z [2024-05-24 23:19:17,595: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:19:18.683973369Z [2024-05-24 23:19:18,683: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:19:18.687528020Z [2024-05-24 23:19:18,687: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:19:18.707504630Z [2024-05-24 23:19:18,707: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:19:18.708800032Z [2024-05-24 23:19:18,708: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:19:18.708879686Z [2024-05-24 23:19:18,708: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:19:18.708985356Z [2024-05-24 23:19:18,708: INFO/ForkPoolWorker-15] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:19:18.709237306Z [2024-05-24 23:19:18,708: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:19:18.709431074Z [2024-05-24 23:19:18,709: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:19:18.709916292Z [2024-05-24 23:19:18,709: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:19:18.710354696Z [2024-05-24 23:19:18,709: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:19:18.716384771Z [2024-05-24 23:19:18,716: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:19:18.787753864Z [2024-05-24 23:19:18,787: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:19:19.339883443Z [2024-05-24 23:19:19,339: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[88214c94-2efb-435c-aa6b-d665db261cb2] succeeded in 2.017383228000199s: None 2024-05-24T23:20:00.848317003Z [2024-05-24 23:20:00,847: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc27bf87-eca3-40da-8834-9759082146ff] received 2024-05-24T23:20:00.850998753Z [2024-05-24 23:20:00,850: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d34ab1a8-24a7-4eda-83d9-0724f8018bc0] received 2024-05-24T23:20:00.855039177Z [2024-05-24 23:20:00,854: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8686b09-b54e-45ce-88d6-6053a1078fd3] received 2024-05-24T23:20:00.857203505Z [2024-05-24 23:20:00,857: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7cdcf19-2d60-4aed-93c3-b6c5a988408c] received 2024-05-24T23:20:00.859524951Z [2024-05-24 23:20:00,857: INFO/ForkPoolWorker-15] [bc27bf87-eca3-40da-8834-9759082146ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:20:00.862967055Z [2024-05-24 23:20:00,862: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6987f57b-d8bd-45b6-a7fd-7fca8e1d91fc] received 2024-05-24T23:20:00.870241532Z [2024-05-24 23:20:00,870: INFO/ForkPoolWorker-3] [6987f57b-d8bd-45b6-a7fd-7fca8e1d91fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:20:00.870745564Z [2024-05-24 23:20:00,870: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62142bbc-b13e-4778-abdb-6fa3dc913467] received 2024-05-24T23:20:00.877685202Z [2024-05-24 23:20:00,877: INFO/ForkPoolWorker-1] [e8686b09-b54e-45ce-88d6-6053a1078fd3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:20:00.877904151Z [2024-05-24 23:20:00,871: INFO/ForkPoolWorker-2] [b7cdcf19-2d60-4aed-93c3-b6c5a988408c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:20:00.878110542Z [2024-05-24 23:20:00,877: INFO/ForkPoolWorker-16] [d34ab1a8-24a7-4eda-83d9-0724f8018bc0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:20:00.898092642Z [2024-05-24 23:20:00,897: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0a0d7a7-c79c-470a-bb4a-f95b0e55f8ad] received 2024-05-24T23:20:00.902237875Z [2024-05-24 23:20:00,901: INFO/ForkPoolWorker-4] [62142bbc-b13e-4778-abdb-6fa3dc913467] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:20:00.902382561Z [2024-05-24 23:20:00,902: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88263950-86ee-46b6-98ce-3e9b4d5c7223] received 2024-05-24T23:20:00.920187426Z [2024-05-24 23:20:00,919: INFO/ForkPoolWorker-6] [88263950-86ee-46b6-98ce-3e9b4d5c7223] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:20:00.929642954Z [2024-05-24 23:20:00,929: INFO/ForkPoolWorker-5] [a0a0d7a7-c79c-470a-bb4a-f95b0e55f8ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:20:01.339007420Z [2024-05-24 23:20:01,335: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:20:01.532962974Z [2024-05-24 23:20:01,529: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:20:01.592478571Z [2024-05-24 23:20:01,588: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:20:01.622093607Z [2024-05-24 23:20:01,611: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:20:01.633640307Z [2024-05-24 23:20:01,619: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:20:01.644531459Z [2024-05-24 23:20:01,640: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:20:01.716621977Z [2024-05-24 23:20:01,713: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:20:01.732529175Z [2024-05-24 23:20:01,729: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:20:01.985307432Z [2024-05-24 23:20:01,985: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:20:01.991587292Z [2024-05-24 23:20:01,991: INFO/ForkPoolWorker-6] Getting SDNC list 2024-05-24T23:20:01.996072782Z [2024-05-24 23:20:01,995: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:20:02.043004708Z [2024-05-24 23:20:02,042: INFO/ForkPoolWorker-6] Connected to database osm version 1.2 2024-05-24T23:20:02.045519905Z [2024-05-24 23:20:02,045: INFO/ForkPoolWorker-6] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:20:02.046013055Z [2024-05-24 23:20:02,045: INFO/ForkPoolWorker-6] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:20:02.046208263Z [2024-05-24 23:20:02,046: INFO/ForkPoolWorker-6] Getting SDNC list OK 2024-05-24T23:20:02.046482535Z [2024-05-24 23:20:02,046: INFO/ForkPoolWorker-6] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:20:02.153174708Z [2024-05-24 23:20:02,152: INFO/ForkPoolWorker-6] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:20:03.079724239Z [2024-05-24 23:20:03,079: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[62142bbc-b13e-4778-abdb-6fa3dc913467] succeeded in 2.20583087399973s: None 2024-05-24T23:20:03.371861525Z [2024-05-24 23:20:03,371: INFO/ForkPoolWorker-6] Task airflow.executors.celery_executor.execute_command[88263950-86ee-46b6-98ce-3e9b4d5c7223] succeeded in 2.466804164000223s: None 2024-05-24T23:20:03.726544574Z [2024-05-24 23:20:03,726: INFO/ForkPoolWorker-5] Getting VIM list 2024-05-24T23:20:03.730089454Z [2024-05-24 23:20:03,729: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:20:03.759431291Z [2024-05-24 23:20:03,759: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-05-24T23:20:03.763327181Z [2024-05-24 23:20:03,763: INFO/ForkPoolWorker-5] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:20:03.763351749Z [2024-05-24 23:20:03,763: INFO/ForkPoolWorker-5] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:20:03.763447374Z [2024-05-24 23:20:03,763: INFO/ForkPoolWorker-5] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:20:03.763602135Z [2024-05-24 23:20:03,763: INFO/ForkPoolWorker-5] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:20:03.763671662Z [2024-05-24 23:20:03,763: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-05-24T23:20:03.763996920Z [2024-05-24 23:20:03,763: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:20:03.764074119Z [2024-05-24 23:20:03,763: INFO/ForkPoolWorker-5] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:20:03.771024633Z [2024-05-24 23:20:03,770: INFO/ForkPoolWorker-5] Creating DAG vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:20:03.823755701Z [2024-05-24 23:20:03,823: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:20:03.833042913Z [2024-05-24 23:20:03,832: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:20:03.871215734Z [2024-05-24 23:20:03,870: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-24T23:20:03.874857037Z [2024-05-24 23:20:03,874: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:20:03.981459402Z [2024-05-24 23:20:03,974: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-24T23:20:03.981468313Z [2024-05-24 23:20:03,976: INFO/ForkPoolWorker-3] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:20:03.981471479Z [2024-05-24 23:20:03,977: INFO/ForkPoolWorker-3] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:20:03.981475203Z [2024-05-24 23:20:03,977: INFO/ForkPoolWorker-3] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:20:03.981479358Z [2024-05-24 23:20:03,977: INFO/ForkPoolWorker-3] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:20:03.981483175Z [2024-05-24 23:20:03,977: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-24T23:20:03.981486231Z [2024-05-24 23:20:03,977: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:20:03.981489189Z [2024-05-24 23:20:03,977: INFO/ForkPoolWorker-3] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:20:03.982655027Z [2024-05-24 23:20:03,982: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:20:03.989407699Z [2024-05-24 23:20:03,986: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:20:03.989433136Z [2024-05-24 23:20:03,986: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:20:03.989437863Z [2024-05-24 23:20:03,987: INFO/ForkPoolWorker-15] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:20:03.989443157Z [2024-05-24 23:20:03,987: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:20:03.989465346Z [2024-05-24 23:20:03,987: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:20:03.989470174Z [2024-05-24 23:20:03,987: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:20:03.989474469Z [2024-05-24 23:20:03,987: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:20:03.989479013Z [2024-05-24 23:20:03,988: INFO/ForkPoolWorker-3] Creating DAG vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:20:03.996539843Z [2024-05-24 23:20:03,996: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:20:03.998372342Z [2024-05-24 23:20:03,998: INFO/ForkPoolWorker-5] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:20:04.076631593Z [2024-05-24 23:20:04,076: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:20:04.135095743Z [2024-05-24 23:20:04,134: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:20:04.396807224Z [2024-05-24 23:20:04,396: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:20:04.403568617Z [2024-05-24 23:20:04,403: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:20:04.446547937Z [2024-05-24 23:20:04,446: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:20:04.450389163Z [2024-05-24 23:20:04,450: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:20:04.450535848Z [2024-05-24 23:20:04,450: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:20:04.450638030Z [2024-05-24 23:20:04,450: INFO/ForkPoolWorker-16] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:20:04.450890007Z [2024-05-24 23:20:04,450: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:20:04.450986208Z [2024-05-24 23:20:04,450: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:20:04.451314530Z [2024-05-24 23:20:04,451: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:20:04.451789874Z [2024-05-24 23:20:04,451: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:20:04.457018058Z [2024-05-24 23:20:04,456: INFO/ForkPoolWorker-16] Creating DAG vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:20:04.635124802Z [2024-05-24 23:20:04,633: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:20:04.883913211Z [2024-05-24 23:20:04,883: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[6987f57b-d8bd-45b6-a7fd-7fca8e1d91fc] succeeded in 4.019241532999786s: None 2024-05-24T23:20:04.915098485Z [2024-05-24 23:20:04,914: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:20:04.918698048Z [2024-05-24 23:20:04,918: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:20:04.943505122Z [2024-05-24 23:20:04,943: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:20:04.945707791Z [2024-05-24 23:20:04,945: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:20:04.945842865Z [2024-05-24 23:20:04,945: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:20:04.945920439Z [2024-05-24 23:20:04,945: INFO/ForkPoolWorker-1] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:20:04.946117640Z [2024-05-24 23:20:04,945: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:20:04.946210745Z [2024-05-24 23:20:04,946: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:20:04.946530907Z [2024-05-24 23:20:04,946: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:20:04.946661526Z [2024-05-24 23:20:04,946: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:20:04.950937349Z [2024-05-24 23:20:04,950: INFO/ForkPoolWorker-1] Creating DAG vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:20:05.047462208Z [2024-05-24 23:20:05,047: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:20:05.187905927Z [2024-05-24 23:20:05,187: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:20:05.191022666Z [2024-05-24 23:20:05,190: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:20:05.219593930Z [2024-05-24 23:20:05,219: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:20:05.221205469Z [2024-05-24 23:20:05,220: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:20:05.221330345Z [2024-05-24 23:20:05,221: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:20:05.221459920Z [2024-05-24 23:20:05,221: INFO/ForkPoolWorker-2] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:20:05.221572903Z [2024-05-24 23:20:05,221: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:20:05.221586407Z [2024-05-24 23:20:05,221: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:20:05.221880257Z [2024-05-24 23:20:05,221: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:20:05.221912015Z [2024-05-24 23:20:05,221: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:20:05.233332711Z [2024-05-24 23:20:05,232: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:20:05.245851261Z [2024-05-24 23:20:05,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bffa704e-ae36-4953-ab3b-6dadfe7f9536] received 2024-05-24T23:20:05.251981294Z [2024-05-24 23:20:05,251: INFO/ForkPoolWorker-3] [bffa704e-ae36-4953-ab3b-6dadfe7f9536] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:20:05.309121732Z [2024-05-24 23:20:05,308: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:20:05.590003468Z [2024-05-24 23:20:05,586: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:20:05.941818211Z [2024-05-24 23:20:05,941: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b7cdcf19-2d60-4aed-93c3-b6c5a988408c] succeeded in 5.081003340999814s: None 2024-05-24T23:20:06.220929368Z [2024-05-24 23:20:06,220: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d34ab1a8-24a7-4eda-83d9-0724f8018bc0] succeeded in 5.3655231780003305s: None 2024-05-24T23:20:06.672763740Z [2024-05-24 23:20:06,672: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[781b48a1-1a20-4ed9-a401-0e221da4f549] received 2024-05-24T23:20:06.687052045Z [2024-05-24 23:20:06,686: INFO/ForkPoolWorker-16] [781b48a1-1a20-4ed9-a401-0e221da4f549] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'split_metrics', 'scheduled__2024-05-24T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:20:06.730354457Z [2024-05-24 23:20:06,730: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-24T23:20:06.733640944Z [2024-05-24 23:20:06,733: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:20:06.749644747Z [2024-05-24 23:20:06,749: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-24T23:20:06.750733385Z [2024-05-24 23:20:06,750: INFO/ForkPoolWorker-3] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:20:06.750748714Z [2024-05-24 23:20:06,750: INFO/ForkPoolWorker-3] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:20:06.750817004Z [2024-05-24 23:20:06,750: INFO/ForkPoolWorker-3] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:20:06.750892963Z [2024-05-24 23:20:06,750: INFO/ForkPoolWorker-3] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:20:06.750951350Z [2024-05-24 23:20:06,750: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-24T23:20:06.751149200Z [2024-05-24 23:20:06,751: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:20:06.751226640Z [2024-05-24 23:20:06,751: INFO/ForkPoolWorker-3] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:20:06.756699618Z [2024-05-24 23:20:06,756: INFO/ForkPoolWorker-3] Creating DAG vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:20:06.886107078Z [2024-05-24 23:20:06,885: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:20:06.894605442Z [2024-05-24 23:20:06,894: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e8686b09-b54e-45ce-88d6-6053a1078fd3] succeeded in 6.036088951000238s: None 2024-05-24T23:20:07.013667946Z [2024-05-24 23:20:07,010: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:20:07.539584218Z [2024-05-24 23:20:07,538: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[a0a0d7a7-c79c-470a-bb4a-f95b0e55f8ad] succeeded in 6.637999177999973s: None 2024-05-24T23:20:07.559501748Z [2024-05-24 23:20:07,559: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[bffa704e-ae36-4953-ab3b-6dadfe7f9536] succeeded in 2.3124061690000417s: None 2024-05-24T23:20:07.614127414Z [2024-05-24 23:20:07,613: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bc27bf87-eca3-40da-8834-9759082146ff] succeeded in 6.76301772800025s: None 2024-05-24T23:20:08.175948553Z [2024-05-24 23:20:08,175: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4fedfca2-5249-4ae2-bb09-55574a229c97] received 2024-05-24T23:20:08.178223322Z [2024-05-24 23:20:08,177: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:20:08.181502156Z [2024-05-24 23:20:08,181: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:20:08.189098647Z [2024-05-24 23:20:08,188: INFO/ForkPoolWorker-15] [4fedfca2-5249-4ae2-bb09-55574a229c97] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:20:08.205339988Z [2024-05-24 23:20:08,205: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:20:08.207603019Z [2024-05-24 23:20:08,207: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:20:08.207633804Z [2024-05-24 23:20:08,207: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:20:08.207775844Z [2024-05-24 23:20:08,207: INFO/ForkPoolWorker-16] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:20:08.207937253Z [2024-05-24 23:20:08,207: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:20:08.207977599Z [2024-05-24 23:20:08,207: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:20:08.208275761Z [2024-05-24 23:20:08,208: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:20:08.208596660Z [2024-05-24 23:20:08,208: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:20:08.214943703Z [2024-05-24 23:20:08,214: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:20:08.321799487Z [2024-05-24 23:20:08,321: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:20:08.496627962Z [2024-05-24 23:20:08,493: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:20:08.997668823Z [2024-05-24 23:20:08,997: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[781b48a1-1a20-4ed9-a401-0e221da4f549] succeeded in 2.323271731999739s: None 2024-05-24T23:20:09.025931125Z [2024-05-24 23:20:09,025: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e815a585-656e-479a-b1f4-8783c260c79b] received 2024-05-24T23:20:09.032144344Z [2024-05-24 23:20:09,031: INFO/ForkPoolWorker-16] [e815a585-656e-479a-b1f4-8783c260c79b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'collect_metrics', 'scheduled__2024-05-24T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:20:09.305694812Z [2024-05-24 23:20:09,302: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:20:09.598310497Z [2024-05-24 23:20:09,597: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:20:09.601845130Z [2024-05-24 23:20:09,601: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:20:09.623829809Z [2024-05-24 23:20:09,623: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:20:09.625252767Z [2024-05-24 23:20:09,625: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:20:09.625467398Z [2024-05-24 23:20:09,625: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:20:09.625592893Z [2024-05-24 23:20:09,625: INFO/ForkPoolWorker-15] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:20:09.625821728Z [2024-05-24 23:20:09,625: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:20:09.625943835Z [2024-05-24 23:20:09,625: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:20:09.626506519Z [2024-05-24 23:20:09,626: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:20:09.626633910Z [2024-05-24 23:20:09,626: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:20:09.633271001Z [2024-05-24 23:20:09,633: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:20:09.727694505Z [2024-05-24 23:20:09,727: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:20:10.351010991Z [2024-05-24 23:20:10,350: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4fedfca2-5249-4ae2-bb09-55574a229c97] succeeded in 2.171106167000289s: None 2024-05-24T23:20:10.428200913Z [2024-05-24 23:20:10,427: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:20:10.432082117Z [2024-05-24 23:20:10,431: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:20:10.458053546Z [2024-05-24 23:20:10,457: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:20:10.459923181Z [2024-05-24 23:20:10,459: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:20:10.459978164Z [2024-05-24 23:20:10,459: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:20:10.460074562Z [2024-05-24 23:20:10,459: INFO/ForkPoolWorker-16] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:20:10.460283663Z [2024-05-24 23:20:10,460: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:20:10.460338057Z [2024-05-24 23:20:10,460: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:20:10.460665195Z [2024-05-24 23:20:10,460: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:20:10.460679664Z [2024-05-24 23:20:10,460: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:20:10.468868851Z [2024-05-24 23:20:10,468: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:20:10.569395331Z [2024-05-24 23:20:10,568: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:20:11.046834433Z [2024-05-24 23:20:11,046: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6461aad-80c0-4665-9b02-ba51ffe2d86d] received 2024-05-24T23:20:11.073857612Z [2024-05-24 23:20:11,073: INFO/ForkPoolWorker-15] [b6461aad-80c0-4665-9b02-ba51ffe2d86d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:20:11.182981290Z [2024-05-24 23:20:11,182: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e815a585-656e-479a-b1f4-8783c260c79b] succeeded in 2.155586375999974s: None 2024-05-24T23:20:11.227446724Z [2024-05-24 23:20:11,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d7d1889-a5cd-4f72-9f7a-d2169250aeb7] received 2024-05-24T23:20:11.239065713Z [2024-05-24 23:20:11,238: INFO/ForkPoolWorker-16] [6d7d1889-a5cd-4f72-9f7a-d2169250aeb7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'send_prometheus', 'scheduled__2024-05-24T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:20:11.344597408Z [2024-05-24 23:20:11,341: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:20:11.620795861Z [2024-05-24 23:20:11,617: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:20:12.542115693Z [2024-05-24 23:20:12,541: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:20:12.547281957Z [2024-05-24 23:20:12,546: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:20:12.564340191Z [2024-05-24 23:20:12,564: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:20:12.566318805Z [2024-05-24 23:20:12,566: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:20:12.566701026Z [2024-05-24 23:20:12,566: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:20:12.566952192Z [2024-05-24 23:20:12,566: INFO/ForkPoolWorker-15] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:20:12.567306371Z [2024-05-24 23:20:12,567: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:20:12.567568070Z [2024-05-24 23:20:12,567: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:20:12.568113122Z [2024-05-24 23:20:12,567: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:20:12.568369949Z [2024-05-24 23:20:12,568: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:20:12.577341345Z [2024-05-24 23:20:12,576: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:20:12.693117373Z [2024-05-24 23:20:12,692: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:20:12.862245483Z [2024-05-24 23:20:12,854: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:20:12.862551539Z [2024-05-24 23:20:12,861: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:20:12.886823868Z [2024-05-24 23:20:12,886: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:20:12.889173509Z [2024-05-24 23:20:12,888: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:20:12.889344825Z [2024-05-24 23:20:12,889: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:20:12.889527485Z [2024-05-24 23:20:12,889: INFO/ForkPoolWorker-16] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:20:12.889775020Z [2024-05-24 23:20:12,889: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:20:12.889923965Z [2024-05-24 23:20:12,889: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:20:12.890453015Z [2024-05-24 23:20:12,890: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:20:12.890570810Z [2024-05-24 23:20:12,890: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:20:12.897694479Z [2024-05-24 23:20:12,897: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:20:12.970498600Z [2024-05-24 23:20:12,970: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:20:13.397654492Z [2024-05-24 23:20:13,397: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b6461aad-80c0-4665-9b02-ba51ffe2d86d] succeeded in 2.347496556999886s: None 2024-05-24T23:20:13.642216927Z [2024-05-24 23:20:13,641: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6d7d1889-a5cd-4f72-9f7a-d2169250aeb7] succeeded in 2.407512403000055s: None 2024-05-24T23:21:00.770454091Z [2024-05-24 23:21:00,769: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93d4ad2e-b3d2-48d1-be33-622bf8e1a7ca] received 2024-05-24T23:21:00.775070082Z [2024-05-24 23:21:00,774: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2bc33cc7-4d04-4858-9f06-3f004c3e9007] received 2024-05-24T23:21:00.781171968Z [2024-05-24 23:21:00,780: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27061e12-57d5-4302-a598-3be54a081f27] received 2024-05-24T23:21:00.785782633Z [2024-05-24 23:21:00,785: INFO/ForkPoolWorker-15] [93d4ad2e-b3d2-48d1-be33-622bf8e1a7ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:21:00.787416271Z [2024-05-24 23:21:00,786: INFO/ForkPoolWorker-16] [2bc33cc7-4d04-4858-9f06-3f004c3e9007] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:21:00.797270018Z [2024-05-24 23:21:00,796: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[373b260f-2a82-4d60-8f76-0f8efd699e73] received 2024-05-24T23:21:00.800938533Z [2024-05-24 23:21:00,800: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b1b977e-f1fa-40f1-b960-c8990b94c8c9] received 2024-05-24T23:21:00.806286432Z [2024-05-24 23:21:00,805: INFO/ForkPoolWorker-1] [27061e12-57d5-4302-a598-3be54a081f27] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:21:00.822728204Z [2024-05-24 23:21:00,822: INFO/ForkPoolWorker-2] [373b260f-2a82-4d60-8f76-0f8efd699e73] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:21:00.824055357Z [2024-05-24 23:21:00,823: INFO/ForkPoolWorker-3] [6b1b977e-f1fa-40f1-b960-c8990b94c8c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:21:01.122909787Z [2024-05-24 23:21:01,119: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:21:01.193607801Z [2024-05-24 23:21:01,189: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:21:01.298690763Z [2024-05-24 23:21:01,292: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:21:01.316522293Z [2024-05-24 23:21:01,312: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:21:01.419622846Z [2024-05-24 23:21:01,414: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:21:01.612574956Z [2024-05-24 23:21:01,612: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-24T23:21:01.622944066Z [2024-05-24 23:21:01,622: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:21:01.669681056Z [2024-05-24 23:21:01,669: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:21:01.671819761Z [2024-05-24 23:21:01,671: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:21:01.671886266Z [2024-05-24 23:21:01,671: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:21:01.671926250Z [2024-05-24 23:21:01,671: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-24T23:21:01.672220973Z [2024-05-24 23:21:01,672: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:21:01.796694301Z [2024-05-24 23:21:01,796: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:21:02.597026658Z [2024-05-24 23:21:02,596: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-24T23:21:02.610177069Z [2024-05-24 23:21:02,609: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:21:02.610201882Z [2024-05-24 23:21:02,609: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[93d4ad2e-b3d2-48d1-be33-622bf8e1a7ca] succeeded in 1.8329906089998076s: None 2024-05-24T23:21:02.638013625Z [2024-05-24 23:21:02,637: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-24T23:21:02.639555118Z [2024-05-24 23:21:02,639: INFO/ForkPoolWorker-3] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:21:02.639595589Z [2024-05-24 23:21:02,639: INFO/ForkPoolWorker-3] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:21:02.639635130Z [2024-05-24 23:21:02,639: INFO/ForkPoolWorker-3] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:21:02.639762640Z [2024-05-24 23:21:02,639: INFO/ForkPoolWorker-3] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:21:02.639796052Z [2024-05-24 23:21:02,639: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-24T23:21:02.640029741Z [2024-05-24 23:21:02,639: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:21:02.640074534Z [2024-05-24 23:21:02,640: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:21:02.644599246Z [2024-05-24 23:21:02,644: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:21:02.734863592Z [2024-05-24 23:21:02,734: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:21:03.119354922Z [2024-05-24 23:21:03,118: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:21:03.123800542Z [2024-05-24 23:21:03,123: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:21:03.128038477Z [2024-05-24 23:21:03,127: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:21:03.132003368Z [2024-05-24 23:21:03,131: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:21:03.148916859Z [2024-05-24 23:21:03,148: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:21:03.152247575Z [2024-05-24 23:21:03,152: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:21:03.153509651Z [2024-05-24 23:21:03,153: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:21:03.153525611Z [2024-05-24 23:21:03,153: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:21:03.153601328Z [2024-05-24 23:21:03,153: INFO/ForkPoolWorker-2] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:21:03.153811908Z [2024-05-24 23:21:03,153: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:21:03.153847135Z [2024-05-24 23:21:03,153: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:21:03.154044210Z [2024-05-24 23:21:03,153: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:21:03.154076287Z [2024-05-24 23:21:03,154: INFO/ForkPoolWorker-2] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:21:03.154281160Z [2024-05-24 23:21:03,154: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:21:03.154498017Z [2024-05-24 23:21:03,153: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:21:03.156101421Z [2024-05-24 23:21:03,155: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:21:03.156149251Z [2024-05-24 23:21:03,156: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:21:03.156244655Z [2024-05-24 23:21:03,156: INFO/ForkPoolWorker-1] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:21:03.156421919Z [2024-05-24 23:21:03,156: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:21:03.156468267Z [2024-05-24 23:21:03,156: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:21:03.156756535Z [2024-05-24 23:21:03,156: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:21:03.156823018Z [2024-05-24 23:21:03,156: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:21:03.158776282Z [2024-05-24 23:21:03,158: INFO/ForkPoolWorker-2] Creating DAG vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:21:03.161273672Z [2024-05-24 23:21:03,161: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:21:03.175530537Z [2024-05-24 23:21:03,175: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:21:03.178150100Z [2024-05-24 23:21:03,177: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:21:03.178362243Z [2024-05-24 23:21:03,178: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:21:03.178558656Z [2024-05-24 23:21:03,178: INFO/ForkPoolWorker-16] Read VIM 706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 (basic_08_vim_test) 2024-05-24T23:21:03.178789371Z [2024-05-24 23:21:03,178: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-05-24T23:21:03.178945780Z [2024-05-24 23:21:03,178: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:21:03.179289291Z [2024-05-24 23:21:03,179: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:21:03.179449881Z [2024-05-24 23:21:03,179: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:21:03.185178463Z [2024-05-24 23:21:03,184: INFO/ForkPoolWorker-16] Creating DAG vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3 2024-05-24T23:21:03.240494185Z [2024-05-24 23:21:03,240: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:21:03.246512842Z [2024-05-24 23:21:03,246: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:21:03.311746595Z [2024-05-24 23:21:03,311: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:21:05.073807454Z [2024-05-24 23:21:05,073: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[373b260f-2a82-4d60-8f76-0f8efd699e73] succeeded in 4.272318969000025s: None 2024-05-24T23:21:05.138270207Z [2024-05-24 23:21:05,137: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[6b1b977e-f1fa-40f1-b960-c8990b94c8c9] succeeded in 4.327749161000156s: None 2024-05-24T23:21:05.189277898Z [2024-05-24 23:21:05,188: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2bc33cc7-4d04-4858-9f06-3f004c3e9007] succeeded in 4.411568247000105s: None 2024-05-24T23:21:05.405791818Z [2024-05-24 23:21:05,405: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[27061e12-57d5-4302-a598-3be54a081f27] succeeded in 4.617693657000018s: None 2024-05-24T23:22:01.185100949Z [2024-05-24 23:22:01,184: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f840a75-9d74-4a5b-8135-702e1b684f05] received 2024-05-24T23:22:01.191145636Z [2024-05-24 23:22:01,190: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71d0edde-c9d7-4439-81e9-fe46e32db058] received 2024-05-24T23:22:01.192988603Z [2024-05-24 23:22:01,192: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d8e40fb-fe38-4b00-830a-2cdfb78c780b] received 2024-05-24T23:22:01.195593369Z [2024-05-24 23:22:01,195: INFO/ForkPoolWorker-15] [4f840a75-9d74-4a5b-8135-702e1b684f05] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:22:01.199976358Z [2024-05-24 23:22:01,199: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa841f8e-bef0-4d6d-aab9-a332645a2fec] received 2024-05-24T23:22:01.204128736Z [2024-05-24 23:22:01,203: INFO/ForkPoolWorker-16] [71d0edde-c9d7-4439-81e9-fe46e32db058] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:22:01.204798305Z [2024-05-24 23:22:01,204: INFO/ForkPoolWorker-1] [3d8e40fb-fe38-4b00-830a-2cdfb78c780b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:22:01.214189540Z [2024-05-24 23:22:01,213: INFO/ForkPoolWorker-2] [aa841f8e-bef0-4d6d-aab9-a332645a2fec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:22:01.214682041Z [2024-05-24 23:22:01,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d0c7e522-24a7-4ad4-aa56-39adaf40f8a2] received 2024-05-24T23:22:01.224229010Z [2024-05-24 23:22:01,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[889dacbe-3e34-489d-84e2-484457ed865c] received 2024-05-24T23:22:01.240756426Z [2024-05-24 23:22:01,239: INFO/ForkPoolWorker-3] [d0c7e522-24a7-4ad4-aa56-39adaf40f8a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:22:01.266311664Z [2024-05-24 23:22:01,265: INFO/ForkPoolWorker-4] [889dacbe-3e34-489d-84e2-484457ed865c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:22:01.838179750Z [2024-05-24 23:22:01,805: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:22:01.890399169Z [2024-05-24 23:22:01,882: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:22:01.894122300Z [2024-05-24 23:22:01,886: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:22:02.111538375Z [2024-05-24 23:22:02,111: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-24T23:22:02.115908501Z [2024-05-24 23:22:02,115: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:22:02.169198739Z [2024-05-24 23:22:02,163: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:22:02.237380012Z [2024-05-24 23:22:02,234: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:22:02.261342572Z [2024-05-24 23:22:02,261: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:22:02.267314694Z [2024-05-24 23:22:02,261: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:22:02.277344224Z [2024-05-24 23:22:02,267: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-24T23:22:02.277365753Z [2024-05-24 23:22:02,273: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:22:02.289332211Z [2024-05-24 23:22:02,285: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:22:02.322997219Z [2024-05-24 23:22:02,318: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:22:02.329870193Z [2024-05-24 23:22:02,325: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:22:02.640082756Z [2024-05-24 23:22:02,639: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:22:03.494268394Z [2024-05-24 23:22:03,493: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[d0c7e522-24a7-4ad4-aa56-39adaf40f8a2] succeeded in 2.2739776849998634s: None 2024-05-24T23:22:04.108434732Z [2024-05-24 23:22:04,107: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3d8e40fb-fe38-4b00-830a-2cdfb78c780b] succeeded in 2.9126379819999784s: None 2024-05-24T23:22:04.279943583Z [2024-05-24 23:22:04,279: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:22:04.286286676Z [2024-05-24 23:22:04,285: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:22:04.324383950Z [2024-05-24 23:22:04,324: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:22:04.327821273Z [2024-05-24 23:22:04,327: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:22:04.354661146Z [2024-05-24 23:22:04,354: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:22:04.374262259Z [2024-05-24 23:22:04,373: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:22:04.374676895Z [2024-05-24 23:22:04,374: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:22:04.375377422Z [2024-05-24 23:22:04,374: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:22:04.375540888Z [2024-05-24 23:22:04,375: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:22:04.376286891Z [2024-05-24 23:22:04,376: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:22:04.376433211Z [2024-05-24 23:22:04,376: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:22:04.410480483Z [2024-05-24 23:22:04,410: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:22:04.411850386Z [2024-05-24 23:22:04,411: WARNING/ForkPoolWorker-2] Dag 'vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:22:04.414014785Z [2024-05-24 23:22:04,413: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:22:04.414128355Z [2024-05-24 23:22:04,414: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:22:04.414288558Z [2024-05-24 23:22:04,414: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:22:04.414359451Z [2024-05-24 23:22:04,414: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:22:04.414665497Z [2024-05-24 23:22:04,414: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:22:04.415114811Z [2024-05-24 23:22:04,414: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:22:04.419159466Z [2024-05-24 23:22:04,414: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:22:04.420472017Z [2024-05-24 23:22:04,420: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:22:04.422783896Z [2024-05-24 23:22:04,422: WARNING/ForkPoolWorker-15] Dag 'vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:22:04.424050963Z [2024-05-24 23:22:04,423: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:22:04.428047928Z [2024-05-24 23:22:04,427: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:22:04.429483232Z [2024-05-24 23:22:04,429: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:22:04.433090435Z [2024-05-24 23:22:04,432: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:22:04.474641065Z [2024-05-24 23:22:04,474: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:22:04.480462358Z [2024-05-24 23:22:04,480: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:22:04.482930992Z [2024-05-24 23:22:04,482: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:22:04.482987158Z [2024-05-24 23:22:04,482: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:22:04.483095299Z [2024-05-24 23:22:04,482: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:22:04.483130676Z [2024-05-24 23:22:04,483: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:22:04.483415280Z [2024-05-24 23:22:04,483: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:22:04.483428229Z [2024-05-24 23:22:04,483: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:22:04.485533177Z [2024-05-24 23:22:04,485: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:22:04.487289519Z [2024-05-24 23:22:04,486: ERROR/ForkPoolWorker-2] [aa841f8e-bef0-4d6d-aab9-a332645a2fec] Failed to execute task Dag 'vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3' could not be found; either it does not exist or it failed to parse.. 2024-05-24T23:22:04.487300521Z Traceback (most recent call last): 2024-05-24T23:22:04.487304176Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-24T23:22:04.487307604Z args.func(args) 2024-05-24T23:22:04.487310672Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-24T23:22:04.487322202Z return func(*args, **kwargs) 2024-05-24T23:22:04.487325389Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-24T23:22:04.487328296Z return f(*args, **kwargs) 2024-05-24T23:22:04.487331256Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-24T23:22:04.487334188Z dag = get_dag(args.subdir, args.dag_id) 2024-05-24T23:22:04.487337071Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-24T23:22:04.487340364Z raise AirflowException( 2024-05-24T23:22:04.487343761Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3' could not be found; either it does not exist or it failed to parse. 2024-05-24T23:22:04.491838790Z [2024-05-24 23:22:04,490: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:22:04.492072105Z [2024-05-24 23:22:04,491: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:22:04.492766914Z [2024-05-24 23:22:04,492: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:22:04.493071279Z [2024-05-24 23:22:04,492: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:22:04.495117729Z [2024-05-24 23:22:04,494: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:22:04.498476245Z [2024-05-24 23:22:04,497: ERROR/ForkPoolWorker-15] [4f840a75-9d74-4a5b-8135-702e1b684f05] Failed to execute task Dag 'vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3' could not be found; either it does not exist or it failed to parse.. 2024-05-24T23:22:04.498488633Z Traceback (most recent call last): 2024-05-24T23:22:04.498492464Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-24T23:22:04.498508984Z args.func(args) 2024-05-24T23:22:04.498512379Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-24T23:22:04.498515705Z return func(*args, **kwargs) 2024-05-24T23:22:04.498518650Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-24T23:22:04.498521683Z return f(*args, **kwargs) 2024-05-24T23:22:04.498524644Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-24T23:22:04.498527473Z dag = get_dag(args.subdir, args.dag_id) 2024-05-24T23:22:04.498530447Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-24T23:22:04.498533305Z raise AirflowException( 2024-05-24T23:22:04.498537337Z airflow.exceptions.AirflowException: Dag 'vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3' could not be found; either it does not exist or it failed to parse. 2024-05-24T23:22:04.535546468Z [2024-05-24 23:22:04,535: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[aa841f8e-bef0-4d6d-aab9-a332645a2fec] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id aa841f8e-bef0-4d6d-aab9-a332645a2fec') 2024-05-24T23:22:04.535567801Z Traceback (most recent call last): 2024-05-24T23:22:04.535572945Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-24T23:22:04.535576662Z R = retval = fun(*args, **kwargs) 2024-05-24T23:22:04.535580190Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-24T23:22:04.535583727Z return self.run(*args, **kwargs) 2024-05-24T23:22:04.535600755Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-24T23:22:04.535605625Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-24T23:22:04.535609133Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-24T23:22:04.535613179Z raise AirflowException(msg) 2024-05-24T23:22:04.535617385Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id aa841f8e-bef0-4d6d-aab9-a332645a2fec 2024-05-24T23:22:04.549594365Z [2024-05-24 23:22:04,549: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4f840a75-9d74-4a5b-8135-702e1b684f05] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4f840a75-9d74-4a5b-8135-702e1b684f05') 2024-05-24T23:22:04.549622546Z Traceback (most recent call last): 2024-05-24T23:22:04.549626324Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-24T23:22:04.549629633Z R = retval = fun(*args, **kwargs) 2024-05-24T23:22:04.549632972Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-24T23:22:04.549636176Z return self.run(*args, **kwargs) 2024-05-24T23:22:04.549639646Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-24T23:22:04.549643103Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-24T23:22:04.549646052Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-24T23:22:04.549661692Z raise AirflowException(msg) 2024-05-24T23:22:04.549665853Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4f840a75-9d74-4a5b-8135-702e1b684f05 2024-05-24T23:22:04.631434430Z [2024-05-24 23:22:04,631: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:22:04.634837377Z [2024-05-24 23:22:04,634: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:22:04.653597388Z [2024-05-24 23:22:04,653: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:22:04.654418788Z [2024-05-24 23:22:04,654: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:22:04.654620839Z [2024-05-24 23:22:04,654: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:22:04.654874446Z [2024-05-24 23:22:04,654: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:22:04.655399677Z [2024-05-24 23:22:04,654: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:22:04.659552462Z [2024-05-24 23:22:04,655: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:22:04.660150533Z [2024-05-24 23:22:04,659: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:22:04.705375326Z [2024-05-24 23:22:04,704: INFO/ForkPoolWorker-4] Getting VIM list 2024-05-24T23:22:04.710859869Z [2024-05-24 23:22:04,710: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:22:04.738858080Z [2024-05-24 23:22:04,738: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:22:04.760900418Z [2024-05-24 23:22:04,760: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-05-24T23:22:04.763482823Z [2024-05-24 23:22:04,763: INFO/ForkPoolWorker-4] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:22:04.763932732Z [2024-05-24 23:22:04,763: INFO/ForkPoolWorker-4] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:22:04.764180431Z [2024-05-24 23:22:04,763: INFO/ForkPoolWorker-4] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:22:04.764458516Z [2024-05-24 23:22:04,764: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-05-24T23:22:04.764793502Z [2024-05-24 23:22:04,764: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:22:04.765386918Z [2024-05-24 23:22:04,764: INFO/ForkPoolWorker-4] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:22:04.869610336Z [2024-05-24 23:22:04,869: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:22:06.351814790Z [2024-05-24 23:22:06,351: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[889dacbe-3e34-489d-84e2-484457ed865c] succeeded in 5.119578413999989s: None 2024-05-24T23:22:06.634011397Z [2024-05-24 23:22:06,633: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[71d0edde-c9d7-4439-81e9-fe46e32db058] succeeded in 5.440553149999687s: None 2024-05-24T23:22:15.507946770Z [2024-05-24 23:22:15,507: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8abb8c3-bfbe-40c6-bcc2-b71835c9e0c5] received 2024-05-24T23:22:15.513751685Z [2024-05-24 23:22:15,513: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51672fb9-bf81-4526-a52e-921ec2a896b7] received 2024-05-24T23:22:15.526083989Z [2024-05-24 23:22:15,525: INFO/ForkPoolWorker-16] [51672fb9-bf81-4526-a52e-921ec2a896b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:22:15.526103210Z [2024-05-24 23:22:15,525: INFO/ForkPoolWorker-15] [c8abb8c3-bfbe-40c6-bcc2-b71835c9e0c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:22:15.800716372Z [2024-05-24 23:22:15,797: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:22:15.849626776Z [2024-05-24 23:22:15,845: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:22:16.880685355Z [2024-05-24 23:22:16,880: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:22:16.883931040Z [2024-05-24 23:22:16,883: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:22:16.910542102Z [2024-05-24 23:22:16,910: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:22:16.911813078Z [2024-05-24 23:22:16,911: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:22:16.911835738Z [2024-05-24 23:22:16,911: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:22:16.912004840Z [2024-05-24 23:22:16,911: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:22:16.912062151Z [2024-05-24 23:22:16,911: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:22:16.912338005Z [2024-05-24 23:22:16,912: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:22:16.912412883Z [2024-05-24 23:22:16,912: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:22:16.920479166Z [2024-05-24 23:22:16,920: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:22:16.921445706Z [2024-05-24 23:22:16,920: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:22:16.922263787Z [2024-05-24 23:22:16,922: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:22:16.924939394Z [2024-05-24 23:22:16,924: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:22:16.937635294Z [2024-05-24 23:22:16,937: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:22:16.938759535Z [2024-05-24 23:22:16,938: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:22:16.938779037Z [2024-05-24 23:22:16,938: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:22:16.939093932Z [2024-05-24 23:22:16,938: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:22:16.939134538Z [2024-05-24 23:22:16,939: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:22:16.939348904Z [2024-05-24 23:22:16,939: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:22:16.939361966Z [2024-05-24 23:22:16,939: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:22:16.943024177Z [2024-05-24 23:22:16,942: ERROR/ForkPoolWorker-16] [51672fb9-bf81-4526-a52e-921ec2a896b7] Failed to execute task Dag 'vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3' could not be found; either it does not exist or it failed to parse.. 2024-05-24T23:22:16.943044842Z Traceback (most recent call last): 2024-05-24T23:22:16.943051030Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-24T23:22:16.943057044Z args.func(args) 2024-05-24T23:22:16.943062477Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-24T23:22:16.943068134Z return func(*args, **kwargs) 2024-05-24T23:22:16.943073134Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-24T23:22:16.943077996Z return f(*args, **kwargs) 2024-05-24T23:22:16.943082886Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-24T23:22:16.943087759Z dag = get_dag(args.subdir, args.dag_id) 2024-05-24T23:22:16.943092707Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-24T23:22:16.943097671Z raise AirflowException( 2024-05-24T23:22:16.943104039Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3' could not be found; either it does not exist or it failed to parse. 2024-05-24T23:22:16.978113167Z [2024-05-24 23:22:16,977: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[51672fb9-bf81-4526-a52e-921ec2a896b7] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 51672fb9-bf81-4526-a52e-921ec2a896b7') 2024-05-24T23:22:16.978138755Z Traceback (most recent call last): 2024-05-24T23:22:16.978192312Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-24T23:22:16.978200511Z R = retval = fun(*args, **kwargs) 2024-05-24T23:22:16.978207689Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-24T23:22:16.978232746Z return self.run(*args, **kwargs) 2024-05-24T23:22:16.978240017Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-24T23:22:16.978246863Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-24T23:22:16.978253170Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-24T23:22:16.978260331Z raise AirflowException(msg) 2024-05-24T23:22:16.978267538Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 51672fb9-bf81-4526-a52e-921ec2a896b7 2024-05-24T23:22:17.114855030Z [2024-05-24 23:22:17,114: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:22:17.118629748Z [2024-05-24 23:22:17,117: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:22:17.146178888Z [2024-05-24 23:22:17,145: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:22:17.148073384Z [2024-05-24 23:22:17,147: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:22:17.148085521Z [2024-05-24 23:22:17,147: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:22:17.148332792Z [2024-05-24 23:22:17,148: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:22:17.148346997Z [2024-05-24 23:22:17,148: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:22:17.148654188Z [2024-05-24 23:22:17,148: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:22:17.148715206Z [2024-05-24 23:22:17,148: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:22:17.157729031Z [2024-05-24 23:22:17,157: WARNING/ForkPoolWorker-15] Dag 'vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:22:17.158798577Z [2024-05-24 23:22:17,157: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:22:17.159795234Z [2024-05-24 23:22:17,159: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:22:17.162680602Z [2024-05-24 23:22:17,162: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:22:17.180674264Z [2024-05-24 23:22:17,180: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:22:17.182051708Z [2024-05-24 23:22:17,181: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:22:17.182073547Z [2024-05-24 23:22:17,181: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:22:17.182218122Z [2024-05-24 23:22:17,181: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:22:17.182252372Z [2024-05-24 23:22:17,182: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:22:17.182571668Z [2024-05-24 23:22:17,182: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:22:17.182620116Z [2024-05-24 23:22:17,182: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:22:17.188123658Z [2024-05-24 23:22:17,187: ERROR/ForkPoolWorker-15] [c8abb8c3-bfbe-40c6-bcc2-b71835c9e0c5] Failed to execute task Dag 'vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3' could not be found; either it does not exist or it failed to parse.. 2024-05-24T23:22:17.188142787Z Traceback (most recent call last): 2024-05-24T23:22:17.188151117Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-24T23:22:17.188158811Z args.func(args) 2024-05-24T23:22:17.188166693Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-24T23:22:17.188192927Z return func(*args, **kwargs) 2024-05-24T23:22:17.188199895Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-24T23:22:17.188206719Z return f(*args, **kwargs) 2024-05-24T23:22:17.188213675Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-24T23:22:17.188220607Z dag = get_dag(args.subdir, args.dag_id) 2024-05-24T23:22:17.188227483Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-24T23:22:17.188234254Z raise AirflowException( 2024-05-24T23:22:17.188242430Z airflow.exceptions.AirflowException: Dag 'vim_status_706b9e8f-77ee-45c7-95ae-9d2ebbd681c3' could not be found; either it does not exist or it failed to parse. 2024-05-24T23:22:17.240033890Z [2024-05-24 23:22:17,239: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c8abb8c3-bfbe-40c6-bcc2-b71835c9e0c5] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c8abb8c3-bfbe-40c6-bcc2-b71835c9e0c5') 2024-05-24T23:22:17.240070650Z Traceback (most recent call last): 2024-05-24T23:22:17.240080925Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-24T23:22:17.240089827Z R = retval = fun(*args, **kwargs) 2024-05-24T23:22:17.240098142Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-24T23:22:17.240106624Z return self.run(*args, **kwargs) 2024-05-24T23:22:17.240117238Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-24T23:22:17.240126531Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-24T23:22:17.240134974Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-24T23:22:17.240144058Z raise AirflowException(msg) 2024-05-24T23:22:17.240153497Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c8abb8c3-bfbe-40c6-bcc2-b71835c9e0c5 2024-05-24T23:23:00.324089713Z [2024-05-24 23:23:00,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f02086e-4064-4c5b-9a8f-867f740a2722] received 2024-05-24T23:23:00.325621848Z [2024-05-24 23:23:00,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a947d047-8c2e-4fb9-9221-d6c261550722] received 2024-05-24T23:23:00.331880427Z [2024-05-24 23:23:00,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15abe184-bd11-4042-9435-bdfcef2e6505] received 2024-05-24T23:23:00.342575859Z [2024-05-24 23:23:00,342: INFO/ForkPoolWorker-16] [a947d047-8c2e-4fb9-9221-d6c261550722] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:23:00.346469588Z [2024-05-24 23:23:00,345: INFO/ForkPoolWorker-15] [3f02086e-4064-4c5b-9a8f-867f740a2722] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:23:00.354010045Z [2024-05-24 23:23:00,353: INFO/ForkPoolWorker-1] [15abe184-bd11-4042-9435-bdfcef2e6505] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:23:00.645907541Z [2024-05-24 23:23:00,642: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:23:00.649910896Z [2024-05-24 23:23:00,646: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:23:00.661200201Z [2024-05-24 23:23:00,657: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:23:00.830355564Z [2024-05-24 23:23:00,829: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-24T23:23:00.834718284Z [2024-05-24 23:23:00,834: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:23:00.858928121Z [2024-05-24 23:23:00,858: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:23:00.862146300Z [2024-05-24 23:23:00,861: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:23:00.862348038Z [2024-05-24 23:23:00,862: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:23:00.862453634Z [2024-05-24 23:23:00,862: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-24T23:23:00.862825978Z [2024-05-24 23:23:00,862: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:23:01.013313885Z [2024-05-24 23:23:01,011: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:23:01.634253244Z [2024-05-24 23:23:01,633: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3f02086e-4064-4c5b-9a8f-867f740a2722] succeeded in 1.3059683659998882s: None 2024-05-24T23:23:01.855372411Z [2024-05-24 23:23:01,854: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:23:01.858583614Z [2024-05-24 23:23:01,858: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:23:01.871117254Z [2024-05-24 23:23:01,870: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:23:01.874589752Z [2024-05-24 23:23:01,874: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:23:01.884554473Z [2024-05-24 23:23:01,884: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:23:01.886159289Z [2024-05-24 23:23:01,885: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:23:01.886176773Z [2024-05-24 23:23:01,886: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:23:01.886318558Z [2024-05-24 23:23:01,886: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:23:01.886354017Z [2024-05-24 23:23:01,886: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:23:01.886695996Z [2024-05-24 23:23:01,886: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:23:01.886762674Z [2024-05-24 23:23:01,886: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:23:01.894226153Z [2024-05-24 23:23:01,894: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:23:01.895926879Z [2024-05-24 23:23:01,895: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:23:01.895947009Z [2024-05-24 23:23:01,895: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:23:01.896079880Z [2024-05-24 23:23:01,895: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:23:01.896128467Z [2024-05-24 23:23:01,896: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:23:01.896355065Z [2024-05-24 23:23:01,896: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:23:01.896388826Z [2024-05-24 23:23:01,896: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:23:01.980825439Z [2024-05-24 23:23:01,980: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:23:01.984703574Z [2024-05-24 23:23:01,984: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:23:03.529616539Z [2024-05-24 23:23:03,529: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a947d047-8c2e-4fb9-9221-d6c261550722] succeeded in 3.1978932170000007s: None 2024-05-24T23:23:03.792001787Z [2024-05-24 23:23:03,791: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[15abe184-bd11-4042-9435-bdfcef2e6505] succeeded in 3.454877251000198s: None 2024-05-24T23:24:00.238090271Z [2024-05-24 23:24:00,237: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b292d48b-0f66-4d3c-817f-b6ccddcafbc0] received 2024-05-24T23:24:00.242647344Z [2024-05-24 23:24:00,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3e9536d-6b8c-4d1d-8423-52e1937e03f0] received 2024-05-24T23:24:00.249498491Z [2024-05-24 23:24:00,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bbe9ee8b-a6cb-4d0c-8413-cc35d12d0634] received 2024-05-24T23:24:00.252044282Z [2024-05-24 23:24:00,251: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3010b5ab-278d-46ac-8884-f21a259281fc] received 2024-05-24T23:24:00.253075035Z [2024-05-24 23:24:00,252: INFO/ForkPoolWorker-16] [e3e9536d-6b8c-4d1d-8423-52e1937e03f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:24:00.254117245Z [2024-05-24 23:24:00,253: INFO/ForkPoolWorker-15] [b292d48b-0f66-4d3c-817f-b6ccddcafbc0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:24:00.271657815Z [2024-05-24 23:24:00,271: INFO/ForkPoolWorker-1] [bbe9ee8b-a6cb-4d0c-8413-cc35d12d0634] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:24:00.283039881Z [2024-05-24 23:24:00,282: INFO/ForkPoolWorker-2] [3010b5ab-278d-46ac-8884-f21a259281fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:24:00.580292882Z [2024-05-24 23:24:00,575: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:24:00.609312318Z [2024-05-24 23:24:00,605: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:24:00.615160405Z [2024-05-24 23:24:00,609: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:24:00.640976422Z [2024-05-24 23:24:00,636: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:24:00.786687704Z [2024-05-24 23:24:00,786: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-24T23:24:00.790452524Z [2024-05-24 23:24:00,790: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:24:00.847970979Z [2024-05-24 23:24:00,847: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:24:00.850369692Z [2024-05-24 23:24:00,849: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:24:00.851187216Z [2024-05-24 23:24:00,850: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:24:00.853962488Z [2024-05-24 23:24:00,853: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-24T23:24:00.854789488Z [2024-05-24 23:24:00,854: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:24:00.855653552Z [2024-05-24 23:24:00,855: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:24:00.953290364Z [2024-05-24 23:24:00,952: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:24:01.494605345Z [2024-05-24 23:24:01,494: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b292d48b-0f66-4d3c-817f-b6ccddcafbc0] succeeded in 1.25381451200019s: None 2024-05-24T23:24:01.656951893Z [2024-05-24 23:24:01,656: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e3e9536d-6b8c-4d1d-8423-52e1937e03f0] succeeded in 1.412528623000071s: None 2024-05-24T23:24:01.983914924Z [2024-05-24 23:24:01,983: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:24:01.987334103Z [2024-05-24 23:24:01,986: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:24:01.990751266Z [2024-05-24 23:24:01,990: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:24:01.994563915Z [2024-05-24 23:24:01,994: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:24:02.014439595Z [2024-05-24 23:24:02,014: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:24:02.015741548Z [2024-05-24 23:24:02,015: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:24:02.015763429Z [2024-05-24 23:24:02,015: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:24:02.015791720Z [2024-05-24 23:24:02,015: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:24:02.015847062Z [2024-05-24 23:24:02,015: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:24:02.016118353Z [2024-05-24 23:24:02,015: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:24:02.016144611Z [2024-05-24 23:24:02,016: INFO/ForkPoolWorker-2] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:24:02.035916050Z [2024-05-24 23:24:02,035: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:24:02.042638131Z [2024-05-24 23:24:02,042: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:24:02.042927481Z [2024-05-24 23:24:02,042: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:24:02.043256467Z [2024-05-24 23:24:02,043: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:24:02.043491809Z [2024-05-24 23:24:02,043: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:24:02.044044829Z [2024-05-24 23:24:02,043: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:24:02.044327993Z [2024-05-24 23:24:02,044: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:24:02.088421744Z [2024-05-24 23:24:02,088: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:24:02.124512802Z [2024-05-24 23:24:02,124: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:24:03.752808623Z [2024-05-24 23:24:03,751: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3010b5ab-278d-46ac-8884-f21a259281fc] succeeded in 3.492334610999933s: None 2024-05-24T23:24:04.162916325Z [2024-05-24 23:24:04,162: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bbe9ee8b-a6cb-4d0c-8413-cc35d12d0634] succeeded in 3.9081393659998866s: None 2024-05-24T23:25:01.224978025Z [2024-05-24 23:25:01,224: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3da55b4-f029-4bd4-93cb-99ff2c4b4a04] received 2024-05-24T23:25:01.231969392Z [2024-05-24 23:25:01,231: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a2701bf-6b38-4dbc-a924-9632316aa7c6] received 2024-05-24T23:25:01.237788400Z [2024-05-24 23:25:01,237: INFO/ForkPoolWorker-15] [e3da55b4-f029-4bd4-93cb-99ff2c4b4a04] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:25:01.241060196Z [2024-05-24 23:25:01,240: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59dbdcd6-ba37-4d38-adb4-418a16dcacc5] received 2024-05-24T23:25:01.250013772Z [2024-05-24 23:25:01,249: INFO/ForkPoolWorker-16] [4a2701bf-6b38-4dbc-a924-9632316aa7c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:25:01.255508078Z [2024-05-24 23:25:01,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[870f790a-a2f6-4c59-b837-033309d19685] received 2024-05-24T23:25:01.261499102Z [2024-05-24 23:25:01,261: INFO/ForkPoolWorker-1] [59dbdcd6-ba37-4d38-adb4-418a16dcacc5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:25:01.264669177Z [2024-05-24 23:25:01,264: INFO/ForkPoolWorker-2] [870f790a-a2f6-4c59-b837-033309d19685] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:25:01.604280840Z [2024-05-24 23:25:01,600: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:25:01.615383231Z [2024-05-24 23:25:01,611: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:25:01.619475576Z [2024-05-24 23:25:01,615: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:25:01.620652219Z [2024-05-24 23:25:01,616: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:25:01.761290384Z [2024-05-24 23:25:01,760: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-24T23:25:01.765447338Z [2024-05-24 23:25:01,764: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:25:01.800470824Z [2024-05-24 23:25:01,800: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:25:01.803840863Z [2024-05-24 23:25:01,803: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:25:01.804131912Z [2024-05-24 23:25:01,803: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:25:01.804346630Z [2024-05-24 23:25:01,804: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-24T23:25:01.804692971Z [2024-05-24 23:25:01,804: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:25:01.908029781Z [2024-05-24 23:25:01,907: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:25:02.612340051Z [2024-05-24 23:25:02,611: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[870f790a-a2f6-4c59-b837-033309d19685] succeeded in 1.3539060550001523s: None 2024-05-24T23:25:02.909861655Z [2024-05-24 23:25:02,909: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:25:02.914891522Z [2024-05-24 23:25:02,914: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:25:02.958710575Z [2024-05-24 23:25:02,958: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:25:02.962289810Z [2024-05-24 23:25:02,961: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:25:02.962470800Z [2024-05-24 23:25:02,962: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:25:02.962678517Z [2024-05-24 23:25:02,962: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:25:02.962818489Z [2024-05-24 23:25:02,962: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:25:02.963472887Z [2024-05-24 23:25:02,963: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:25:02.963583066Z [2024-05-24 23:25:02,963: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:25:03.039209473Z [2024-05-24 23:25:03,038: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:25:03.115911974Z [2024-05-24 23:25:03,115: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:25:03.119647257Z [2024-05-24 23:25:03,119: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:25:03.129413018Z [2024-05-24 23:25:03,129: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:25:03.133129286Z [2024-05-24 23:25:03,132: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:25:03.143429474Z [2024-05-24 23:25:03,143: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:25:03.144751942Z [2024-05-24 23:25:03,144: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:25:03.144765531Z [2024-05-24 23:25:03,144: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:25:03.144893203Z [2024-05-24 23:25:03,144: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:25:03.144903189Z [2024-05-24 23:25:03,144: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:25:03.145128772Z [2024-05-24 23:25:03,145: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:25:03.145163815Z [2024-05-24 23:25:03,145: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:25:03.163651924Z [2024-05-24 23:25:03,163: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:25:03.164975706Z [2024-05-24 23:25:03,164: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:25:03.165062650Z [2024-05-24 23:25:03,164: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:25:03.165310704Z [2024-05-24 23:25:03,165: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:25:03.165496961Z [2024-05-24 23:25:03,165: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:25:03.167187326Z [2024-05-24 23:25:03,167: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:25:03.167296946Z [2024-05-24 23:25:03,167: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:25:03.230017276Z [2024-05-24 23:25:03,229: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:25:03.259025090Z [2024-05-24 23:25:03,258: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:25:03.901330110Z [2024-05-24 23:25:03,896: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[59dbdcd6-ba37-4d38-adb4-418a16dcacc5] succeeded in 2.6507041200002277s: None 2024-05-24T23:25:04.145652074Z [2024-05-24 23:25:04,145: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e311c999-6883-4fff-9cbf-73b7ffe4540c] received 2024-05-24T23:25:04.155547473Z [2024-05-24 23:25:04,155: INFO/ForkPoolWorker-1] [e311c999-6883-4fff-9cbf-73b7ffe4540c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:25:04.494861830Z [2024-05-24 23:25:04,491: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:25:04.685513716Z [2024-05-24 23:25:04,685: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e3da55b4-f029-4bd4-93cb-99ff2c4b4a04] succeeded in 3.4578769380000267s: None 2024-05-24T23:25:04.995577613Z [2024-05-24 23:25:04,995: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4a2701bf-6b38-4dbc-a924-9632316aa7c6] succeeded in 3.7607880069999737s: None 2024-05-24T23:25:05.675563332Z [2024-05-24 23:25:05,675: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:25:05.679112084Z [2024-05-24 23:25:05,678: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:25:05.697863917Z [2024-05-24 23:25:05,697: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:25:05.699247285Z [2024-05-24 23:25:05,699: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:25:05.699272036Z [2024-05-24 23:25:05,699: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:25:05.699496997Z [2024-05-24 23:25:05,699: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:25:05.699567034Z [2024-05-24 23:25:05,699: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:25:05.699877150Z [2024-05-24 23:25:05,699: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:25:05.699889411Z [2024-05-24 23:25:05,699: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:25:05.800380846Z [2024-05-24 23:25:05,800: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:25:06.440629890Z [2024-05-24 23:25:06,440: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e311c999-6883-4fff-9cbf-73b7ffe4540c] succeeded in 2.292269810000107s: None 2024-05-24T23:25:06.775173161Z [2024-05-24 23:25:06,774: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4180bbdb-b01f-448e-be57-ac040aa3ab77] received 2024-05-24T23:25:06.790804884Z [2024-05-24 23:25:06,789: INFO/ForkPoolWorker-15] [4180bbdb-b01f-448e-be57-ac040aa3ab77] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:25:07.089605489Z [2024-05-24 23:25:07,086: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:25:08.239777760Z [2024-05-24 23:25:08,239: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:25:08.243125281Z [2024-05-24 23:25:08,242: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:25:08.262167541Z [2024-05-24 23:25:08,261: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:25:08.263270190Z [2024-05-24 23:25:08,263: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:25:08.263284420Z [2024-05-24 23:25:08,263: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:25:08.263381457Z [2024-05-24 23:25:08,263: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:25:08.263393540Z [2024-05-24 23:25:08,263: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:25:08.263705660Z [2024-05-24 23:25:08,263: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:25:08.263721958Z [2024-05-24 23:25:08,263: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:25:08.346837281Z [2024-05-24 23:25:08,346: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:25:08.962775656Z [2024-05-24 23:25:08,962: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4180bbdb-b01f-448e-be57-ac040aa3ab77] succeeded in 2.1853603279996605s: None 2024-05-24T23:25:09.128817020Z [2024-05-24 23:25:09,128: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d52c604-04db-4024-b1ff-1cecccc8c31b] received 2024-05-24T23:25:09.138943445Z [2024-05-24 23:25:09,138: INFO/ForkPoolWorker-15] [7d52c604-04db-4024-b1ff-1cecccc8c31b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:25:09.484017646Z [2024-05-24 23:25:09,479: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:25:10.691120257Z [2024-05-24 23:25:10,690: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:25:10.695819521Z [2024-05-24 23:25:10,695: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:25:10.720696638Z [2024-05-24 23:25:10,720: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:25:10.722873992Z [2024-05-24 23:25:10,722: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:25:10.722887496Z [2024-05-24 23:25:10,722: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:25:10.723030965Z [2024-05-24 23:25:10,722: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:25:10.723107833Z [2024-05-24 23:25:10,722: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:25:10.723349523Z [2024-05-24 23:25:10,723: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:25:10.723387203Z [2024-05-24 23:25:10,723: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:25:10.815090579Z [2024-05-24 23:25:10,814: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:25:11.481490331Z [2024-05-24 23:25:11,480: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7d52c604-04db-4024-b1ff-1cecccc8c31b] succeeded in 2.3488234650003506s: None 2024-05-24T23:26:00.297368661Z [2024-05-24 23:26:00,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[825f09df-c245-4624-924a-abf2e4c4d814] received 2024-05-24T23:26:00.298935139Z [2024-05-24 23:26:00,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46d559e7-7eca-48fc-bc3b-9482a66b19e6] received 2024-05-24T23:26:00.307360104Z [2024-05-24 23:26:00,306: INFO/ForkPoolWorker-15] [825f09df-c245-4624-924a-abf2e4c4d814] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:26:00.311648076Z [2024-05-24 23:26:00,311: INFO/ForkPoolWorker-16] [46d559e7-7eca-48fc-bc3b-9482a66b19e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:26:00.321764427Z [2024-05-24 23:26:00,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b2bf7ac-838c-4e89-8a45-4186916401ec] received 2024-05-24T23:26:00.332134759Z [2024-05-24 23:26:00,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bad0b08a-a178-41d7-9eed-972733d6efb4] received 2024-05-24T23:26:00.334208434Z [2024-05-24 23:26:00,333: INFO/ForkPoolWorker-1] [2b2bf7ac-838c-4e89-8a45-4186916401ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:26:00.345496972Z [2024-05-24 23:26:00,345: INFO/ForkPoolWorker-2] [bad0b08a-a178-41d7-9eed-972733d6efb4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:26:00.641143309Z [2024-05-24 23:26:00,636: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:26:00.705040958Z [2024-05-24 23:26:00,702: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:26:00.857875098Z [2024-05-24 23:26:00,846: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:26:00.865294365Z [2024-05-24 23:26:00,862: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:26:00.901530458Z [2024-05-24 23:26:00,901: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:26:01.130105851Z [2024-05-24 23:26:01,129: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-24T23:26:01.140988154Z [2024-05-24 23:26:01,140: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:26:01.195022912Z [2024-05-24 23:26:01,194: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:26:01.198079072Z [2024-05-24 23:26:01,197: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:26:01.198148542Z [2024-05-24 23:26:01,197: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:26:01.198156259Z [2024-05-24 23:26:01,198: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-24T23:26:01.198340082Z [2024-05-24 23:26:01,198: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:26:01.425064472Z [2024-05-24 23:26:01,424: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:26:01.572573079Z [2024-05-24 23:26:01,571: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2b2bf7ac-838c-4e89-8a45-4186916401ec] succeeded in 1.2486723689999053s: None 2024-05-24T23:26:02.008721529Z [2024-05-24 23:26:02,008: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[46d559e7-7eca-48fc-bc3b-9482a66b19e6] succeeded in 1.708162951000304s: None 2024-05-24T23:26:02.113184878Z [2024-05-24 23:26:02,112: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:26:02.116475322Z [2024-05-24 23:26:02,116: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:26:02.134384477Z [2024-05-24 23:26:02,134: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:26:02.136276580Z [2024-05-24 23:26:02,136: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:26:02.136383373Z [2024-05-24 23:26:02,136: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:26:02.136648692Z [2024-05-24 23:26:02,136: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:26:02.136806936Z [2024-05-24 23:26:02,136: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:26:02.137092047Z [2024-05-24 23:26:02,136: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:26:02.137263142Z [2024-05-24 23:26:02,137: INFO/ForkPoolWorker-2] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:26:02.240745122Z [2024-05-24 23:26:02,240: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:26:02.308794865Z [2024-05-24 23:26:02,308: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:26:02.312302521Z [2024-05-24 23:26:02,311: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:26:02.331545742Z [2024-05-24 23:26:02,331: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:26:02.333570695Z [2024-05-24 23:26:02,333: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:26:02.333586576Z [2024-05-24 23:26:02,333: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:26:02.333614119Z [2024-05-24 23:26:02,333: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:26:02.333706771Z [2024-05-24 23:26:02,333: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:26:02.333949587Z [2024-05-24 23:26:02,333: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:26:02.334037936Z [2024-05-24 23:26:02,333: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:26:02.421661949Z [2024-05-24 23:26:02,420: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:26:03.984734734Z [2024-05-24 23:26:03,984: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bad0b08a-a178-41d7-9eed-972733d6efb4] succeeded in 3.6506544180001583s: None 2024-05-24T23:26:04.926138226Z [2024-05-24 23:26:04,925: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[825f09df-c245-4624-924a-abf2e4c4d814] succeeded in 4.625230890000239s: None 2024-05-24T23:27:01.275977503Z [2024-05-24 23:27:01,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6c11100-f890-4ad1-9238-72498e13c5e7] received 2024-05-24T23:27:01.285427113Z [2024-05-24 23:27:01,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d88f838f-ee6e-43ae-999f-2964af6b87ac] received 2024-05-24T23:27:01.291371656Z [2024-05-24 23:27:01,290: INFO/ForkPoolWorker-15] [b6c11100-f890-4ad1-9238-72498e13c5e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:27:01.295088048Z [2024-05-24 23:27:01,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7cbd3b5b-c1bb-4be4-9dfd-8e0c1138785d] received 2024-05-24T23:27:01.303166300Z [2024-05-24 23:27:01,302: INFO/ForkPoolWorker-16] [d88f838f-ee6e-43ae-999f-2964af6b87ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:27:01.314281020Z [2024-05-24 23:27:01,313: INFO/ForkPoolWorker-1] [7cbd3b5b-c1bb-4be4-9dfd-8e0c1138785d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:27:01.672977710Z [2024-05-24 23:27:01,669: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:27:01.709164049Z [2024-05-24 23:27:01,705: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:27:01.789240067Z [2024-05-24 23:27:01,785: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:27:01.846923438Z [2024-05-24 23:27:01,846: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-24T23:27:01.851782330Z [2024-05-24 23:27:01,851: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:27:01.899618724Z [2024-05-24 23:27:01,899: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:27:01.906086982Z [2024-05-24 23:27:01,905: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:27:01.906110319Z [2024-05-24 23:27:01,905: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:27:01.906161163Z [2024-05-24 23:27:01,906: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-24T23:27:01.906357111Z [2024-05-24 23:27:01,906: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:27:02.013817856Z [2024-05-24 23:27:02,013: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:27:02.705684571Z [2024-05-24 23:27:02,705: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d88f838f-ee6e-43ae-999f-2964af6b87ac] succeeded in 1.4164703150004243s: None 2024-05-24T23:27:03.086718150Z [2024-05-24 23:27:03,086: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:27:03.090103100Z [2024-05-24 23:27:03,089: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:27:03.113551847Z [2024-05-24 23:27:03,113: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:27:03.116137635Z [2024-05-24 23:27:03,115: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:27:03.116167064Z [2024-05-24 23:27:03,116: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:27:03.116334507Z [2024-05-24 23:27:03,116: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:27:03.116357292Z [2024-05-24 23:27:03,116: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:27:03.116744188Z [2024-05-24 23:27:03,116: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:27:03.116762504Z [2024-05-24 23:27:03,116: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:27:03.145157299Z [2024-05-24 23:27:03,144: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:27:03.148701601Z [2024-05-24 23:27:03,148: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:27:03.171093639Z [2024-05-24 23:27:03,170: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:27:03.172733197Z [2024-05-24 23:27:03,172: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:27:03.172822595Z [2024-05-24 23:27:03,172: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:27:03.173091449Z [2024-05-24 23:27:03,172: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:27:03.173733204Z [2024-05-24 23:27:03,173: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:27:03.174193866Z [2024-05-24 23:27:03,174: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:27:03.174398643Z [2024-05-24 23:27:03,174: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:27:03.219319995Z [2024-05-24 23:27:03,219: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:27:03.254239610Z [2024-05-24 23:27:03,253: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:27:05.018883661Z [2024-05-24 23:27:05,018: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7cbd3b5b-c1bb-4be4-9dfd-8e0c1138785d] succeeded in 3.72139430299967s: None 2024-05-24T23:27:05.949032972Z [2024-05-24 23:27:05,948: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b6c11100-f890-4ad1-9238-72498e13c5e7] succeeded in 4.670455470999968s: None 2024-05-24T23:28:01.312490804Z [2024-05-24 23:28:01,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[047f1864-83d6-4e06-8a43-3cd8901f8d10] received 2024-05-24T23:28:01.318420898Z [2024-05-24 23:28:01,316: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e016cc5-fbcf-469c-9108-52d37f0bdbd7] received 2024-05-24T23:28:01.331317652Z [2024-05-24 23:28:01,329: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1dafc2b6-a988-4b15-a69f-b5ca0d41acbb] received 2024-05-24T23:28:01.335077930Z [2024-05-24 23:28:01,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c97f787-9152-44d4-aff2-e383ebb936b5] received 2024-05-24T23:28:01.335103455Z [2024-05-24 23:28:01,334: INFO/ForkPoolWorker-16] [1e016cc5-fbcf-469c-9108-52d37f0bdbd7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:28:01.355811431Z [2024-05-24 23:28:01,355: INFO/ForkPoolWorker-2] [3c97f787-9152-44d4-aff2-e383ebb936b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:28:01.356672479Z [2024-05-24 23:28:01,356: INFO/ForkPoolWorker-15] [047f1864-83d6-4e06-8a43-3cd8901f8d10] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:28:01.372508549Z [2024-05-24 23:28:01,358: INFO/ForkPoolWorker-1] [1dafc2b6-a988-4b15-a69f-b5ca0d41acbb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:28:01.805622164Z [2024-05-24 23:28:01,801: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:28:01.839218704Z [2024-05-24 23:28:01,835: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:28:01.883438317Z [2024-05-24 23:28:01,880: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:28:01.912444451Z [2024-05-24 23:28:01,907: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:28:02.080922047Z [2024-05-24 23:28:02,080: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:28:02.099410678Z [2024-05-24 23:28:02,098: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-24T23:28:02.106208920Z [2024-05-24 23:28:02,105: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:28:02.141015149Z [2024-05-24 23:28:02,140: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:28:02.142907884Z [2024-05-24 23:28:02,142: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:28:02.143149832Z [2024-05-24 23:28:02,142: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:28:02.143315227Z [2024-05-24 23:28:02,143: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-24T23:28:02.143972970Z [2024-05-24 23:28:02,143: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:28:02.358889151Z [2024-05-24 23:28:02,358: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:28:02.795627788Z [2024-05-24 23:28:02,795: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[047f1864-83d6-4e06-8a43-3cd8901f8d10] succeeded in 1.472424544000205s: None 2024-05-24T23:28:03.085451676Z [2024-05-24 23:28:03,084: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1dafc2b6-a988-4b15-a69f-b5ca0d41acbb] succeeded in 1.7498515359998237s: None 2024-05-24T23:28:03.318586383Z [2024-05-24 23:28:03,317: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:28:03.321611639Z [2024-05-24 23:28:03,321: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:28:03.348416812Z [2024-05-24 23:28:03,348: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:28:03.349830952Z [2024-05-24 23:28:03,349: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:28:03.349848921Z [2024-05-24 23:28:03,349: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:28:03.349966885Z [2024-05-24 23:28:03,349: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:28:03.350018247Z [2024-05-24 23:28:03,349: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:28:03.350254197Z [2024-05-24 23:28:03,350: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:28:03.350430430Z [2024-05-24 23:28:03,350: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:28:03.435709627Z [2024-05-24 23:28:03,435: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:28:03.438438421Z [2024-05-24 23:28:03,438: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:28:03.441750751Z [2024-05-24 23:28:03,441: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:28:03.473738101Z [2024-05-24 23:28:03,473: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:28:03.475747531Z [2024-05-24 23:28:03,475: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:28:03.475917543Z [2024-05-24 23:28:03,475: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:28:03.476184924Z [2024-05-24 23:28:03,475: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:28:03.476368681Z [2024-05-24 23:28:03,476: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:28:03.476756545Z [2024-05-24 23:28:03,476: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:28:03.477395877Z [2024-05-24 23:28:03,477: INFO/ForkPoolWorker-2] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:28:03.576756084Z [2024-05-24 23:28:03,576: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:28:05.445781678Z [2024-05-24 23:28:05,445: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3c97f787-9152-44d4-aff2-e383ebb936b5] succeeded in 4.108166258999972s: None 2024-05-24T23:28:05.550911301Z [2024-05-24 23:28:05,550: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1e016cc5-fbcf-469c-9108-52d37f0bdbd7] succeeded in 4.228882528999748s: None 2024-05-24T23:29:01.046686191Z [2024-05-24 23:29:01,046: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5cae7f02-d54a-4e40-a2c4-be9a953c72ca] received 2024-05-24T23:29:01.050336136Z [2024-05-24 23:29:01,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c82557df-2e5d-4230-8675-709ebac30d2a] received 2024-05-24T23:29:01.051919375Z [2024-05-24 23:29:01,051: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edff1512-9242-469f-ae7f-384a281c0afd] received 2024-05-24T23:29:01.061654581Z [2024-05-24 23:29:01,061: INFO/ForkPoolWorker-1] [edff1512-9242-469f-ae7f-384a281c0afd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:29:01.066284981Z [2024-05-24 23:29:01,065: INFO/ForkPoolWorker-16] [c82557df-2e5d-4230-8675-709ebac30d2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:29:01.074983239Z [2024-05-24 23:29:01,074: INFO/ForkPoolWorker-15] [5cae7f02-d54a-4e40-a2c4-be9a953c72ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:29:01.369451804Z [2024-05-24 23:29:01,365: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:29:01.372438563Z [2024-05-24 23:29:01,368: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:29:01.417460647Z [2024-05-24 23:29:01,406: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:29:01.545817679Z [2024-05-24 23:29:01,545: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-24T23:29:01.554853669Z [2024-05-24 23:29:01,554: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:29:01.581729230Z [2024-05-24 23:29:01,581: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:29:01.582838758Z [2024-05-24 23:29:01,582: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:29:01.583052998Z [2024-05-24 23:29:01,582: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:29:01.583180470Z [2024-05-24 23:29:01,583: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-24T23:29:01.583614383Z [2024-05-24 23:29:01,583: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:29:01.682810544Z [2024-05-24 23:29:01,682: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:29:02.465141271Z [2024-05-24 23:29:02,464: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5cae7f02-d54a-4e40-a2c4-be9a953c72ca] succeeded in 1.4145118980000007s: None 2024-05-24T23:29:02.596339535Z [2024-05-24 23:29:02,595: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:29:02.599539269Z [2024-05-24 23:29:02,599: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:29:02.633732186Z [2024-05-24 23:29:02,633: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:29:02.636102094Z [2024-05-24 23:29:02,635: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:29:02.636164126Z [2024-05-24 23:29:02,636: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:29:02.636327597Z [2024-05-24 23:29:02,636: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:29:02.636395355Z [2024-05-24 23:29:02,636: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:29:02.636638063Z [2024-05-24 23:29:02,636: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:29:02.636670330Z [2024-05-24 23:29:02,636: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:29:02.758928457Z [2024-05-24 23:29:02,758: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:29:02.890627494Z [2024-05-24 23:29:02,890: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:29:02.893855691Z [2024-05-24 23:29:02,893: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:29:02.912166901Z [2024-05-24 23:29:02,911: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:29:02.913358314Z [2024-05-24 23:29:02,913: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:29:02.913381133Z [2024-05-24 23:29:02,913: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:29:02.913517612Z [2024-05-24 23:29:02,913: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:29:02.913532026Z [2024-05-24 23:29:02,913: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:29:02.913752492Z [2024-05-24 23:29:02,913: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:29:02.913765272Z [2024-05-24 23:29:02,913: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:29:03.005877467Z [2024-05-24 23:29:03,005: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:29:04.524055641Z [2024-05-24 23:29:04,523: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c82557df-2e5d-4230-8675-709ebac30d2a] succeeded in 3.469846680000046s: None 2024-05-24T23:29:04.685263433Z [2024-05-24 23:29:04,684: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[edff1512-9242-469f-ae7f-384a281c0afd] succeeded in 3.6311701459999313s: None 2024-05-24T23:30:01.662938474Z [2024-05-24 23:30:01,662: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a933e60-b3b4-421d-bc16-fe0755a8736a] received 2024-05-24T23:30:01.666040308Z [2024-05-24 23:30:01,665: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d14f8bb2-2c46-4291-861c-673872904867] received 2024-05-24T23:30:01.682438972Z [2024-05-24 23:30:01,682: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd3c7c86-5489-49f2-82e5-f9cad3013239] received 2024-05-24T23:30:01.709287660Z [2024-05-24 23:30:01,706: INFO/ForkPoolWorker-15] [1a933e60-b3b4-421d-bc16-fe0755a8736a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:30:01.711380080Z [2024-05-24 23:30:01,711: INFO/ForkPoolWorker-16] [d14f8bb2-2c46-4291-861c-673872904867] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:30:01.714852804Z [2024-05-24 23:30:01,714: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7c38316-7809-49a6-97fc-ff9bc72e0125] received 2024-05-24T23:30:01.717357861Z [2024-05-24 23:30:01,717: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43901d0f-38ad-48af-8212-3929f70529b8] received 2024-05-24T23:30:01.722292751Z [2024-05-24 23:30:01,721: INFO/ForkPoolWorker-1] [cd3c7c86-5489-49f2-82e5-f9cad3013239] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:30:01.763087893Z [2024-05-24 23:30:01,762: INFO/ForkPoolWorker-2] [f7c38316-7809-49a6-97fc-ff9bc72e0125] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:30:01.838369217Z [2024-05-24 23:30:01,837: INFO/ForkPoolWorker-3] [43901d0f-38ad-48af-8212-3929f70529b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:30:02.569379715Z [2024-05-24 23:30:02,566: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:30:03.440234155Z [2024-05-24 23:30:03,439: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-24T23:30:03.444928975Z [2024-05-24 23:30:03,444: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:30:03.489873862Z [2024-05-24 23:30:03,489: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:30:03.491164607Z [2024-05-24 23:30:03,490: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:30:03.491365587Z [2024-05-24 23:30:03,491: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:30:03.491629919Z [2024-05-24 23:30:03,491: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-24T23:30:03.491888905Z [2024-05-24 23:30:03,491: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:30:03.518461788Z [2024-05-24 23:30:03,514: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:30:03.600149943Z [2024-05-24 23:30:03,599: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:30:03.618409310Z [2024-05-24 23:30:03,612: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:30:03.658858732Z [2024-05-24 23:30:03,655: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:30:04.272150558Z [2024-05-24 23:30:04,267: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:30:04.964913846Z [2024-05-24 23:30:04,964: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:30:05.603789743Z [2024-05-24 23:30:05,603: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d14f8bb2-2c46-4291-861c-673872904867] succeeded in 3.9346088550000786s: None 2024-05-24T23:30:06.501291639Z [2024-05-24 23:30:06,488: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f7c38316-7809-49a6-97fc-ff9bc72e0125] succeeded in 4.73801748599999s: None 2024-05-24T23:30:08.601232275Z [2024-05-24 23:30:08,600: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:30:08.606238500Z [2024-05-24 23:30:08,605: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:30:08.826463602Z [2024-05-24 23:30:08,826: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:30:08.828963335Z [2024-05-24 23:30:08,828: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:30:08.829231668Z [2024-05-24 23:30:08,828: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:30:08.835538194Z [2024-05-24 23:30:08,829: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:30:08.835553040Z [2024-05-24 23:30:08,829: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:30:08.835557638Z [2024-05-24 23:30:08,829: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:30:08.835561350Z [2024-05-24 23:30:08,829: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:30:09.064802511Z [2024-05-24 23:30:09,064: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:30:09.483825750Z [2024-05-24 23:30:09,483: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:30:09.497892457Z [2024-05-24 23:30:09,487: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:30:09.554325785Z [2024-05-24 23:30:09,554: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:30:09.556080000Z [2024-05-24 23:30:09,555: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:30:09.556345609Z [2024-05-24 23:30:09,556: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:30:09.556664194Z [2024-05-24 23:30:09,556: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:30:09.556840196Z [2024-05-24 23:30:09,556: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:30:09.557159659Z [2024-05-24 23:30:09,557: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:30:09.557336649Z [2024-05-24 23:30:09,557: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:30:09.667497595Z [2024-05-24 23:30:09,666: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-24T23:30:09.681329530Z [2024-05-24 23:30:09,680: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:30:09.703456446Z [2024-05-24 23:30:09,703: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:30:09.715170149Z [2024-05-24 23:30:09,714: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-24T23:30:09.716560032Z [2024-05-24 23:30:09,716: INFO/ForkPoolWorker-3] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:30:09.716715702Z [2024-05-24 23:30:09,716: INFO/ForkPoolWorker-3] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:30:09.716890434Z [2024-05-24 23:30:09,716: INFO/ForkPoolWorker-3] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:30:09.717419328Z [2024-05-24 23:30:09,716: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-24T23:30:09.717708447Z [2024-05-24 23:30:09,717: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:30:09.717942389Z [2024-05-24 23:30:09,717: INFO/ForkPoolWorker-3] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:30:09.801752601Z [2024-05-24 23:30:09,801: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:30:09.878710778Z [2024-05-24 23:30:09,876: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cd3c7c86-5489-49f2-82e5-f9cad3013239] succeeded in 8.19167173599999s: None 2024-05-24T23:30:10.633191479Z [2024-05-24 23:30:10,632: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b14ac73-74ff-43b7-bff7-fa415dead1b5] received 2024-05-24T23:30:10.648409126Z [2024-05-24 23:30:10,647: INFO/ForkPoolWorker-16] [2b14ac73-74ff-43b7-bff7-fa415dead1b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:30:10.939325237Z [2024-05-24 23:30:10,932: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:30:11.762801348Z [2024-05-24 23:30:11,762: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1a933e60-b3b4-421d-bc16-fe0755a8736a] succeeded in 10.096620681000331s: None 2024-05-24T23:30:12.801616831Z [2024-05-24 23:30:12,801: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[43901d0f-38ad-48af-8212-3929f70529b8] succeeded in 11.036683353999706s: None 2024-05-24T23:30:13.036347625Z [2024-05-24 23:30:13,035: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:30:13.040914414Z [2024-05-24 23:30:13,040: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:30:13.098749799Z [2024-05-24 23:30:13,098: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:30:13.102544490Z [2024-05-24 23:30:13,102: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:30:13.102573428Z [2024-05-24 23:30:13,102: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:30:13.122080155Z [2024-05-24 23:30:13,102: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:30:13.125109025Z [2024-05-24 23:30:13,122: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:30:13.125787317Z [2024-05-24 23:30:13,125: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:30:13.126231471Z [2024-05-24 23:30:13,125: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:30:13.327466540Z [2024-05-24 23:30:13,322: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:30:14.362650020Z [2024-05-24 23:30:14,362: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d54205c-8a4a-4dd5-b35e-5d92c39cec3b] received 2024-05-24T23:30:14.377554131Z [2024-05-24 23:30:14,375: INFO/ForkPoolWorker-15] [5d54205c-8a4a-4dd5-b35e-5d92c39cec3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:30:14.414914060Z [2024-05-24 23:30:14,412: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2b14ac73-74ff-43b7-bff7-fa415dead1b5] succeeded in 3.7775903530000505s: None 2024-05-24T23:30:14.955125718Z [2024-05-24 23:30:14,951: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:30:17.070254763Z [2024-05-24 23:30:17,069: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:30:17.073839752Z [2024-05-24 23:30:17,073: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:30:17.142843631Z [2024-05-24 23:30:17,142: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:30:17.151188719Z [2024-05-24 23:30:17,150: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:30:17.151247897Z [2024-05-24 23:30:17,151: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:30:17.151294976Z [2024-05-24 23:30:17,151: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:30:17.151342467Z [2024-05-24 23:30:17,151: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:30:17.151616531Z [2024-05-24 23:30:17,151: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:30:17.151692432Z [2024-05-24 23:30:17,151: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:30:17.356115009Z [2024-05-24 23:30:17,355: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:30:17.949914615Z [2024-05-24 23:30:17,949: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5d54205c-8a4a-4dd5-b35e-5d92c39cec3b] succeeded in 3.584582264000346s: None 2024-05-24T23:30:18.206623786Z [2024-05-24 23:30:18,205: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aeb755a2-61d5-44b7-b939-79b8caf41b63] received 2024-05-24T23:30:18.212770832Z [2024-05-24 23:30:18,212: INFO/ForkPoolWorker-15] [aeb755a2-61d5-44b7-b939-79b8caf41b63] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:30:18.581262164Z [2024-05-24 23:30:18,577: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:30:19.893699882Z [2024-05-24 23:30:19,893: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:30:19.897523356Z [2024-05-24 23:30:19,897: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:30:19.932679571Z [2024-05-24 23:30:19,932: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:30:19.934660410Z [2024-05-24 23:30:19,934: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:30:19.934928875Z [2024-05-24 23:30:19,934: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:30:19.935311828Z [2024-05-24 23:30:19,935: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:30:19.935518849Z [2024-05-24 23:30:19,935: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:30:19.936328470Z [2024-05-24 23:30:19,936: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:30:19.936478529Z [2024-05-24 23:30:19,936: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:30:20.015940810Z [2024-05-24 23:30:20,015: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:30:20.646836995Z [2024-05-24 23:30:20,646: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aeb755a2-61d5-44b7-b939-79b8caf41b63] succeeded in 2.4388824970001224s: None 2024-05-24T23:31:00.913349130Z [2024-05-24 23:31:00,912: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6dab3721-62ac-47ab-bc5d-0302de55a308] received 2024-05-24T23:31:00.917578501Z [2024-05-24 23:31:00,917: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a058a274-3391-429f-9b55-f6468e369e0e] received 2024-05-24T23:31:00.932136561Z [2024-05-24 23:31:00,931: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0830608a-019b-4df7-a9d0-1893eefafc34] received 2024-05-24T23:31:00.936636786Z [2024-05-24 23:31:00,936: INFO/ForkPoolWorker-15] [6dab3721-62ac-47ab-bc5d-0302de55a308] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:31:00.939996655Z [2024-05-24 23:31:00,939: INFO/ForkPoolWorker-1] [0830608a-019b-4df7-a9d0-1893eefafc34] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:31:00.940614215Z [2024-05-24 23:31:00,940: INFO/ForkPoolWorker-16] [a058a274-3391-429f-9b55-f6468e369e0e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:31:01.240125025Z [2024-05-24 23:31:01,236: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:31:01.266316607Z [2024-05-24 23:31:01,263: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:31:01.280047903Z [2024-05-24 23:31:01,276: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:31:01.411530893Z [2024-05-24 23:31:01,411: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-24T23:31:01.415918127Z [2024-05-24 23:31:01,415: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:31:01.440182076Z [2024-05-24 23:31:01,439: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:31:01.441353071Z [2024-05-24 23:31:01,441: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:31:01.441438364Z [2024-05-24 23:31:01,441: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:31:01.441498032Z [2024-05-24 23:31:01,441: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-24T23:31:01.441791834Z [2024-05-24 23:31:01,441: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:31:01.574440757Z [2024-05-24 23:31:01,574: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:31:02.193544507Z [2024-05-24 23:31:02,191: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0830608a-019b-4df7-a9d0-1893eefafc34] succeeded in 1.2575481929998205s: None 2024-05-24T23:31:02.575281851Z [2024-05-24 23:31:02,574: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:31:02.579441481Z [2024-05-24 23:31:02,578: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:31:02.603047895Z [2024-05-24 23:31:02,602: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:31:02.604507456Z [2024-05-24 23:31:02,604: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:31:02.604653853Z [2024-05-24 23:31:02,604: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:31:02.604839087Z [2024-05-24 23:31:02,604: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:31:02.604882137Z [2024-05-24 23:31:02,604: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:31:02.605615115Z [2024-05-24 23:31:02,605: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:31:02.605761760Z [2024-05-24 23:31:02,605: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:31:02.625813133Z [2024-05-24 23:31:02,625: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:31:02.629243344Z [2024-05-24 23:31:02,628: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:31:02.648153399Z [2024-05-24 23:31:02,647: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:31:02.650222552Z [2024-05-24 23:31:02,649: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:31:02.650242984Z [2024-05-24 23:31:02,650: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:31:02.650342523Z [2024-05-24 23:31:02,650: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:31:02.650374422Z [2024-05-24 23:31:02,650: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:31:02.650678837Z [2024-05-24 23:31:02,650: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:31:02.650775440Z [2024-05-24 23:31:02,650: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:31:02.722133206Z [2024-05-24 23:31:02,721: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:31:02.728081842Z [2024-05-24 23:31:02,727: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:31:04.260143133Z [2024-05-24 23:31:04,259: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a058a274-3391-429f-9b55-f6468e369e0e] succeeded in 3.3378392160002477s: None 2024-05-24T23:31:04.655769680Z [2024-05-24 23:31:04,655: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6dab3721-62ac-47ab-bc5d-0302de55a308] succeeded in 3.735035584000343s: None 2024-05-24T23:32:00.925457063Z [2024-05-24 23:32:00,924: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84fad15b-6f2a-4e41-8569-934961701c80] received 2024-05-24T23:32:00.929247859Z [2024-05-24 23:32:00,928: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1945bd9-378d-4e8f-8322-c19f8f0e8b87] received 2024-05-24T23:32:00.930657981Z [2024-05-24 23:32:00,930: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a8ba8bb-1d54-48a1-8714-b413d164a01f] received 2024-05-24T23:32:00.931825822Z [2024-05-24 23:32:00,931: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d17f8372-6851-46d8-889a-17e18a44c716] received 2024-05-24T23:32:00.945718947Z [2024-05-24 23:32:00,945: INFO/ForkPoolWorker-15] [84fad15b-6f2a-4e41-8569-934961701c80] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:32:00.961616175Z [2024-05-24 23:32:00,956: INFO/ForkPoolWorker-2] [d17f8372-6851-46d8-889a-17e18a44c716] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:32:00.963157357Z [2024-05-24 23:32:00,962: INFO/ForkPoolWorker-1] [4a8ba8bb-1d54-48a1-8714-b413d164a01f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:32:00.968389294Z [2024-05-24 23:32:00,967: INFO/ForkPoolWorker-16] [d1945bd9-378d-4e8f-8322-c19f8f0e8b87] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:32:01.316432068Z [2024-05-24 23:32:01,312: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:32:01.430447431Z [2024-05-24 23:32:01,421: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:32:01.608658887Z [2024-05-24 23:32:01,604: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:32:01.626474679Z [2024-05-24 23:32:01,619: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:32:01.797680054Z [2024-05-24 23:32:01,797: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-24T23:32:01.802369384Z [2024-05-24 23:32:01,801: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:32:01.867639299Z [2024-05-24 23:32:01,867: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:32:01.873405151Z [2024-05-24 23:32:01,873: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:32:01.873641679Z [2024-05-24 23:32:01,873: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:32:01.873800431Z [2024-05-24 23:32:01,873: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-24T23:32:01.874069049Z [2024-05-24 23:32:01,873: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:32:01.903751338Z [2024-05-24 23:32:01,903: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:32:01.960176692Z [2024-05-24 23:32:01,959: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:32:02.570926323Z [2024-05-24 23:32:02,570: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d1945bd9-378d-4e8f-8322-c19f8f0e8b87] succeeded in 1.6282069429998955s: None 2024-05-24T23:32:02.715530312Z [2024-05-24 23:32:02,715: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4a8ba8bb-1d54-48a1-8714-b413d164a01f] succeeded in 1.7809426199996778s: None 2024-05-24T23:32:02.758091411Z [2024-05-24 23:32:02,757: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:32:02.761779025Z [2024-05-24 23:32:02,761: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:32:02.780214256Z [2024-05-24 23:32:02,779: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:32:02.781525428Z [2024-05-24 23:32:02,781: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:32:02.781537032Z [2024-05-24 23:32:02,781: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:32:02.781778792Z [2024-05-24 23:32:02,781: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:32:02.781877177Z [2024-05-24 23:32:02,781: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:32:02.782177026Z [2024-05-24 23:32:02,782: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:32:02.782223583Z [2024-05-24 23:32:02,782: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:32:02.889232822Z [2024-05-24 23:32:02,888: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:32:03.172925373Z [2024-05-24 23:32:03,172: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:32:03.176499687Z [2024-05-24 23:32:03,176: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:32:03.193966261Z [2024-05-24 23:32:03,193: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:32:03.195168165Z [2024-05-24 23:32:03,194: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:32:03.195392311Z [2024-05-24 23:32:03,195: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:32:03.195598071Z [2024-05-24 23:32:03,195: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:32:03.195743169Z [2024-05-24 23:32:03,195: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:32:03.196030162Z [2024-05-24 23:32:03,195: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:32:03.196282197Z [2024-05-24 23:32:03,196: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:32:03.306129375Z [2024-05-24 23:32:03,305: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:32:04.785476913Z [2024-05-24 23:32:04,784: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[84fad15b-6f2a-4e41-8569-934961701c80] succeeded in 3.850015285000154s: None 2024-05-24T23:32:05.776121151Z [2024-05-24 23:32:05,775: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d17f8372-6851-46d8-889a-17e18a44c716] succeeded in 4.833808071000021s: None 2024-05-24T23:33:00.841104365Z [2024-05-24 23:33:00,840: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1723806a-ab17-4a23-9a7d-afe48a375c01] received 2024-05-24T23:33:00.844824481Z [2024-05-24 23:33:00,844: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[375c8325-32bb-4622-89f4-e7835a94f347] received 2024-05-24T23:33:00.850569565Z [2024-05-24 23:33:00,850: INFO/ForkPoolWorker-15] [1723806a-ab17-4a23-9a7d-afe48a375c01] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:33:00.856482662Z [2024-05-24 23:33:00,856: INFO/ForkPoolWorker-16] [375c8325-32bb-4622-89f4-e7835a94f347] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:33:00.860855228Z [2024-05-24 23:33:00,860: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3824bc2-e098-42c0-b0bb-ac5e721218f3] received 2024-05-24T23:33:00.879047045Z [2024-05-24 23:33:00,878: INFO/ForkPoolWorker-1] [e3824bc2-e098-42c0-b0bb-ac5e721218f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:33:01.182897410Z [2024-05-24 23:33:01,179: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:33:01.247304186Z [2024-05-24 23:33:01,240: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:33:01.262994615Z [2024-05-24 23:33:01,259: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:33:01.347268098Z [2024-05-24 23:33:01,345: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-24T23:33:01.351858539Z [2024-05-24 23:33:01,350: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:33:01.382969098Z [2024-05-24 23:33:01,382: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:33:01.384135630Z [2024-05-24 23:33:01,383: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:33:01.384217230Z [2024-05-24 23:33:01,384: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:33:01.384306418Z [2024-05-24 23:33:01,384: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-24T23:33:01.384468396Z [2024-05-24 23:33:01,384: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:33:01.552299127Z [2024-05-24 23:33:01,552: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:33:02.259856455Z [2024-05-24 23:33:02,259: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[375c8325-32bb-4622-89f4-e7835a94f347] succeeded in 1.4125862319997395s: None 2024-05-24T23:33:02.647075675Z [2024-05-24 23:33:02,646: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:33:02.650899616Z [2024-05-24 23:33:02,650: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:33:02.676679666Z [2024-05-24 23:33:02,676: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:33:02.679893071Z [2024-05-24 23:33:02,679: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:33:02.679994925Z [2024-05-24 23:33:02,679: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:33:02.680133112Z [2024-05-24 23:33:02,679: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:33:02.680982121Z [2024-05-24 23:33:02,680: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:33:02.681493588Z [2024-05-24 23:33:02,681: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:33:02.681703723Z [2024-05-24 23:33:02,681: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:33:02.784376955Z [2024-05-24 23:33:02,784: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:33:02.829583682Z [2024-05-24 23:33:02,829: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:33:02.833123423Z [2024-05-24 23:33:02,832: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:33:02.855515077Z [2024-05-24 23:33:02,855: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:33:02.857072755Z [2024-05-24 23:33:02,856: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:33:02.857319568Z [2024-05-24 23:33:02,857: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:33:02.857558234Z [2024-05-24 23:33:02,857: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:33:02.857715724Z [2024-05-24 23:33:02,857: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:33:02.858047237Z [2024-05-24 23:33:02,857: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:33:02.858232025Z [2024-05-24 23:33:02,858: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:33:02.931930676Z [2024-05-24 23:33:02,931: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:33:05.159014711Z [2024-05-24 23:33:05,157: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e3824bc2-e098-42c0-b0bb-ac5e721218f3] succeeded in 4.287269413999638s: None 2024-05-24T23:33:06.534587634Z [2024-05-24 23:33:06,534: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1723806a-ab17-4a23-9a7d-afe48a375c01] succeeded in 5.6915931840003395s: None 2024-05-24T23:34:00.778665177Z [2024-05-24 23:34:00,778: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1541bd8-2ab1-4c8b-851b-110dc9579a82] received 2024-05-24T23:34:00.784004569Z [2024-05-24 23:34:00,783: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e4ac67e-01d1-46ee-8c85-b43b58e2da0c] received 2024-05-24T23:34:00.796946416Z [2024-05-24 23:34:00,796: INFO/ForkPoolWorker-16] [7e4ac67e-01d1-46ee-8c85-b43b58e2da0c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:34:00.801536358Z [2024-05-24 23:34:00,801: INFO/ForkPoolWorker-15] [d1541bd8-2ab1-4c8b-851b-110dc9579a82] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:34:00.810694620Z [2024-05-24 23:34:00,810: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d419417a-d6a1-4786-965e-0fdb6370bd09] received 2024-05-24T23:34:00.813369713Z [2024-05-24 23:34:00,812: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d061708-0b75-49f1-a3e4-cc75344b45c5] received 2024-05-24T23:34:00.837895920Z [2024-05-24 23:34:00,837: INFO/ForkPoolWorker-1] [d419417a-d6a1-4786-965e-0fdb6370bd09] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:34:00.843507597Z [2024-05-24 23:34:00,843: INFO/ForkPoolWorker-2] [3d061708-0b75-49f1-a3e4-cc75344b45c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:34:01.210098178Z [2024-05-24 23:34:01,206: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:34:01.227413446Z [2024-05-24 23:34:01,223: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:34:01.294710271Z [2024-05-24 23:34:01,291: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:34:01.357569380Z [2024-05-24 23:34:01,349: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:34:01.583613489Z [2024-05-24 23:34:01,583: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-24T23:34:01.590730374Z [2024-05-24 23:34:01,590: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:34:01.608153558Z [2024-05-24 23:34:01,607: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:34:01.619304453Z [2024-05-24 23:34:01,619: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:34:01.620656592Z [2024-05-24 23:34:01,620: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:34:01.620766804Z [2024-05-24 23:34:01,620: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:34:01.620857954Z [2024-05-24 23:34:01,620: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-24T23:34:01.621118694Z [2024-05-24 23:34:01,620: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:34:01.778976690Z [2024-05-24 23:34:01,778: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:34:02.448153725Z [2024-05-24 23:34:02,447: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d1541bd8-2ab1-4c8b-851b-110dc9579a82] succeeded in 1.664732940000249s: None 2024-05-24T23:34:02.622990718Z [2024-05-24 23:34:02,622: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3d061708-0b75-49f1-a3e4-cc75344b45c5] succeeded in 1.806512474000101s: None 2024-05-24T23:34:02.907182834Z [2024-05-24 23:34:02,906: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:34:02.910668325Z [2024-05-24 23:34:02,910: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:34:02.924208591Z [2024-05-24 23:34:02,923: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:34:02.929791062Z [2024-05-24 23:34:02,929: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:34:02.931076503Z [2024-05-24 23:34:02,930: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:34:02.931196455Z [2024-05-24 23:34:02,931: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:34:02.931407656Z [2024-05-24 23:34:02,931: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:34:02.931519017Z [2024-05-24 23:34:02,931: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:34:02.931804254Z [2024-05-24 23:34:02,931: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:34:02.931924042Z [2024-05-24 23:34:02,931: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:34:02.932427809Z [2024-05-24 23:34:02,931: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:34:02.959019301Z [2024-05-24 23:34:02,958: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:34:02.960908880Z [2024-05-24 23:34:02,960: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:34:02.961131923Z [2024-05-24 23:34:02,960: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:34:02.961369473Z [2024-05-24 23:34:02,961: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:34:02.961517397Z [2024-05-24 23:34:02,961: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:34:02.961980873Z [2024-05-24 23:34:02,961: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:34:02.962149646Z [2024-05-24 23:34:02,961: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:34:03.045964339Z [2024-05-24 23:34:03,045: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:34:03.080767563Z [2024-05-24 23:34:03,080: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:34:04.718684252Z [2024-05-24 23:34:04,718: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d419417a-d6a1-4786-965e-0fdb6370bd09] succeeded in 3.90503451099994s: None 2024-05-24T23:34:05.075399247Z [2024-05-24 23:34:05,074: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7e4ac67e-01d1-46ee-8c85-b43b58e2da0c] succeeded in 4.287761173000035s: None 2024-05-24T23:35:00.724608821Z [2024-05-24 23:35:00,723: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8330f2ee-add5-4eb7-9b48-f06f745ffb25] received 2024-05-24T23:35:00.727375854Z [2024-05-24 23:35:00,727: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f93d8f2-c807-450d-bf5b-5d01673e989f] received 2024-05-24T23:35:00.743402307Z [2024-05-24 23:35:00,743: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d81b596-cabe-4ffb-bd08-16d82bb480fd] received 2024-05-24T23:35:00.743445627Z [2024-05-24 23:35:00,743: INFO/ForkPoolWorker-16] [3f93d8f2-c807-450d-bf5b-5d01673e989f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:35:00.745512971Z [2024-05-24 23:35:00,745: INFO/ForkPoolWorker-15] [8330f2ee-add5-4eb7-9b48-f06f745ffb25] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:35:00.752879399Z [2024-05-24 23:35:00,752: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0855bbf8-ce30-4712-89f8-cd4730cd6637] received 2024-05-24T23:35:00.761577221Z [2024-05-24 23:35:00,761: INFO/ForkPoolWorker-1] [8d81b596-cabe-4ffb-bd08-16d82bb480fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:35:00.766658311Z [2024-05-24 23:35:00,766: INFO/ForkPoolWorker-2] [0855bbf8-ce30-4712-89f8-cd4730cd6637] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:35:01.063150702Z [2024-05-24 23:35:01,059: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:35:01.096128161Z [2024-05-24 23:35:01,086: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:35:01.107093751Z [2024-05-24 23:35:01,103: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:35:01.190800364Z [2024-05-24 23:35:01,187: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:35:01.303889766Z [2024-05-24 23:35:01,303: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-24T23:35:01.307956324Z [2024-05-24 23:35:01,307: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:35:01.351573723Z [2024-05-24 23:35:01,348: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:35:01.351588026Z [2024-05-24 23:35:01,349: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:35:01.351591829Z [2024-05-24 23:35:01,349: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:35:01.351595725Z [2024-05-24 23:35:01,349: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-24T23:35:01.351598781Z [2024-05-24 23:35:01,350: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:35:01.470594113Z [2024-05-24 23:35:01,470: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:35:02.338027679Z [2024-05-24 23:35:02,337: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3f93d8f2-c807-450d-bf5b-5d01673e989f] succeeded in 1.6041773700003432s: None 2024-05-24T23:35:02.689038828Z [2024-05-24 23:35:02,688: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:35:02.693062621Z [2024-05-24 23:35:02,692: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:35:02.695198802Z [2024-05-24 23:35:02,694: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:35:02.700540096Z [2024-05-24 23:35:02,700: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:35:02.725477777Z [2024-05-24 23:35:02,725: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:35:02.727036512Z [2024-05-24 23:35:02,726: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:35:02.728363672Z [2024-05-24 23:35:02,727: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:35:02.728626482Z [2024-05-24 23:35:02,728: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:35:02.728976454Z [2024-05-24 23:35:02,728: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:35:02.729039445Z [2024-05-24 23:35:02,728: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:35:02.729224873Z [2024-05-24 23:35:02,729: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:35:02.729246879Z [2024-05-24 23:35:02,728: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:35:02.729528350Z [2024-05-24 23:35:02,729: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:35:02.729658329Z [2024-05-24 23:35:02,729: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:35:02.729840261Z [2024-05-24 23:35:02,729: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:35:02.730020367Z [2024-05-24 23:35:02,729: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:35:02.730057726Z [2024-05-24 23:35:02,729: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:35:02.730208814Z [2024-05-24 23:35:02,730: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:35:02.817198896Z [2024-05-24 23:35:02,816: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:35:02.829820214Z [2024-05-24 23:35:02,829: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:35:02.921380374Z [2024-05-24 23:35:02,920: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:35:02.924827740Z [2024-05-24 23:35:02,924: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:35:02.955213741Z [2024-05-24 23:35:02,954: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:35:02.956446101Z [2024-05-24 23:35:02,956: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:35:02.956523704Z [2024-05-24 23:35:02,956: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:35:02.956679365Z [2024-05-24 23:35:02,956: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:35:02.956759121Z [2024-05-24 23:35:02,956: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:35:02.957042698Z [2024-05-24 23:35:02,956: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:35:02.957130025Z [2024-05-24 23:35:02,957: INFO/ForkPoolWorker-2] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:35:03.060238181Z [2024-05-24 23:35:03,059: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:35:03.541824670Z [2024-05-24 23:35:03,539: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8330f2ee-add5-4eb7-9b48-f06f745ffb25] succeeded in 2.8078051210000012s: None 2024-05-24T23:35:03.542297051Z [2024-05-24 23:35:03,542: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4a564b8-7afd-4ba1-8bd3-41116544f895] received 2024-05-24T23:35:03.553294535Z [2024-05-24 23:35:03,552: INFO/ForkPoolWorker-15] [f4a564b8-7afd-4ba1-8bd3-41116544f895] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:35:03.964686992Z [2024-05-24 23:35:03,961: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:35:04.580871425Z [2024-05-24 23:35:04,580: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0855bbf8-ce30-4712-89f8-cd4730cd6637] succeeded in 3.8225404310001068s: None 2024-05-24T23:35:04.718886290Z [2024-05-24 23:35:04,718: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8d81b596-cabe-4ffb-bd08-16d82bb480fd] succeeded in 3.9641275610001685s: None 2024-05-24T23:35:05.295575860Z [2024-05-24 23:35:05,295: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:35:05.299114893Z [2024-05-24 23:35:05,298: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:35:05.320560249Z [2024-05-24 23:35:05,320: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:35:05.321973052Z [2024-05-24 23:35:05,321: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:35:05.322069426Z [2024-05-24 23:35:05,321: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:35:05.322276593Z [2024-05-24 23:35:05,322: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:35:05.322387392Z [2024-05-24 23:35:05,322: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:35:05.322705929Z [2024-05-24 23:35:05,322: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:35:05.322872815Z [2024-05-24 23:35:05,322: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:35:05.418792014Z [2024-05-24 23:35:05,418: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:35:06.140670474Z [2024-05-24 23:35:06,139: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f4a564b8-7afd-4ba1-8bd3-41116544f895] succeeded in 2.593327995999971s: None 2024-05-24T23:35:06.170313726Z [2024-05-24 23:35:06,169: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c2f54f0-aa72-4523-b40a-c39ee7d1e69c] received 2024-05-24T23:35:06.182028658Z [2024-05-24 23:35:06,181: INFO/ForkPoolWorker-15] [4c2f54f0-aa72-4523-b40a-c39ee7d1e69c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:35:06.501134357Z [2024-05-24 23:35:06,493: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:35:07.657287692Z [2024-05-24 23:35:07,656: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:35:07.660606851Z [2024-05-24 23:35:07,660: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:35:07.696485225Z [2024-05-24 23:35:07,696: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:35:07.698430924Z [2024-05-24 23:35:07,698: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:35:07.699121464Z [2024-05-24 23:35:07,698: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:35:07.699277607Z [2024-05-24 23:35:07,699: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:35:07.699337094Z [2024-05-24 23:35:07,699: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:35:07.699720501Z [2024-05-24 23:35:07,699: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:35:07.699793939Z [2024-05-24 23:35:07,699: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:35:07.808129248Z [2024-05-24 23:35:07,807: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:35:08.364868758Z [2024-05-24 23:35:08,364: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4c2f54f0-aa72-4523-b40a-c39ee7d1e69c] succeeded in 2.1916255390001425s: None 2024-05-24T23:35:08.994452049Z [2024-05-24 23:35:08,994: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc47f9fe-eb3e-4173-bf09-4fceb7af21fe] received 2024-05-24T23:35:09.003979269Z [2024-05-24 23:35:09,003: INFO/ForkPoolWorker-15] [fc47f9fe-eb3e-4173-bf09-4fceb7af21fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:35:09.343498216Z [2024-05-24 23:35:09,340: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:35:10.535260716Z [2024-05-24 23:35:10,534: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:35:10.538493348Z [2024-05-24 23:35:10,537: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:35:10.563964429Z [2024-05-24 23:35:10,563: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:35:10.565475003Z [2024-05-24 23:35:10,565: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:35:10.565607656Z [2024-05-24 23:35:10,565: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:35:10.565853659Z [2024-05-24 23:35:10,565: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:35:10.565955084Z [2024-05-24 23:35:10,565: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:35:10.566450210Z [2024-05-24 23:35:10,566: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:35:10.566828995Z [2024-05-24 23:35:10,566: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:35:10.649190350Z [2024-05-24 23:35:10,648: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:35:11.256448452Z [2024-05-24 23:35:11,255: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fc47f9fe-eb3e-4173-bf09-4fceb7af21fe] succeeded in 2.2587969930000327s: None 2024-05-24T23:36:00.620108071Z [2024-05-24 23:36:00,619: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e9cbbf4-ad40-4f78-a6a4-7318f4208f25] received 2024-05-24T23:36:00.626535649Z [2024-05-24 23:36:00,625: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14308431-793a-4467-923b-1ddd5e3b0647] received 2024-05-24T23:36:00.630297092Z [2024-05-24 23:36:00,629: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7420d0f-5e07-4271-b73e-ccf2fcc46a16] received 2024-05-24T23:36:00.637511479Z [2024-05-24 23:36:00,637: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13227af1-40da-4e65-ae10-73f82530297a] received 2024-05-24T23:36:00.638436209Z [2024-05-24 23:36:00,638: INFO/ForkPoolWorker-15] [1e9cbbf4-ad40-4f78-a6a4-7318f4208f25] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:36:00.648171570Z [2024-05-24 23:36:00,647: INFO/ForkPoolWorker-16] [14308431-793a-4467-923b-1ddd5e3b0647] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:36:00.650657871Z [2024-05-24 23:36:00,650: INFO/ForkPoolWorker-1] [c7420d0f-5e07-4271-b73e-ccf2fcc46a16] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:36:00.652179119Z [2024-05-24 23:36:00,651: INFO/ForkPoolWorker-2] [13227af1-40da-4e65-ae10-73f82530297a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:36:00.960361714Z [2024-05-24 23:36:00,956: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:36:00.966812419Z [2024-05-24 23:36:00,963: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:36:00.992607856Z [2024-05-24 23:36:00,988: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:36:01.134771552Z [2024-05-24 23:36:01,131: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:36:01.182941706Z [2024-05-24 23:36:01,182: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-24T23:36:01.187600077Z [2024-05-24 23:36:01,187: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:36:01.229682360Z [2024-05-24 23:36:01,229: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:36:01.232362836Z [2024-05-24 23:36:01,232: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:36:01.232690367Z [2024-05-24 23:36:01,232: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:36:01.233072717Z [2024-05-24 23:36:01,232: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-24T23:36:01.233937872Z [2024-05-24 23:36:01,233: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:36:01.405380078Z [2024-05-24 23:36:01,399: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:36:01.455311626Z [2024-05-24 23:36:01,455: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:36:01.986284108Z [2024-05-24 23:36:01,985: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1e9cbbf4-ad40-4f78-a6a4-7318f4208f25] succeeded in 1.3620497740002975s: None 2024-05-24T23:36:02.081030706Z [2024-05-24 23:36:02,080: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c7420d0f-5e07-4271-b73e-ccf2fcc46a16] succeeded in 1.4453652659999534s: None 2024-05-24T23:36:02.235109409Z [2024-05-24 23:36:02,232: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:36:02.239080579Z [2024-05-24 23:36:02,238: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:36:02.262325879Z [2024-05-24 23:36:02,262: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:36:02.265870342Z [2024-05-24 23:36:02,265: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:36:02.266925152Z [2024-05-24 23:36:02,265: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:36:02.267098499Z [2024-05-24 23:36:02,266: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:36:02.267181510Z [2024-05-24 23:36:02,267: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:36:02.267419774Z [2024-05-24 23:36:02,267: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:36:02.268149463Z [2024-05-24 23:36:02,268: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:36:02.351561948Z [2024-05-24 23:36:02,351: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:36:02.440783285Z [2024-05-24 23:36:02,440: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:36:02.444057141Z [2024-05-24 23:36:02,443: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:36:02.472487392Z [2024-05-24 23:36:02,472: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:36:02.474486469Z [2024-05-24 23:36:02,474: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:36:02.474515123Z [2024-05-24 23:36:02,474: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:36:02.474865434Z [2024-05-24 23:36:02,474: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:36:02.474884755Z [2024-05-24 23:36:02,474: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:36:02.475335118Z [2024-05-24 23:36:02,475: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:36:02.475666662Z [2024-05-24 23:36:02,475: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:36:02.564442812Z [2024-05-24 23:36:02,564: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:36:03.909070112Z [2024-05-24 23:36:03,908: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[14308431-793a-4467-923b-1ddd5e3b0647] succeeded in 3.2771151749998353s: None 2024-05-24T23:36:04.717648997Z [2024-05-24 23:36:04,717: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[13227af1-40da-4e65-ae10-73f82530297a] succeeded in 4.075432990000081s: None 2024-05-24T23:37:00.358763951Z [2024-05-24 23:37:00,358: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18d69fba-0271-4f79-9703-4d87d26b1753] received 2024-05-24T23:37:00.365338375Z [2024-05-24 23:37:00,365: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d540a85-e9ae-4e8a-8cc3-69427d1c81af] received 2024-05-24T23:37:00.366356637Z [2024-05-24 23:37:00,366: INFO/ForkPoolWorker-15] [18d69fba-0271-4f79-9703-4d87d26b1753] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:37:00.367180687Z [2024-05-24 23:37:00,367: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1312b2f-a439-495a-a31c-66c53c57567f] received 2024-05-24T23:37:00.379166202Z [2024-05-24 23:37:00,378: INFO/ForkPoolWorker-16] [7d540a85-e9ae-4e8a-8cc3-69427d1c81af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:37:00.382024452Z [2024-05-24 23:37:00,381: INFO/ForkPoolWorker-1] [f1312b2f-a439-495a-a31c-66c53c57567f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:37:00.639768836Z [2024-05-24 23:37:00,636: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:37:00.680859131Z [2024-05-24 23:37:00,677: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:37:00.708359858Z [2024-05-24 23:37:00,703: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:37:00.829519980Z [2024-05-24 23:37:00,829: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-24T23:37:00.833346716Z [2024-05-24 23:37:00,832: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:37:00.863592242Z [2024-05-24 23:37:00,863: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:37:00.864713210Z [2024-05-24 23:37:00,864: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:37:00.864797323Z [2024-05-24 23:37:00,864: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:37:00.864856044Z [2024-05-24 23:37:00,864: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-24T23:37:00.865687075Z [2024-05-24 23:37:00,865: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:37:00.961930976Z [2024-05-24 23:37:00,961: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:37:01.629531686Z [2024-05-24 23:37:01,629: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[18d69fba-0271-4f79-9703-4d87d26b1753] succeeded in 1.2687239120000413s: None 2024-05-24T23:37:01.798822950Z [2024-05-24 23:37:01,798: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:37:01.802975849Z [2024-05-24 23:37:01,802: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:37:01.832534487Z [2024-05-24 23:37:01,832: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:37:01.833849783Z [2024-05-24 23:37:01,833: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:37:01.833959159Z [2024-05-24 23:37:01,833: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:37:01.834140351Z [2024-05-24 23:37:01,833: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:37:01.834218244Z [2024-05-24 23:37:01,834: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:37:01.834522517Z [2024-05-24 23:37:01,834: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:37:01.834688028Z [2024-05-24 23:37:01,834: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:37:01.908996670Z [2024-05-24 23:37:01,908: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:37:02.113544604Z [2024-05-24 23:37:02,113: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:37:02.116910249Z [2024-05-24 23:37:02,116: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:37:02.140619497Z [2024-05-24 23:37:02,140: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:37:02.142088612Z [2024-05-24 23:37:02,141: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:37:02.142139061Z [2024-05-24 23:37:02,142: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:37:02.142351233Z [2024-05-24 23:37:02,142: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:37:02.142534532Z [2024-05-24 23:37:02,142: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:37:02.143017166Z [2024-05-24 23:37:02,142: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:37:02.143664177Z [2024-05-24 23:37:02,143: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:37:02.258140651Z [2024-05-24 23:37:02,257: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:37:03.414079584Z [2024-05-24 23:37:03,413: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7d540a85-e9ae-4e8a-8cc3-69427d1c81af] succeeded in 3.046427845999915s: None 2024-05-24T23:37:04.178279529Z [2024-05-24 23:37:04,177: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f1312b2f-a439-495a-a31c-66c53c57567f] succeeded in 3.8087190719998034s: None 2024-05-24T23:38:00.236940405Z [2024-05-24 23:38:00,235: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[134e0191-ddf7-4cc7-b8e8-f0412d57a436] received 2024-05-24T23:38:00.238638167Z [2024-05-24 23:38:00,238: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11798772-b44e-433e-a246-2ca8bc099949] received 2024-05-24T23:38:00.247890228Z [2024-05-24 23:38:00,247: INFO/ForkPoolWorker-15] [134e0191-ddf7-4cc7-b8e8-f0412d57a436] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:38:00.250586719Z [2024-05-24 23:38:00,250: INFO/ForkPoolWorker-16] [11798772-b44e-433e-a246-2ca8bc099949] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:38:00.257622277Z [2024-05-24 23:38:00,257: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e76d26f4-78d8-4ea2-823a-53364ee49aba] received 2024-05-24T23:38:00.259571244Z [2024-05-24 23:38:00,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31617379-5ff2-4e73-bd36-a6bb0a614dfc] received 2024-05-24T23:38:00.278771634Z [2024-05-24 23:38:00,278: INFO/ForkPoolWorker-2] [31617379-5ff2-4e73-bd36-a6bb0a614dfc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:38:00.281795371Z [2024-05-24 23:38:00,281: INFO/ForkPoolWorker-1] [e76d26f4-78d8-4ea2-823a-53364ee49aba] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:38:00.571440290Z [2024-05-24 23:38:00,567: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:38:00.748084469Z [2024-05-24 23:38:00,744: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:38:00.758914121Z [2024-05-24 23:38:00,755: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:38:00.769892325Z [2024-05-24 23:38:00,766: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:38:00.928429852Z [2024-05-24 23:38:00,927: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-24T23:38:00.932329689Z [2024-05-24 23:38:00,931: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:38:00.966984608Z [2024-05-24 23:38:00,966: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:38:00.970160745Z [2024-05-24 23:38:00,969: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:38:00.970323116Z [2024-05-24 23:38:00,970: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:38:00.970426577Z [2024-05-24 23:38:00,970: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-24T23:38:00.970820162Z [2024-05-24 23:38:00,970: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:38:01.070448565Z [2024-05-24 23:38:01,070: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:38:01.119158289Z [2024-05-24 23:38:01,118: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:38:01.765088869Z [2024-05-24 23:38:01,764: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e76d26f4-78d8-4ea2-823a-53364ee49aba] succeeded in 1.5029210310003691s: None 2024-05-24T23:38:01.790714495Z [2024-05-24 23:38:01,790: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[11798772-b44e-433e-a246-2ca8bc099949] succeeded in 1.550081506999959s: None 2024-05-24T23:38:02.043831286Z [2024-05-24 23:38:02,043: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:38:02.047505398Z [2024-05-24 23:38:02,046: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:38:02.067741959Z [2024-05-24 23:38:02,067: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:38:02.069168935Z [2024-05-24 23:38:02,068: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:38:02.069186108Z [2024-05-24 23:38:02,069: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:38:02.069378475Z [2024-05-24 23:38:02,069: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:38:02.069453073Z [2024-05-24 23:38:02,069: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:38:02.069625579Z [2024-05-24 23:38:02,069: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:38:02.069646786Z [2024-05-24 23:38:02,069: INFO/ForkPoolWorker-2] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:38:02.158141039Z [2024-05-24 23:38:02,157: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:38:02.246028321Z [2024-05-24 23:38:02,245: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:38:02.274206881Z [2024-05-24 23:38:02,273: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:38:02.292621434Z [2024-05-24 23:38:02,292: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:38:02.293876183Z [2024-05-24 23:38:02,293: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:38:02.293975897Z [2024-05-24 23:38:02,293: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:38:02.294134353Z [2024-05-24 23:38:02,293: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:38:02.294191753Z [2024-05-24 23:38:02,294: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:38:02.294423211Z [2024-05-24 23:38:02,294: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:38:02.294538904Z [2024-05-24 23:38:02,294: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:38:02.381927891Z [2024-05-24 23:38:02,381: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:38:03.772936367Z [2024-05-24 23:38:03,772: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[31617379-5ff2-4e73-bd36-a6bb0a614dfc] succeeded in 3.5102400850000777s: None 2024-05-24T23:38:04.463336505Z [2024-05-24 23:38:04,462: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[134e0191-ddf7-4cc7-b8e8-f0412d57a436] succeeded in 4.223544839000169s: None 2024-05-24T23:39:00.256163527Z [2024-05-24 23:39:00,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d237eee-e2be-4a0b-8233-8a1c40a61772] received 2024-05-24T23:39:00.262041188Z [2024-05-24 23:39:00,261: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f9a9dae-e381-4cf9-a050-0b63c4018dac] received 2024-05-24T23:39:00.264699813Z [2024-05-24 23:39:00,264: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fecc2166-8fa3-4515-93fb-48be8e58b7a2] received 2024-05-24T23:39:00.269059248Z [2024-05-24 23:39:00,268: INFO/ForkPoolWorker-15] [4d237eee-e2be-4a0b-8233-8a1c40a61772] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:39:00.282469216Z [2024-05-24 23:39:00,282: INFO/ForkPoolWorker-1] [fecc2166-8fa3-4515-93fb-48be8e58b7a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:39:00.295478236Z [2024-05-24 23:39:00,295: INFO/ForkPoolWorker-16] [9f9a9dae-e381-4cf9-a050-0b63c4018dac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:39:00.629189809Z [2024-05-24 23:39:00,622: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:39:00.670146612Z [2024-05-24 23:39:00,666: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:39:00.704545004Z [2024-05-24 23:39:00,700: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:39:00.801712448Z [2024-05-24 23:39:00,801: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-24T23:39:00.817102641Z [2024-05-24 23:39:00,813: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:39:00.852477090Z [2024-05-24 23:39:00,852: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:39:00.854699175Z [2024-05-24 23:39:00,854: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:39:00.854891816Z [2024-05-24 23:39:00,854: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:39:00.855036916Z [2024-05-24 23:39:00,854: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-24T23:39:00.855322379Z [2024-05-24 23:39:00,855: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:39:00.941099827Z [2024-05-24 23:39:00,940: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:39:01.638307731Z [2024-05-24 23:39:01,637: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fecc2166-8fa3-4515-93fb-48be8e58b7a2] succeeded in 1.3703981680000652s: None 2024-05-24T23:39:02.052778585Z [2024-05-24 23:39:02,052: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:39:02.056678722Z [2024-05-24 23:39:02,056: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:39:02.061122071Z [2024-05-24 23:39:02,060: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:39:02.065562119Z [2024-05-24 23:39:02,064: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:39:02.084152162Z [2024-05-24 23:39:02,083: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:39:02.087685016Z [2024-05-24 23:39:02,087: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:39:02.087832322Z [2024-05-24 23:39:02,087: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:39:02.088082744Z [2024-05-24 23:39:02,087: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:39:02.088246006Z [2024-05-24 23:39:02,088: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:39:02.088688853Z [2024-05-24 23:39:02,088: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:39:02.088814315Z [2024-05-24 23:39:02,088: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:39:02.094130084Z [2024-05-24 23:39:02,093: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:39:02.095912265Z [2024-05-24 23:39:02,095: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:39:02.096085170Z [2024-05-24 23:39:02,095: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:39:02.096317655Z [2024-05-24 23:39:02,096: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:39:02.096443574Z [2024-05-24 23:39:02,096: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:39:02.096982821Z [2024-05-24 23:39:02,096: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:39:02.097202501Z [2024-05-24 23:39:02,097: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:39:02.209304322Z [2024-05-24 23:39:02,201: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:39:02.209327192Z [2024-05-24 23:39:02,201: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:39:03.954454430Z [2024-05-24 23:39:03,953: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4d237eee-e2be-4a0b-8233-8a1c40a61772] succeeded in 3.6958074499998474s: None 2024-05-24T23:39:05.024372897Z [2024-05-24 23:39:05,023: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9f9a9dae-e381-4cf9-a050-0b63c4018dac] succeeded in 4.757382657999642s: None 2024-05-24T23:40:01.242356754Z [2024-05-24 23:40:01,241: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9e2e279-6de2-4b07-914d-5b6e644d5bb4] received 2024-05-24T23:40:01.248713279Z [2024-05-24 23:40:01,248: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[176186e3-e012-428d-9743-fe33fd949279] received 2024-05-24T23:40:01.253535417Z [2024-05-24 23:40:01,253: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fda45551-0a16-40fc-919e-93a352194e26] received 2024-05-24T23:40:01.256494824Z [2024-05-24 23:40:01,256: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df02d26f-2523-4583-898e-619ca67119e9] received 2024-05-24T23:40:01.259825275Z [2024-05-24 23:40:01,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[907fb707-09a1-49d8-9252-6d15aaf5f09c] received 2024-05-24T23:40:01.277125764Z [2024-05-24 23:40:01,276: INFO/ForkPoolWorker-16] [176186e3-e012-428d-9743-fe33fd949279] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:40:01.277735345Z [2024-05-24 23:40:01,277: INFO/ForkPoolWorker-1] [fda45551-0a16-40fc-919e-93a352194e26] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:40:01.278959520Z [2024-05-24 23:40:01,278: INFO/ForkPoolWorker-15] [f9e2e279-6de2-4b07-914d-5b6e644d5bb4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:40:01.286187561Z [2024-05-24 23:40:01,285: INFO/ForkPoolWorker-2] [df02d26f-2523-4583-898e-619ca67119e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:40:01.294220872Z [2024-05-24 23:40:01,293: INFO/ForkPoolWorker-3] [907fb707-09a1-49d8-9252-6d15aaf5f09c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:40:01.650728954Z [2024-05-24 23:40:01,647: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:40:01.653213895Z [2024-05-24 23:40:01,647: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:40:01.751217922Z [2024-05-24 23:40:01,746: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:40:01.805666911Z [2024-05-24 23:40:01,782: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:40:01.929240688Z [2024-05-24 23:40:01,928: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-24T23:40:01.934084570Z [2024-05-24 23:40:01,933: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:40:01.940404140Z [2024-05-24 23:40:01,936: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:40:01.991625791Z [2024-05-24 23:40:01,991: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-24T23:40:01.995843996Z [2024-05-24 23:40:01,995: INFO/ForkPoolWorker-3] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:40:01.996203962Z [2024-05-24 23:40:01,995: INFO/ForkPoolWorker-3] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:40:01.996287478Z [2024-05-24 23:40:01,996: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-24T23:40:01.996622473Z [2024-05-24 23:40:01,996: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:40:02.088241231Z [2024-05-24 23:40:02,087: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:40:02.233078002Z [2024-05-24 23:40:02,230: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:40:03.193369807Z [2024-05-24 23:40:03,192: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[907fb707-09a1-49d8-9252-6d15aaf5f09c] succeeded in 1.9273680539999987s: None 2024-05-24T23:40:03.337705686Z [2024-05-24 23:40:03,337: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[176186e3-e012-428d-9743-fe33fd949279] succeeded in 2.080829938000079s: None 2024-05-24T23:40:03.411845327Z [2024-05-24 23:40:03,411: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:40:03.415386048Z [2024-05-24 23:40:03,414: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:40:03.461362912Z [2024-05-24 23:40:03,460: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:40:03.466859969Z [2024-05-24 23:40:03,466: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:40:03.467209474Z [2024-05-24 23:40:03,466: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:40:03.467654657Z [2024-05-24 23:40:03,467: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:40:03.467930336Z [2024-05-24 23:40:03,467: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:40:03.468519152Z [2024-05-24 23:40:03,468: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:40:03.468870353Z [2024-05-24 23:40:03,468: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:40:03.569597047Z [2024-05-24 23:40:03,569: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:40:03.618414414Z [2024-05-24 23:40:03,618: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:40:03.621945315Z [2024-05-24 23:40:03,621: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:40:03.653607255Z [2024-05-24 23:40:03,653: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:40:03.655052251Z [2024-05-24 23:40:03,654: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:40:03.655114486Z [2024-05-24 23:40:03,654: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:40:03.655245218Z [2024-05-24 23:40:03,655: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:40:03.655295623Z [2024-05-24 23:40:03,655: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:40:03.655562209Z [2024-05-24 23:40:03,655: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:40:03.655607498Z [2024-05-24 23:40:03,655: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:40:03.743461029Z [2024-05-24 23:40:03,743: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:40:04.046313567Z [2024-05-24 23:40:04,045: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:40:04.049429977Z [2024-05-24 23:40:04,049: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:40:04.074516182Z [2024-05-24 23:40:04,074: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:40:04.075959693Z [2024-05-24 23:40:04,075: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:40:04.076010866Z [2024-05-24 23:40:04,075: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:40:04.076143345Z [2024-05-24 23:40:04,075: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:40:04.076241848Z [2024-05-24 23:40:04,076: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:40:04.076462344Z [2024-05-24 23:40:04,076: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:40:04.076508304Z [2024-05-24 23:40:04,076: INFO/ForkPoolWorker-2] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:40:04.171448960Z [2024-05-24 23:40:04,171: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:40:04.379308314Z [2024-05-24 23:40:04,379: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fba989c9-ed51-4bcb-8ce0-3dc76f619794] received 2024-05-24T23:40:04.418257005Z [2024-05-24 23:40:04,417: INFO/ForkPoolWorker-16] [fba989c9-ed51-4bcb-8ce0-3dc76f619794] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:40:04.467689051Z [2024-05-24 23:40:04,467: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f9e2e279-6de2-4b07-914d-5b6e644d5bb4] succeeded in 3.211935421999897s: None 2024-05-24T23:40:04.678226347Z [2024-05-24 23:40:04,675: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:40:05.627424061Z [2024-05-24 23:40:05,627: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fda45551-0a16-40fc-919e-93a352194e26] succeeded in 4.365984297000068s: None 2024-05-24T23:40:05.820091403Z [2024-05-24 23:40:05,819: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[df02d26f-2523-4583-898e-619ca67119e9] succeeded in 4.558797735000098s: None 2024-05-24T23:40:05.854297550Z [2024-05-24 23:40:05,853: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:40:05.857613213Z [2024-05-24 23:40:05,857: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:40:05.882346711Z [2024-05-24 23:40:05,881: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:40:05.883741440Z [2024-05-24 23:40:05,883: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:40:05.883754725Z [2024-05-24 23:40:05,883: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:40:05.883966266Z [2024-05-24 23:40:05,883: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:40:05.883984823Z [2024-05-24 23:40:05,883: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:40:05.884494280Z [2024-05-24 23:40:05,884: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:40:05.884546096Z [2024-05-24 23:40:05,884: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:40:05.978972261Z [2024-05-24 23:40:05,978: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:40:06.739323729Z [2024-05-24 23:40:06,738: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fba989c9-ed51-4bcb-8ce0-3dc76f619794] succeeded in 2.3564915329998257s: None 2024-05-24T23:40:06.823052665Z [2024-05-24 23:40:06,822: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6928ad4-4c87-499b-b1e1-bb3de278e0db] received 2024-05-24T23:40:06.838424822Z [2024-05-24 23:40:06,838: INFO/ForkPoolWorker-15] [c6928ad4-4c87-499b-b1e1-bb3de278e0db] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:40:07.098305522Z [2024-05-24 23:40:07,094: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:40:08.319584931Z [2024-05-24 23:40:08,319: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:40:08.324370230Z [2024-05-24 23:40:08,323: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:40:08.345129563Z [2024-05-24 23:40:08,344: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:40:08.346837039Z [2024-05-24 23:40:08,346: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:40:08.346990141Z [2024-05-24 23:40:08,346: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:40:08.347215578Z [2024-05-24 23:40:08,347: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:40:08.347407943Z [2024-05-24 23:40:08,347: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:40:08.347935214Z [2024-05-24 23:40:08,347: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:40:08.348185356Z [2024-05-24 23:40:08,348: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:40:08.457357852Z [2024-05-24 23:40:08,456: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:40:09.190391835Z [2024-05-24 23:40:09,189: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c6928ad4-4c87-499b-b1e1-bb3de278e0db] succeeded in 2.3647656759999336s: None 2024-05-24T23:40:10.070902278Z [2024-05-24 23:40:10,070: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ca059fe-016b-4af3-a365-0c443046af78] received 2024-05-24T23:40:10.082217155Z [2024-05-24 23:40:10,081: INFO/ForkPoolWorker-15] [7ca059fe-016b-4af3-a365-0c443046af78] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:40:10.366111412Z [2024-05-24 23:40:10,362: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:40:11.419093321Z [2024-05-24 23:40:11,418: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:40:11.422362148Z [2024-05-24 23:40:11,421: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:40:11.448252546Z [2024-05-24 23:40:11,447: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:40:11.449820363Z [2024-05-24 23:40:11,449: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:40:11.449863857Z [2024-05-24 23:40:11,449: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:40:11.450053172Z [2024-05-24 23:40:11,449: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:40:11.450110666Z [2024-05-24 23:40:11,450: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:40:11.450481961Z [2024-05-24 23:40:11,450: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:40:11.450562202Z [2024-05-24 23:40:11,450: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:40:11.559385598Z [2024-05-24 23:40:11,558: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:40:12.225543313Z [2024-05-24 23:40:12,224: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7ca059fe-016b-4af3-a365-0c443046af78] succeeded in 2.1515631890001714s: None 2024-05-24T23:41:00.579448753Z [2024-05-24 23:41:00,578: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1444f760-3b56-41f1-8c7d-ea2c5f1d16c8] received 2024-05-24T23:41:00.600095268Z [2024-05-24 23:41:00,599: INFO/ForkPoolWorker-15] [1444f760-3b56-41f1-8c7d-ea2c5f1d16c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:41:00.600566346Z [2024-05-24 23:41:00,600: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38414ec2-48dd-4367-b030-f1eb95040598] received 2024-05-24T23:41:00.606980535Z [2024-05-24 23:41:00,606: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f46a9fe-5fdc-41e4-9d0c-ae1124da6a0a] received 2024-05-24T23:41:00.614058710Z [2024-05-24 23:41:00,613: INFO/ForkPoolWorker-16] [38414ec2-48dd-4367-b030-f1eb95040598] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:41:00.626325713Z [2024-05-24 23:41:00,625: INFO/ForkPoolWorker-1] [8f46a9fe-5fdc-41e4-9d0c-ae1124da6a0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:41:00.926041831Z [2024-05-24 23:41:00,921: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:41:00.926242565Z [2024-05-24 23:41:00,922: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:41:00.929042089Z [2024-05-24 23:41:00,925: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:41:01.105860498Z [2024-05-24 23:41:01,105: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-24T23:41:01.110723908Z [2024-05-24 23:41:01,110: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:41:01.140505825Z [2024-05-24 23:41:01,139: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:41:01.141938598Z [2024-05-24 23:41:01,141: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:41:01.142193572Z [2024-05-24 23:41:01,141: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:41:01.142496025Z [2024-05-24 23:41:01,142: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-24T23:41:01.142849967Z [2024-05-24 23:41:01,142: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:41:01.258398232Z [2024-05-24 23:41:01,258: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:41:01.928279632Z [2024-05-24 23:41:01,927: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8f46a9fe-5fdc-41e4-9d0c-ae1124da6a0a] succeeded in 1.317688943000121s: None 2024-05-24T23:41:02.157748591Z [2024-05-24 23:41:02,157: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:41:02.163333546Z [2024-05-24 23:41:02,162: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:41:02.207561628Z [2024-05-24 23:41:02,200: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:41:02.207611108Z [2024-05-24 23:41:02,202: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:41:02.207634030Z [2024-05-24 23:41:02,202: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:41:02.207638108Z [2024-05-24 23:41:02,202: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:41:02.207641960Z [2024-05-24 23:41:02,202: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:41:02.207644883Z [2024-05-24 23:41:02,202: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:41:02.207647880Z [2024-05-24 23:41:02,202: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:41:02.345495709Z [2024-05-24 23:41:02,345: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:41:02.406825160Z [2024-05-24 23:41:02,406: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:41:02.410320370Z [2024-05-24 23:41:02,409: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:41:02.428042230Z [2024-05-24 23:41:02,427: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:41:02.429489086Z [2024-05-24 23:41:02,429: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:41:02.429609655Z [2024-05-24 23:41:02,429: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:41:02.429818232Z [2024-05-24 23:41:02,429: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:41:02.429952841Z [2024-05-24 23:41:02,429: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:41:02.430238858Z [2024-05-24 23:41:02,430: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:41:02.430443967Z [2024-05-24 23:41:02,430: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:41:02.508916404Z [2024-05-24 23:41:02,508: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:41:03.877967489Z [2024-05-24 23:41:03,877: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[38414ec2-48dd-4367-b030-f1eb95040598] succeeded in 3.2732324620001236s: None 2024-05-24T23:41:04.310336021Z [2024-05-24 23:41:04,309: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1444f760-3b56-41f1-8c7d-ea2c5f1d16c8] succeeded in 3.725940283s: None 2024-05-24T23:42:00.961363926Z [2024-05-24 23:42:00,958: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b958568-6a96-4ffb-814c-e4bd7fd333ac] received 2024-05-24T23:42:00.961400366Z [2024-05-24 23:42:00,960: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f282cff0-1f59-4320-889f-b2fe12998358] received 2024-05-24T23:42:00.970941731Z [2024-05-24 23:42:00,970: INFO/ForkPoolWorker-16] [f282cff0-1f59-4320-889f-b2fe12998358] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:42:00.975882621Z [2024-05-24 23:42:00,975: INFO/ForkPoolWorker-15] [6b958568-6a96-4ffb-814c-e4bd7fd333ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:42:00.979051382Z [2024-05-24 23:42:00,978: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5254bad0-06b1-495a-9e66-53e3ceea71ac] received 2024-05-24T23:42:00.980927491Z [2024-05-24 23:42:00,980: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a63749fa-44a7-40ca-a3c9-271200d2a43c] received 2024-05-24T23:42:00.993362665Z [2024-05-24 23:42:00,992: INFO/ForkPoolWorker-1] [5254bad0-06b1-495a-9e66-53e3ceea71ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:42:00.997838723Z [2024-05-24 23:42:00,997: INFO/ForkPoolWorker-2] [a63749fa-44a7-40ca-a3c9-271200d2a43c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:42:01.361817820Z [2024-05-24 23:42:01,346: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:42:01.426288025Z [2024-05-24 23:42:01,410: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:42:01.547757274Z [2024-05-24 23:42:01,544: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:42:01.566903490Z [2024-05-24 23:42:01,563: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:42:01.671571787Z [2024-05-24 23:42:01,671: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:42:01.750593366Z [2024-05-24 23:42:01,745: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-24T23:42:01.757476835Z [2024-05-24 23:42:01,756: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:42:01.838834372Z [2024-05-24 23:42:01,838: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:42:01.840942828Z [2024-05-24 23:42:01,840: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:42:01.841214731Z [2024-05-24 23:42:01,840: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:42:01.841778556Z [2024-05-24 23:42:01,841: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-24T23:42:01.842104860Z [2024-05-24 23:42:01,841: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:42:02.050018218Z [2024-05-24 23:42:02,049: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:42:02.612030386Z [2024-05-24 23:42:02,611: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5254bad0-06b1-495a-9e66-53e3ceea71ac] succeeded in 1.6293508429998838s: None 2024-05-24T23:42:02.930700372Z [2024-05-24 23:42:02,930: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f282cff0-1f59-4320-889f-b2fe12998358] succeeded in 1.9685528049999448s: None 2024-05-24T23:42:03.141873297Z [2024-05-24 23:42:03,141: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:42:03.146211319Z [2024-05-24 23:42:03,145: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:42:03.181110821Z [2024-05-24 23:42:03,180: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:42:03.183112095Z [2024-05-24 23:42:03,182: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:42:03.183225801Z [2024-05-24 23:42:03,183: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:42:03.183456063Z [2024-05-24 23:42:03,183: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:42:03.183568073Z [2024-05-24 23:42:03,183: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:42:03.183937491Z [2024-05-24 23:42:03,183: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:42:03.184039484Z [2024-05-24 23:42:03,183: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:42:03.270145898Z [2024-05-24 23:42:03,269: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:42:03.487770378Z [2024-05-24 23:42:03,487: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:42:03.491466391Z [2024-05-24 23:42:03,491: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:42:03.509475675Z [2024-05-24 23:42:03,509: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:42:03.510868714Z [2024-05-24 23:42:03,510: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:42:03.511131201Z [2024-05-24 23:42:03,511: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:42:03.511300986Z [2024-05-24 23:42:03,511: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:42:03.511384386Z [2024-05-24 23:42:03,511: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:42:03.511624321Z [2024-05-24 23:42:03,511: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:42:03.511925303Z [2024-05-24 23:42:03,511: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:42:03.633127890Z [2024-05-24 23:42:03,632: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:42:05.158068731Z [2024-05-24 23:42:05,157: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a63749fa-44a7-40ca-a3c9-271200d2a43c] succeeded in 4.17448116200012s: None 2024-05-24T23:42:05.216202044Z [2024-05-24 23:42:05,215: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6b958568-6a96-4ffb-814c-e4bd7fd333ac] succeeded in 4.249191883000094s: None 2024-05-24T23:43:00.300117763Z [2024-05-24 23:43:00,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1df7b77f-2e51-4a26-a5a7-8bfa4641f8c3] received 2024-05-24T23:43:00.303787338Z [2024-05-24 23:43:00,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4852b545-42de-4c6b-81f2-26646c4251b9] received 2024-05-24T23:43:00.317783398Z [2024-05-24 23:43:00,317: INFO/ForkPoolWorker-16] [4852b545-42de-4c6b-81f2-26646c4251b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:43:00.326032018Z [2024-05-24 23:43:00,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b32bd2be-958e-4729-b5e0-59fa167ada30] received 2024-05-24T23:43:00.329070551Z [2024-05-24 23:43:00,328: INFO/ForkPoolWorker-15] [1df7b77f-2e51-4a26-a5a7-8bfa4641f8c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:43:00.358218647Z [2024-05-24 23:43:00,357: INFO/ForkPoolWorker-1] [b32bd2be-958e-4729-b5e0-59fa167ada30] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:43:00.667812243Z [2024-05-24 23:43:00,663: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:43:00.692993456Z [2024-05-24 23:43:00,688: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:43:00.700343470Z [2024-05-24 23:43:00,696: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:43:00.858042413Z [2024-05-24 23:43:00,857: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-24T23:43:00.862506504Z [2024-05-24 23:43:00,862: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:43:00.888382429Z [2024-05-24 23:43:00,888: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:43:00.890645453Z [2024-05-24 23:43:00,890: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:43:00.890784936Z [2024-05-24 23:43:00,890: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:43:00.890878831Z [2024-05-24 23:43:00,890: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-24T23:43:00.891137150Z [2024-05-24 23:43:00,890: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:43:00.988223980Z [2024-05-24 23:43:00,987: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:43:01.737704377Z [2024-05-24 23:43:01,737: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b32bd2be-958e-4729-b5e0-59fa167ada30] succeeded in 1.4073928279999564s: None 2024-05-24T23:43:01.958806103Z [2024-05-24 23:43:01,958: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:43:01.962278650Z [2024-05-24 23:43:01,961: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:43:01.992821467Z [2024-05-24 23:43:01,992: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:43:01.994379125Z [2024-05-24 23:43:01,994: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:43:01.994527492Z [2024-05-24 23:43:01,994: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:43:01.994738697Z [2024-05-24 23:43:01,994: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:43:01.994908787Z [2024-05-24 23:43:01,994: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:43:01.995290966Z [2024-05-24 23:43:01,995: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:43:01.995428456Z [2024-05-24 23:43:01,995: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:43:02.083674381Z [2024-05-24 23:43:02,083: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:43:02.087700262Z [2024-05-24 23:43:02,087: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:43:02.098462049Z [2024-05-24 23:43:02,098: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:43:02.116725040Z [2024-05-24 23:43:02,116: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:43:02.118761918Z [2024-05-24 23:43:02,118: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:43:02.118952963Z [2024-05-24 23:43:02,118: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:43:02.119211298Z [2024-05-24 23:43:02,118: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:43:02.119339647Z [2024-05-24 23:43:02,119: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:43:02.119809880Z [2024-05-24 23:43:02,119: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:43:02.120047968Z [2024-05-24 23:43:02,119: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:43:02.293607568Z [2024-05-24 23:43:02,293: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:43:04.323331778Z [2024-05-24 23:43:04,322: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4852b545-42de-4c6b-81f2-26646c4251b9] succeeded in 4.016282723000131s: None 2024-05-24T23:43:04.648345763Z [2024-05-24 23:43:04,647: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1df7b77f-2e51-4a26-a5a7-8bfa4641f8c3] succeeded in 4.3389429810004s: None 2024-05-24T23:44:00.279882733Z [2024-05-24 23:44:00,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48e31ddf-e77c-4725-a2ab-663c74a57374] received 2024-05-24T23:44:00.282000695Z [2024-05-24 23:44:00,281: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e18b70d4-7227-401d-90a1-909d80f036f2] received 2024-05-24T23:44:00.295053598Z [2024-05-24 23:44:00,294: INFO/ForkPoolWorker-15] [48e31ddf-e77c-4725-a2ab-663c74a57374] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:44:00.299389089Z [2024-05-24 23:44:00,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a2f70d3-1684-49ea-8a5a-bb2f0202db44] received 2024-05-24T23:44:00.301907162Z [2024-05-24 23:44:00,301: INFO/ForkPoolWorker-16] [e18b70d4-7227-401d-90a1-909d80f036f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:44:00.309790573Z [2024-05-24 23:44:00,309: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe2b3c26-5259-4bde-9fd5-7bf0c077fc1f] received 2024-05-24T23:44:00.319375492Z [2024-05-24 23:44:00,318: INFO/ForkPoolWorker-1] [5a2f70d3-1684-49ea-8a5a-bb2f0202db44] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:44:00.355443818Z [2024-05-24 23:44:00,355: INFO/ForkPoolWorker-2] [fe2b3c26-5259-4bde-9fd5-7bf0c077fc1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:44:00.666499590Z [2024-05-24 23:44:00,661: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:44:00.677677599Z [2024-05-24 23:44:00,674: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:44:00.727456375Z [2024-05-24 23:44:00,719: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:44:00.757986907Z [2024-05-24 23:44:00,753: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:44:00.921376587Z [2024-05-24 23:44:00,920: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-24T23:44:00.925459220Z [2024-05-24 23:44:00,924: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:44:00.948804519Z [2024-05-24 23:44:00,948: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:44:00.950839300Z [2024-05-24 23:44:00,950: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:44:00.954004040Z [2024-05-24 23:44:00,953: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:44:00.954087935Z [2024-05-24 23:44:00,953: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:44:00.954124312Z [2024-05-24 23:44:00,954: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-24T23:44:00.954327599Z [2024-05-24 23:44:00,954: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:44:01.096045884Z [2024-05-24 23:44:01,095: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:44:01.704676789Z [2024-05-24 23:44:01,703: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[48e31ddf-e77c-4725-a2ab-663c74a57374] succeeded in 1.421474162999857s: None 2024-05-24T23:44:01.809651857Z [2024-05-24 23:44:01,808: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fe2b3c26-5259-4bde-9fd5-7bf0c077fc1f] succeeded in 1.4833438800001204s: None 2024-05-24T23:44:02.148894603Z [2024-05-24 23:44:02,148: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:44:02.152848741Z [2024-05-24 23:44:02,152: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:44:02.188961478Z [2024-05-24 23:44:02,184: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:44:02.188984909Z [2024-05-24 23:44:02,186: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:44:02.188989269Z [2024-05-24 23:44:02,186: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:44:02.188993696Z [2024-05-24 23:44:02,186: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:44:02.188998661Z [2024-05-24 23:44:02,186: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:44:02.189002125Z [2024-05-24 23:44:02,187: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:44:02.189005347Z [2024-05-24 23:44:02,187: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:44:02.315535764Z [2024-05-24 23:44:02,315: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:44:02.371040388Z [2024-05-24 23:44:02,370: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:44:02.375161931Z [2024-05-24 23:44:02,374: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:44:02.409567245Z [2024-05-24 23:44:02,409: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:44:02.411046137Z [2024-05-24 23:44:02,410: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:44:02.411147238Z [2024-05-24 23:44:02,411: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:44:02.411307090Z [2024-05-24 23:44:02,411: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:44:02.411440273Z [2024-05-24 23:44:02,411: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:44:02.412200212Z [2024-05-24 23:44:02,412: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:44:02.412753742Z [2024-05-24 23:44:02,412: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:44:02.496568634Z [2024-05-24 23:44:02,496: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:44:04.139509475Z [2024-05-24 23:44:04,138: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5a2f70d3-1684-49ea-8a5a-bb2f0202db44] succeeded in 3.831713352999941s: None 2024-05-24T23:44:04.208731680Z [2024-05-24 23:44:04,208: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e18b70d4-7227-401d-90a1-909d80f036f2] succeeded in 3.9245785889997933s: None 2024-05-24T23:45:00.574297488Z [2024-05-24 23:45:00,573: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0400b42a-06b2-4656-934f-3839411c1576] received 2024-05-24T23:45:00.576404035Z [2024-05-24 23:45:00,576: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0db8b4d-8c49-4cd1-8208-a1a8b5ba0665] received 2024-05-24T23:45:00.578954139Z [2024-05-24 23:45:00,578: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[819d5642-b826-4526-b8fd-d4621481db82] received 2024-05-24T23:45:00.580621472Z [2024-05-24 23:45:00,580: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ff1989f-437f-4199-82bf-5fc447ca2d1d] received 2024-05-24T23:45:00.595448602Z [2024-05-24 23:45:00,595: INFO/ForkPoolWorker-2] [4ff1989f-437f-4199-82bf-5fc447ca2d1d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:45:00.595842286Z [2024-05-24 23:45:00,595: INFO/ForkPoolWorker-1] [819d5642-b826-4526-b8fd-d4621481db82] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:45:00.602159964Z [2024-05-24 23:45:00,601: INFO/ForkPoolWorker-15] [0400b42a-06b2-4656-934f-3839411c1576] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:45:00.602884977Z [2024-05-24 23:45:00,602: INFO/ForkPoolWorker-16] [f0db8b4d-8c49-4cd1-8208-a1a8b5ba0665] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:45:00.937789714Z [2024-05-24 23:45:00,934: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:45:00.939296963Z [2024-05-24 23:45:00,932: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:45:01.006168272Z [2024-05-24 23:45:00,987: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:45:01.135408043Z [2024-05-24 23:45:01,131: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:45:01.217699734Z [2024-05-24 23:45:01,217: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-24T23:45:01.222214540Z [2024-05-24 23:45:01,221: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:45:01.267098089Z [2024-05-24 23:45:01,266: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:45:01.269274851Z [2024-05-24 23:45:01,268: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:45:01.269521878Z [2024-05-24 23:45:01,269: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:45:01.269749247Z [2024-05-24 23:45:01,269: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-24T23:45:01.270092524Z [2024-05-24 23:45:01,269: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:45:01.419738482Z [2024-05-24 23:45:01,419: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:45:02.162447901Z [2024-05-24 23:45:02,162: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4ff1989f-437f-4199-82bf-5fc447ca2d1d] succeeded in 1.5791788229998929s: None 2024-05-24T23:45:02.616270284Z [2024-05-24 23:45:02,615: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:45:02.620480744Z [2024-05-24 23:45:02,620: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:45:02.647601787Z [2024-05-24 23:45:02,647: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:45:02.649382614Z [2024-05-24 23:45:02,649: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:45:02.649572286Z [2024-05-24 23:45:02,649: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:45:02.649836480Z [2024-05-24 23:45:02,649: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:45:02.650128475Z [2024-05-24 23:45:02,649: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:45:02.650659102Z [2024-05-24 23:45:02,650: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:45:02.650890032Z [2024-05-24 23:45:02,650: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:45:02.686202933Z [2024-05-24 23:45:02,685: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:45:02.689536783Z [2024-05-24 23:45:02,689: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:45:02.712455255Z [2024-05-24 23:45:02,712: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:45:02.714444298Z [2024-05-24 23:45:02,714: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:45:02.714625355Z [2024-05-24 23:45:02,714: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:45:02.714832124Z [2024-05-24 23:45:02,714: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:45:02.714963755Z [2024-05-24 23:45:02,714: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:45:02.715324894Z [2024-05-24 23:45:02,715: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:45:02.715955639Z [2024-05-24 23:45:02,715: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:45:02.765615360Z [2024-05-24 23:45:02,765: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:45:02.823573776Z [2024-05-24 23:45:02,823: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:45:02.841629233Z [2024-05-24 23:45:02,841: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:45:02.846108783Z [2024-05-24 23:45:02,845: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:45:02.887761024Z [2024-05-24 23:45:02,887: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:45:02.889740709Z [2024-05-24 23:45:02,889: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:45:02.890090837Z [2024-05-24 23:45:02,889: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:45:02.890285101Z [2024-05-24 23:45:02,890: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:45:02.890442551Z [2024-05-24 23:45:02,890: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:45:02.890745645Z [2024-05-24 23:45:02,890: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:45:02.890980011Z [2024-05-24 23:45:02,890: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:45:02.991595031Z [2024-05-24 23:45:02,991: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:45:03.435091856Z [2024-05-24 23:45:03,434: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0400b42a-06b2-4656-934f-3839411c1576] succeeded in 2.8562823759998537s: None 2024-05-24T23:45:04.328371831Z [2024-05-24 23:45:04,328: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c69e183b-631d-4793-ac6b-ba1f0bb0aa3a] received 2024-05-24T23:45:04.337950284Z [2024-05-24 23:45:04,337: INFO/ForkPoolWorker-15] [c69e183b-631d-4793-ac6b-ba1f0bb0aa3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:45:04.480754148Z [2024-05-24 23:45:04,480: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[819d5642-b826-4526-b8fd-d4621481db82] succeeded in 3.898519720999957s: None 2024-05-24T23:45:04.650863592Z [2024-05-24 23:45:04,647: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:45:05.701996830Z [2024-05-24 23:45:05,701: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f0db8b4d-8c49-4cd1-8208-a1a8b5ba0665] succeeded in 5.119725273999848s: None 2024-05-24T23:45:05.816502811Z [2024-05-24 23:45:05,816: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:45:05.819876482Z [2024-05-24 23:45:05,819: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:45:05.844135227Z [2024-05-24 23:45:05,843: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:45:05.845542032Z [2024-05-24 23:45:05,845: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:45:05.845569810Z [2024-05-24 23:45:05,845: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:45:05.845732904Z [2024-05-24 23:45:05,845: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:45:05.845748252Z [2024-05-24 23:45:05,845: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:45:05.846250514Z [2024-05-24 23:45:05,845: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:45:05.846259958Z [2024-05-24 23:45:05,845: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:45:05.942887790Z [2024-05-24 23:45:05,942: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:45:06.753016366Z [2024-05-24 23:45:06,752: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c69e183b-631d-4793-ac6b-ba1f0bb0aa3a] succeeded in 2.4222397519997685s: None 2024-05-24T23:45:06.784183693Z [2024-05-24 23:45:06,783: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e456789a-bc34-4726-afd3-6c11b6c7d70f] received 2024-05-24T23:45:06.801203715Z [2024-05-24 23:45:06,800: INFO/ForkPoolWorker-15] [e456789a-bc34-4726-afd3-6c11b6c7d70f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:45:07.171993417Z [2024-05-24 23:45:07,164: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:45:08.534542843Z [2024-05-24 23:45:08,534: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:45:08.542554849Z [2024-05-24 23:45:08,542: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:45:08.561693828Z [2024-05-24 23:45:08,561: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:45:08.562880094Z [2024-05-24 23:45:08,562: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:45:08.562973570Z [2024-05-24 23:45:08,562: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:45:08.563115008Z [2024-05-24 23:45:08,562: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:45:08.563192539Z [2024-05-24 23:45:08,563: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:45:08.563437312Z [2024-05-24 23:45:08,563: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:45:08.563514439Z [2024-05-24 23:45:08,563: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:45:08.660403615Z [2024-05-24 23:45:08,660: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:45:11.883449570Z [2024-05-24 23:45:11,882: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e456789a-bc34-4726-afd3-6c11b6c7d70f] succeeded in 5.096345566000309s: None 2024-05-24T23:45:12.253649212Z [2024-05-24 23:45:12,252: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[086a62b0-c4e1-44ae-838c-3b5f2b910f94] received 2024-05-24T23:45:12.274759192Z [2024-05-24 23:45:12,274: INFO/ForkPoolWorker-15] [086a62b0-c4e1-44ae-838c-3b5f2b910f94] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:45:12.670220334Z [2024-05-24 23:45:12,666: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:45:14.086112911Z [2024-05-24 23:45:14,085: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:45:14.089450345Z [2024-05-24 23:45:14,088: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:45:14.123780775Z [2024-05-24 23:45:14,123: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:45:14.125798289Z [2024-05-24 23:45:14,125: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:45:14.125868303Z [2024-05-24 23:45:14,125: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:45:14.126145676Z [2024-05-24 23:45:14,125: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:45:14.126163864Z [2024-05-24 23:45:14,126: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:45:14.126731795Z [2024-05-24 23:45:14,126: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:45:14.126761920Z [2024-05-24 23:45:14,126: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:45:14.231187870Z [2024-05-24 23:45:14,230: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:45:14.884998354Z [2024-05-24 23:45:14,884: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[086a62b0-c4e1-44ae-838c-3b5f2b910f94] succeeded in 2.628439040000103s: None 2024-05-24T23:46:00.254006542Z [2024-05-24 23:46:00,253: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f28afac-7b99-4a53-8307-f89e798599c2] received 2024-05-24T23:46:00.255706930Z [2024-05-24 23:46:00,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6dc9bda-5c5c-4447-aafb-b54edd8667de] received 2024-05-24T23:46:00.269381027Z [2024-05-24 23:46:00,269: INFO/ForkPoolWorker-15] [7f28afac-7b99-4a53-8307-f89e798599c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:46:00.271726556Z [2024-05-24 23:46:00,271: INFO/ForkPoolWorker-16] [e6dc9bda-5c5c-4447-aafb-b54edd8667de] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:46:00.305757817Z [2024-05-24 23:46:00,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[543565e9-4e7f-4771-84b8-71589468a408] received 2024-05-24T23:46:00.313670807Z [2024-05-24 23:46:00,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05b5042c-fb20-4289-a0b4-925cb9288d85] received 2024-05-24T23:46:00.335929150Z [2024-05-24 23:46:00,333: INFO/ForkPoolWorker-1] [543565e9-4e7f-4771-84b8-71589468a408] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:46:00.362159789Z [2024-05-24 23:46:00,361: INFO/ForkPoolWorker-2] [05b5042c-fb20-4289-a0b4-925cb9288d85] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:46:00.685871570Z [2024-05-24 23:46:00,681: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:46:00.732792619Z [2024-05-24 23:46:00,723: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:46:00.940919535Z [2024-05-24 23:46:00,936: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:46:00.993953665Z [2024-05-24 23:46:00,990: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:46:01.236808496Z [2024-05-24 23:46:01,236: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-24T23:46:01.240630719Z [2024-05-24 23:46:01,240: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:46:01.265991582Z [2024-05-24 23:46:01,265: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:46:01.269511532Z [2024-05-24 23:46:01,269: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:46:01.270508195Z [2024-05-24 23:46:01,270: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:46:01.270713183Z [2024-05-24 23:46:01,270: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:46:01.270779061Z [2024-05-24 23:46:01,270: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-24T23:46:01.271238207Z [2024-05-24 23:46:01,271: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:46:01.448181310Z [2024-05-24 23:46:01,447: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:46:01.983554894Z [2024-05-24 23:46:01,983: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[543565e9-4e7f-4771-84b8-71589468a408] succeeded in 1.6748678500002825s: None 2024-05-24T23:46:02.049316597Z [2024-05-24 23:46:02,048: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e6dc9bda-5c5c-4447-aafb-b54edd8667de] succeeded in 1.7907954890001747s: None 2024-05-24T23:46:02.134178919Z [2024-05-24 23:46:02,133: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:46:02.137548178Z [2024-05-24 23:46:02,137: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:46:02.158458361Z [2024-05-24 23:46:02,158: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:46:02.159882022Z [2024-05-24 23:46:02,159: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:46:02.160029455Z [2024-05-24 23:46:02,159: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:46:02.160703586Z [2024-05-24 23:46:02,160: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:46:02.160836205Z [2024-05-24 23:46:02,160: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:46:02.161456120Z [2024-05-24 23:46:02,161: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:46:02.161584107Z [2024-05-24 23:46:02,161: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:46:02.245364401Z [2024-05-24 23:46:02,244: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:46:02.628353105Z [2024-05-24 23:46:02,627: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:46:02.631623305Z [2024-05-24 23:46:02,631: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:46:02.654130100Z [2024-05-24 23:46:02,653: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:46:02.655462042Z [2024-05-24 23:46:02,655: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:46:02.655671176Z [2024-05-24 23:46:02,655: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:46:02.655951825Z [2024-05-24 23:46:02,655: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:46:02.656151737Z [2024-05-24 23:46:02,655: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:46:02.656699544Z [2024-05-24 23:46:02,656: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:46:02.656877359Z [2024-05-24 23:46:02,656: INFO/ForkPoolWorker-2] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:46:02.732427742Z [2024-05-24 23:46:02,732: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:46:04.078253462Z [2024-05-24 23:46:04,077: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7f28afac-7b99-4a53-8307-f89e798599c2] succeeded in 3.821196711999619s: None 2024-05-24T23:46:04.326964973Z [2024-05-24 23:46:04,326: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[05b5042c-fb20-4289-a0b4-925cb9288d85] succeeded in 4.00354516499965s: None 2024-05-24T23:47:01.197849650Z [2024-05-24 23:47:01,197: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e73da4c-b303-4dfe-bde2-d1244d523948] received 2024-05-24T23:47:01.205290554Z [2024-05-24 23:47:01,205: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55b67208-2841-4721-aa44-c00b3d19e94c] received 2024-05-24T23:47:01.214293085Z [2024-05-24 23:47:01,213: INFO/ForkPoolWorker-15] [9e73da4c-b303-4dfe-bde2-d1244d523948] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:47:01.217476991Z [2024-05-24 23:47:01,217: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a3840a3-6c15-49b2-92f4-0428f8dd1001] received 2024-05-24T23:47:01.219534480Z [2024-05-24 23:47:01,219: INFO/ForkPoolWorker-16] [55b67208-2841-4721-aa44-c00b3d19e94c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:47:01.229728231Z [2024-05-24 23:47:01,229: INFO/ForkPoolWorker-1] [1a3840a3-6c15-49b2-92f4-0428f8dd1001] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:47:01.589199743Z [2024-05-24 23:47:01,585: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:47:01.596448805Z [2024-05-24 23:47:01,592: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:47:01.621240467Z [2024-05-24 23:47:01,617: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:47:01.741093830Z [2024-05-24 23:47:01,740: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-24T23:47:01.745061710Z [2024-05-24 23:47:01,744: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:47:01.777541971Z [2024-05-24 23:47:01,776: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:47:01.779045922Z [2024-05-24 23:47:01,778: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:47:01.779344266Z [2024-05-24 23:47:01,779: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:47:01.779521559Z [2024-05-24 23:47:01,779: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-24T23:47:01.779869397Z [2024-05-24 23:47:01,779: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:47:01.872544638Z [2024-05-24 23:47:01,872: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:47:02.675076922Z [2024-05-24 23:47:02,674: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9e73da4c-b303-4dfe-bde2-d1244d523948] succeeded in 1.474493041000187s: None 2024-05-24T23:47:03.010191139Z [2024-05-24 23:47:03,009: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:47:03.016308921Z [2024-05-24 23:47:03,015: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:47:03.052896835Z [2024-05-24 23:47:03,052: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:47:03.054727127Z [2024-05-24 23:47:03,054: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:47:03.055969764Z [2024-05-24 23:47:03,055: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:47:03.056170386Z [2024-05-24 23:47:03,055: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:47:03.056280315Z [2024-05-24 23:47:03,056: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:47:03.056570620Z [2024-05-24 23:47:03,056: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:47:03.056689630Z [2024-05-24 23:47:03,056: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:47:03.082802507Z [2024-05-24 23:47:03,082: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:47:03.085997280Z [2024-05-24 23:47:03,085: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:47:03.118312740Z [2024-05-24 23:47:03,118: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:47:03.122223132Z [2024-05-24 23:47:03,121: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:47:03.122370042Z [2024-05-24 23:47:03,122: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:47:03.122603988Z [2024-05-24 23:47:03,122: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:47:03.122770387Z [2024-05-24 23:47:03,122: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:47:03.123174578Z [2024-05-24 23:47:03,122: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:47:03.123360784Z [2024-05-24 23:47:03,123: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:47:03.132966132Z [2024-05-24 23:47:03,132: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:47:03.269780487Z [2024-05-24 23:47:03,269: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:47:04.650778968Z [2024-05-24 23:47:04,650: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[55b67208-2841-4721-aa44-c00b3d19e94c] succeeded in 3.442194519000168s: None 2024-05-24T23:47:05.298229257Z [2024-05-24 23:47:05,297: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1a3840a3-6c15-49b2-92f4-0428f8dd1001] succeeded in 4.078539861000081s: None 2024-05-24T23:48:01.133849615Z [2024-05-24 23:48:01,132: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ce134c6-006e-4938-939b-b7b175be1e05] received 2024-05-24T23:48:01.143768096Z [2024-05-24 23:48:01,143: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6353490-6afd-44f4-9b70-9583f6383a0f] received 2024-05-24T23:48:01.151074753Z [2024-05-24 23:48:01,150: INFO/ForkPoolWorker-15] [4ce134c6-006e-4938-939b-b7b175be1e05] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:48:01.166628470Z [2024-05-24 23:48:01,166: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f9ebdb4-072a-465c-a1ba-dd88dc9973d1] received 2024-05-24T23:48:01.179242441Z [2024-05-24 23:48:01,178: INFO/ForkPoolWorker-16] [f6353490-6afd-44f4-9b70-9583f6383a0f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:48:01.180174990Z [2024-05-24 23:48:01,179: INFO/ForkPoolWorker-1] [7f9ebdb4-072a-465c-a1ba-dd88dc9973d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:48:01.182040378Z [2024-05-24 23:48:01,181: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4d7c310-2713-46db-bac1-37a9f5bf4778] received 2024-05-24T23:48:01.197539537Z [2024-05-24 23:48:01,197: INFO/ForkPoolWorker-2] [e4d7c310-2713-46db-bac1-37a9f5bf4778] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:48:01.575601135Z [2024-05-24 23:48:01,570: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:48:01.582443796Z [2024-05-24 23:48:01,578: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:48:01.613010593Z [2024-05-24 23:48:01,608: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:48:01.647878157Z [2024-05-24 23:48:01,643: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:48:01.831566583Z [2024-05-24 23:48:01,831: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-24T23:48:01.837521645Z [2024-05-24 23:48:01,837: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:48:01.879317924Z [2024-05-24 23:48:01,879: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:48:01.886336153Z [2024-05-24 23:48:01,886: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:48:01.890157414Z [2024-05-24 23:48:01,889: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:48:01.890517890Z [2024-05-24 23:48:01,890: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:48:01.890765051Z [2024-05-24 23:48:01,890: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-24T23:48:01.891268807Z [2024-05-24 23:48:01,891: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:48:02.031191890Z [2024-05-24 23:48:02,030: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:48:02.726145330Z [2024-05-24 23:48:02,725: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4ce134c6-006e-4938-939b-b7b175be1e05] succeeded in 1.586825059000148s: None 2024-05-24T23:48:02.759018715Z [2024-05-24 23:48:02,758: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e4d7c310-2713-46db-bac1-37a9f5bf4778] succeeded in 1.5724694709997493s: None 2024-05-24T23:48:03.075903840Z [2024-05-24 23:48:03,075: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:48:03.079156165Z [2024-05-24 23:48:03,078: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:48:03.101750091Z [2024-05-24 23:48:03,101: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:48:03.103041244Z [2024-05-24 23:48:03,102: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:48:03.103055257Z [2024-05-24 23:48:03,102: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:48:03.103173242Z [2024-05-24 23:48:03,103: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:48:03.103199948Z [2024-05-24 23:48:03,103: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:48:03.103522627Z [2024-05-24 23:48:03,103: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:48:03.103531915Z [2024-05-24 23:48:03,103: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:48:03.197598844Z [2024-05-24 23:48:03,196: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:48:03.219424384Z [2024-05-24 23:48:03,219: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:48:03.223013536Z [2024-05-24 23:48:03,222: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:48:03.248961700Z [2024-05-24 23:48:03,248: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:48:03.250179888Z [2024-05-24 23:48:03,249: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:48:03.250194820Z [2024-05-24 23:48:03,250: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:48:03.250349340Z [2024-05-24 23:48:03,250: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:48:03.250374088Z [2024-05-24 23:48:03,250: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:48:03.250677773Z [2024-05-24 23:48:03,250: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:48:03.250771528Z [2024-05-24 23:48:03,250: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:48:03.325549316Z [2024-05-24 23:48:03,323: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:48:05.095316079Z [2024-05-24 23:48:05,094: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f6353490-6afd-44f4-9b70-9583f6383a0f] succeeded in 3.946007638000083s: None 2024-05-24T23:48:05.596624685Z [2024-05-24 23:48:05,595: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7f9ebdb4-072a-465c-a1ba-dd88dc9973d1] succeeded in 4.425622503999875s: None 2024-05-24T23:49:00.597302645Z [2024-05-24 23:49:00,596: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de6d8f32-bebb-440b-8698-5883b237f85a] received 2024-05-24T23:49:00.614625943Z [2024-05-24 23:49:00,614: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0e303e0-d0f5-491b-a477-c9121daea5a2] received 2024-05-24T23:49:00.620901297Z [2024-05-24 23:49:00,620: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0a203fc-d20c-4e13-9a07-04aee88a7c9b] received 2024-05-24T23:49:00.628292189Z [2024-05-24 23:49:00,627: INFO/ForkPoolWorker-1] [a0a203fc-d20c-4e13-9a07-04aee88a7c9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:49:00.635329806Z [2024-05-24 23:49:00,635: INFO/ForkPoolWorker-16] [e0e303e0-d0f5-491b-a477-c9121daea5a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:49:00.636065764Z [2024-05-24 23:49:00,635: INFO/ForkPoolWorker-15] [de6d8f32-bebb-440b-8698-5883b237f85a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:49:00.909367186Z [2024-05-24 23:49:00,905: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:49:00.911534648Z [2024-05-24 23:49:00,908: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:49:00.945151991Z [2024-05-24 23:49:00,941: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:49:01.068025439Z [2024-05-24 23:49:01,067: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-24T23:49:01.072104793Z [2024-05-24 23:49:01,071: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:49:01.100554320Z [2024-05-24 23:49:01,100: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:49:01.102182643Z [2024-05-24 23:49:01,101: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:49:01.102414724Z [2024-05-24 23:49:01,102: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:49:01.102581410Z [2024-05-24 23:49:01,102: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-24T23:49:01.102926776Z [2024-05-24 23:49:01,102: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:49:01.202843401Z [2024-05-24 23:49:01,202: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:49:01.964414203Z [2024-05-24 23:49:01,963: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[de6d8f32-bebb-440b-8698-5883b237f85a] succeeded in 1.3629154260001997s: None 2024-05-24T23:49:02.092701863Z [2024-05-24 23:49:02,092: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:49:02.096206514Z [2024-05-24 23:49:02,095: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:49:02.119848225Z [2024-05-24 23:49:02,119: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:49:02.121388309Z [2024-05-24 23:49:02,121: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:49:02.121538630Z [2024-05-24 23:49:02,121: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:49:02.121776527Z [2024-05-24 23:49:02,121: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:49:02.121984166Z [2024-05-24 23:49:02,121: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:49:02.122397951Z [2024-05-24 23:49:02,122: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:49:02.122579993Z [2024-05-24 23:49:02,122: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:49:02.217318079Z [2024-05-24 23:49:02,209: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:49:02.273918532Z [2024-05-24 23:49:02,273: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:49:02.281123632Z [2024-05-24 23:49:02,280: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:49:02.330188810Z [2024-05-24 23:49:02,329: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:49:02.331286617Z [2024-05-24 23:49:02,331: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:49:02.331347937Z [2024-05-24 23:49:02,331: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:49:02.331437287Z [2024-05-24 23:49:02,331: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:49:02.331475250Z [2024-05-24 23:49:02,331: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:49:02.331759867Z [2024-05-24 23:49:02,331: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:49:02.331802679Z [2024-05-24 23:49:02,331: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:49:02.426371309Z [2024-05-24 23:49:02,426: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:49:03.958260912Z [2024-05-24 23:49:03,957: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e0e303e0-d0f5-491b-a477-c9121daea5a2] succeeded in 3.3410789310000837s: None 2024-05-24T23:49:04.170821136Z [2024-05-24 23:49:04,170: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a0a203fc-d20c-4e13-9a07-04aee88a7c9b] succeeded in 3.54808054599971s: None 2024-05-24T23:50:00.903093232Z [2024-05-24 23:50:00,902: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69703ff4-bd0b-425f-ad56-c454ba295ade] received 2024-05-24T23:50:00.908341911Z [2024-05-24 23:50:00,908: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d50d636-e011-421e-a4ca-a1cefd6e4660] received 2024-05-24T23:50:00.912499817Z [2024-05-24 23:50:00,912: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2e1e36f-d6a2-463c-a912-757bce708494] received 2024-05-24T23:50:00.915739226Z [2024-05-24 23:50:00,915: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b80da0e9-2dd5-4723-a7cd-e6ea28e084b5] received 2024-05-24T23:50:00.917766381Z [2024-05-24 23:50:00,917: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57239779-a5d3-4ae7-bf09-d27e22f2781b] received 2024-05-24T23:50:00.930296089Z [2024-05-24 23:50:00,929: INFO/ForkPoolWorker-16] [7d50d636-e011-421e-a4ca-a1cefd6e4660] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:50:00.934006621Z [2024-05-24 23:50:00,933: INFO/ForkPoolWorker-15] [69703ff4-bd0b-425f-ad56-c454ba295ade] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:50:00.934521281Z [2024-05-24 23:50:00,934: INFO/ForkPoolWorker-1] [a2e1e36f-d6a2-463c-a912-757bce708494] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:50:00.934942294Z [2024-05-24 23:50:00,934: INFO/ForkPoolWorker-2] [b80da0e9-2dd5-4723-a7cd-e6ea28e084b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:50:00.935656967Z [2024-05-24 23:50:00,935: INFO/ForkPoolWorker-3] [57239779-a5d3-4ae7-bf09-d27e22f2781b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:50:01.277671370Z [2024-05-24 23:50:01,273: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:50:01.288992259Z [2024-05-24 23:50:01,284: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:50:01.421450465Z [2024-05-24 23:50:01,416: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:50:01.429397135Z [2024-05-24 23:50:01,424: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:50:01.522693734Z [2024-05-24 23:50:01,517: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:50:01.550884310Z [2024-05-24 23:50:01,550: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-24T23:50:01.551886408Z [2024-05-24 23:50:01,551: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:50:01.555551808Z [2024-05-24 23:50:01,555: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:50:01.620302487Z [2024-05-24 23:50:01,620: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:50:01.623714184Z [2024-05-24 23:50:01,623: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:50:01.624673793Z [2024-05-24 23:50:01,624: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:50:01.625547943Z [2024-05-24 23:50:01,624: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-24T23:50:01.625959477Z [2024-05-24 23:50:01,625: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:50:01.799247417Z [2024-05-24 23:50:01,799: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:50:02.178814905Z [2024-05-24 23:50:02,176: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[57239779-a5d3-4ae7-bf09-d27e22f2781b] succeeded in 1.2541694179999467s: None 2024-05-24T23:50:02.575657754Z [2024-05-24 23:50:02,575: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7d50d636-e011-421e-a4ca-a1cefd6e4660] succeeded in 1.6646416500002488s: None 2024-05-24T23:50:03.019311629Z [2024-05-24 23:50:03,018: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:50:03.023107919Z [2024-05-24 23:50:03,022: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:50:03.076382327Z [2024-05-24 23:50:03,076: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:50:03.082843810Z [2024-05-24 23:50:03,082: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:50:03.085442352Z [2024-05-24 23:50:03,082: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:50:03.085839393Z [2024-05-24 23:50:03,085: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:50:03.087141013Z [2024-05-24 23:50:03,086: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:50:03.088611094Z [2024-05-24 23:50:03,088: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:50:03.088842536Z [2024-05-24 23:50:03,088: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:50:03.126537686Z [2024-05-24 23:50:03,126: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:50:03.133514074Z [2024-05-24 23:50:03,132: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:50:03.169912121Z [2024-05-24 23:50:03,169: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:50:03.171603065Z [2024-05-24 23:50:03,171: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:50:03.171763298Z [2024-05-24 23:50:03,171: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:50:03.172071642Z [2024-05-24 23:50:03,171: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:50:03.172348831Z [2024-05-24 23:50:03,172: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:50:03.174076417Z [2024-05-24 23:50:03,173: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:50:03.174744026Z [2024-05-24 23:50:03,174: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:50:03.193571997Z [2024-05-24 23:50:03,193: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:50:03.257270053Z [2024-05-24 23:50:03,256: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:50:03.292517875Z [2024-05-24 23:50:03,292: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:50:03.295961470Z [2024-05-24 23:50:03,295: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:50:03.317840167Z [2024-05-24 23:50:03,317: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:50:03.318985993Z [2024-05-24 23:50:03,318: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:50:03.319066634Z [2024-05-24 23:50:03,318: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:50:03.319093219Z [2024-05-24 23:50:03,318: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:50:03.319143907Z [2024-05-24 23:50:03,319: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:50:03.319392418Z [2024-05-24 23:50:03,319: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:50:03.319444255Z [2024-05-24 23:50:03,319: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:50:03.405589752Z [2024-05-24 23:50:03,405: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:50:03.974409066Z [2024-05-24 23:50:03,974: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b80da0e9-2dd5-4723-a7cd-e6ea28e084b5] succeeded in 3.0518190020002294s: None 2024-05-24T23:50:04.074417172Z [2024-05-24 23:50:04,074: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1985219a-a48d-420f-a6cb-beb245aa87e3] received 2024-05-24T23:50:04.084811384Z [2024-05-24 23:50:04,084: INFO/ForkPoolWorker-16] [1985219a-a48d-420f-a6cb-beb245aa87e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:50:04.373985354Z [2024-05-24 23:50:04,370: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:50:04.950064877Z [2024-05-24 23:50:04,949: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a2e1e36f-d6a2-463c-a912-757bce708494] succeeded in 4.032001262999984s: None 2024-05-24T23:50:05.062115656Z [2024-05-24 23:50:05,061: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[69703ff4-bd0b-425f-ad56-c454ba295ade] succeeded in 4.154770268999982s: None 2024-05-24T23:50:05.593941222Z [2024-05-24 23:50:05,593: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:50:05.597836396Z [2024-05-24 23:50:05,597: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:50:05.620976511Z [2024-05-24 23:50:05,620: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:50:05.622284907Z [2024-05-24 23:50:05,622: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:50:05.622327321Z [2024-05-24 23:50:05,622: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:50:05.622606283Z [2024-05-24 23:50:05,622: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:50:05.622691425Z [2024-05-24 23:50:05,622: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:50:05.623071053Z [2024-05-24 23:50:05,622: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:50:05.623155175Z [2024-05-24 23:50:05,623: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:50:05.702853646Z [2024-05-24 23:50:05,702: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:50:06.424565256Z [2024-05-24 23:50:06,424: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1985219a-a48d-420f-a6cb-beb245aa87e3] succeeded in 2.3479596579995814s: None 2024-05-24T23:50:06.557489041Z [2024-05-24 23:50:06,553: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9514d9e9-26d5-4fe8-a01b-4cd68ec2a8e7] received 2024-05-24T23:50:06.565451172Z [2024-05-24 23:50:06,561: INFO/ForkPoolWorker-15] [9514d9e9-26d5-4fe8-a01b-4cd68ec2a8e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:50:06.894651939Z [2024-05-24 23:50:06,891: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:50:08.257790585Z [2024-05-24 23:50:08,257: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:50:08.261075152Z [2024-05-24 23:50:08,260: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:50:08.291482284Z [2024-05-24 23:50:08,291: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:50:08.292727998Z [2024-05-24 23:50:08,292: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:50:08.292829123Z [2024-05-24 23:50:08,292: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:50:08.293070322Z [2024-05-24 23:50:08,292: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:50:08.293155253Z [2024-05-24 23:50:08,292: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:50:08.293401942Z [2024-05-24 23:50:08,293: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:50:08.293491301Z [2024-05-24 23:50:08,293: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:50:08.406287841Z [2024-05-24 23:50:08,405: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:50:08.954679342Z [2024-05-24 23:50:08,954: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9514d9e9-26d5-4fe8-a01b-4cd68ec2a8e7] succeeded in 2.399208825000187s: None 2024-05-24T23:50:09.275918376Z [2024-05-24 23:50:09,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86eaa73d-ad16-4809-befb-646fad5f481d] received 2024-05-24T23:50:09.289510215Z [2024-05-24 23:50:09,289: INFO/ForkPoolWorker-15] [86eaa73d-ad16-4809-befb-646fad5f481d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:50:09.561414183Z [2024-05-24 23:50:09,558: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:50:10.605426639Z [2024-05-24 23:50:10,604: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:50:10.608467920Z [2024-05-24 23:50:10,607: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:50:10.631893738Z [2024-05-24 23:50:10,631: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:50:10.633563979Z [2024-05-24 23:50:10,633: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:50:10.633611368Z [2024-05-24 23:50:10,633: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:50:10.633849597Z [2024-05-24 23:50:10,633: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:50:10.633869870Z [2024-05-24 23:50:10,633: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:50:10.634263143Z [2024-05-24 23:50:10,634: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:50:10.634383661Z [2024-05-24 23:50:10,634: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:50:10.738452025Z [2024-05-24 23:50:10,738: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:50:11.415005360Z [2024-05-24 23:50:11,414: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[86eaa73d-ad16-4809-befb-646fad5f481d] succeeded in 2.131276562000039s: None 2024-05-24T23:51:01.050914087Z [2024-05-24 23:51:01,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ef56d99-86f8-4fb4-98e9-247649cef617] received 2024-05-24T23:51:01.058036779Z [2024-05-24 23:51:01,057: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22632028-3eed-4c61-9108-e9d00ecde399] received 2024-05-24T23:51:01.060894552Z [2024-05-24 23:51:01,060: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb72fd59-3384-45d1-9b75-93ecb2157b99] received 2024-05-24T23:51:01.066346926Z [2024-05-24 23:51:01,066: INFO/ForkPoolWorker-15] [7ef56d99-86f8-4fb4-98e9-247649cef617] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:51:01.074914240Z [2024-05-24 23:51:01,074: INFO/ForkPoolWorker-1] [cb72fd59-3384-45d1-9b75-93ecb2157b99] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:51:01.077966094Z [2024-05-24 23:51:01,077: INFO/ForkPoolWorker-16] [22632028-3eed-4c61-9108-e9d00ecde399] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:51:01.379559173Z [2024-05-24 23:51:01,370: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:51:01.379580280Z [2024-05-24 23:51:01,372: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:51:01.449705300Z [2024-05-24 23:51:01,446: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:51:01.559535225Z [2024-05-24 23:51:01,559: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-24T23:51:01.564435794Z [2024-05-24 23:51:01,563: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:51:01.614430959Z [2024-05-24 23:51:01,614: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:51:01.615489098Z [2024-05-24 23:51:01,615: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:51:01.615699343Z [2024-05-24 23:51:01,615: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:51:01.615857474Z [2024-05-24 23:51:01,615: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-24T23:51:01.616253356Z [2024-05-24 23:51:01,616: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:51:01.753466224Z [2024-05-24 23:51:01,753: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:51:02.551551202Z [2024-05-24 23:51:02,548: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7ef56d99-86f8-4fb4-98e9-247649cef617] succeeded in 1.4941493919995992s: None 2024-05-24T23:51:02.896332509Z [2024-05-24 23:51:02,895: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:51:02.899411136Z [2024-05-24 23:51:02,898: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:51:02.939224959Z [2024-05-24 23:51:02,938: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:51:02.941320137Z [2024-05-24 23:51:02,940: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:51:02.941591616Z [2024-05-24 23:51:02,941: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:51:02.941830157Z [2024-05-24 23:51:02,941: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:51:02.941945187Z [2024-05-24 23:51:02,941: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:51:02.942584868Z [2024-05-24 23:51:02,942: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:51:02.942618949Z [2024-05-24 23:51:02,942: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:51:03.023396432Z [2024-05-24 23:51:03,022: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:51:03.026871215Z [2024-05-24 23:51:03,026: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:51:03.036420160Z [2024-05-24 23:51:03,036: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:51:03.054661547Z [2024-05-24 23:51:03,054: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:51:03.056144479Z [2024-05-24 23:51:03,055: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:51:03.056213987Z [2024-05-24 23:51:03,056: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:51:03.056336357Z [2024-05-24 23:51:03,056: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:51:03.056350055Z [2024-05-24 23:51:03,056: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:51:03.056641828Z [2024-05-24 23:51:03,056: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:51:03.056706944Z [2024-05-24 23:51:03,056: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:51:03.166593755Z [2024-05-24 23:51:03,166: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:51:05.055198762Z [2024-05-24 23:51:05,054: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cb72fd59-3384-45d1-9b75-93ecb2157b99] succeeded in 3.9923194410002907s: None 2024-05-24T23:51:05.556001556Z [2024-05-24 23:51:05,555: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[22632028-3eed-4c61-9108-e9d00ecde399] succeeded in 4.492482509000183s: None 2024-05-24T23:52:00.258667059Z [2024-05-24 23:52:00,258: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ce45f0c-7e40-4ed9-a51e-f60642d6efd5] received 2024-05-24T23:52:00.260585615Z [2024-05-24 23:52:00,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb6e9e90-8043-446a-9b18-aaf1c3b8cddb] received 2024-05-24T23:52:00.268231310Z [2024-05-24 23:52:00,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e65df6ef-9b08-4812-a5b3-2059d1675807] received 2024-05-24T23:52:00.271285857Z [2024-05-24 23:52:00,270: INFO/ForkPoolWorker-16] [cb6e9e90-8043-446a-9b18-aaf1c3b8cddb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:52:00.282367365Z [2024-05-24 23:52:00,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1293c2cb-0e6e-48e8-8429-21da9ae9316c] received 2024-05-24T23:52:00.283642877Z [2024-05-24 23:52:00,283: INFO/ForkPoolWorker-1] [e65df6ef-9b08-4812-a5b3-2059d1675807] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:52:00.285458418Z [2024-05-24 23:52:00,284: INFO/ForkPoolWorker-15] [6ce45f0c-7e40-4ed9-a51e-f60642d6efd5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:52:00.303641770Z [2024-05-24 23:52:00,303: INFO/ForkPoolWorker-2] [1293c2cb-0e6e-48e8-8429-21da9ae9316c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:52:00.591280085Z [2024-05-24 23:52:00,587: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:52:00.634583882Z [2024-05-24 23:52:00,629: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:52:00.653264642Z [2024-05-24 23:52:00,649: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:52:00.697383773Z [2024-05-24 23:52:00,693: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:52:00.894913086Z [2024-05-24 23:52:00,894: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-24T23:52:00.900628093Z [2024-05-24 23:52:00,900: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:52:00.983807464Z [2024-05-24 23:52:00,983: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:52:00.985039669Z [2024-05-24 23:52:00,984: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:52:00.985306749Z [2024-05-24 23:52:00,984: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:52:00.987460824Z [2024-05-24 23:52:00,985: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-24T23:52:00.988082660Z [2024-05-24 23:52:00,987: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:52:01.030621061Z [2024-05-24 23:52:01,030: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:52:01.144786811Z [2024-05-24 23:52:01,144: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:52:01.745903930Z [2024-05-24 23:52:01,745: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6ce45f0c-7e40-4ed9-a51e-f60642d6efd5] succeeded in 1.4830971420001333s: None 2024-05-24T23:52:01.904956389Z [2024-05-24 23:52:01,904: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cb6e9e90-8043-446a-9b18-aaf1c3b8cddb] succeeded in 1.6417648259998714s: None 2024-05-24T23:52:02.206195504Z [2024-05-24 23:52:02,199: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:52:02.211457524Z [2024-05-24 23:52:02,207: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:52:02.252650672Z [2024-05-24 23:52:02,252: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:52:02.253884806Z [2024-05-24 23:52:02,253: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:52:02.254009444Z [2024-05-24 23:52:02,253: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:52:02.254240433Z [2024-05-24 23:52:02,253: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:52:02.254348218Z [2024-05-24 23:52:02,254: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:52:02.254716350Z [2024-05-24 23:52:02,254: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:52:02.254854920Z [2024-05-24 23:52:02,254: INFO/ForkPoolWorker-2] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:52:02.318002620Z [2024-05-24 23:52:02,317: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:52:02.331756618Z [2024-05-24 23:52:02,331: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:52:02.351906546Z [2024-05-24 23:52:02,351: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:52:02.352311115Z [2024-05-24 23:52:02,352: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:52:02.353784334Z [2024-05-24 23:52:02,353: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:52:02.353903534Z [2024-05-24 23:52:02,353: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:52:02.354079689Z [2024-05-24 23:52:02,353: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:52:02.354339221Z [2024-05-24 23:52:02,354: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:52:02.354563689Z [2024-05-24 23:52:02,354: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:52:02.354646853Z [2024-05-24 23:52:02,354: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:52:02.446747345Z [2024-05-24 23:52:02,446: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:52:04.046906847Z [2024-05-24 23:52:04,046: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1293c2cb-0e6e-48e8-8429-21da9ae9316c] succeeded in 3.7604337509997094s: None 2024-05-24T23:52:04.628355353Z [2024-05-24 23:52:04,627: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e65df6ef-9b08-4812-a5b3-2059d1675807] succeeded in 4.357992914000079s: None 2024-05-24T23:53:01.047411145Z [2024-05-24 23:53:01,047: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[688046e7-d7c8-4484-b04e-d3ac84bfdb52] received 2024-05-24T23:53:01.060130803Z [2024-05-24 23:53:01,059: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2449ab4a-caa4-49fb-a94d-3eb5094c1926] received 2024-05-24T23:53:01.061492873Z [2024-05-24 23:53:01,061: INFO/ForkPoolWorker-15] [688046e7-d7c8-4484-b04e-d3ac84bfdb52] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:53:01.072552607Z [2024-05-24 23:53:01,072: INFO/ForkPoolWorker-16] [2449ab4a-caa4-49fb-a94d-3eb5094c1926] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:53:01.078228344Z [2024-05-24 23:53:01,077: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30ec3c84-acbe-4e72-927d-7342098f54a7] received 2024-05-24T23:53:01.112160915Z [2024-05-24 23:53:01,110: INFO/ForkPoolWorker-1] [30ec3c84-acbe-4e72-927d-7342098f54a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:53:01.374411414Z [2024-05-24 23:53:01,366: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:53:01.403417568Z [2024-05-24 23:53:01,399: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:53:01.496148709Z [2024-05-24 23:53:01,492: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:53:01.543353842Z [2024-05-24 23:53:01,542: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-24T23:53:01.549599661Z [2024-05-24 23:53:01,548: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:53:01.570877499Z [2024-05-24 23:53:01,570: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:53:01.572065221Z [2024-05-24 23:53:01,571: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:53:01.572223775Z [2024-05-24 23:53:01,572: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:53:01.572865936Z [2024-05-24 23:53:01,572: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-24T23:53:01.573186262Z [2024-05-24 23:53:01,572: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:53:01.658841220Z [2024-05-24 23:53:01,658: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:53:02.357613841Z [2024-05-24 23:53:02,355: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[688046e7-d7c8-4484-b04e-d3ac84bfdb52] succeeded in 1.3011558759999389s: None 2024-05-24T23:53:02.739616273Z [2024-05-24 23:53:02,739: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:53:02.743801373Z [2024-05-24 23:53:02,743: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:53:02.786473245Z [2024-05-24 23:53:02,786: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:53:02.788026674Z [2024-05-24 23:53:02,787: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:53:02.788193010Z [2024-05-24 23:53:02,788: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:53:02.788470875Z [2024-05-24 23:53:02,788: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:53:02.788620823Z [2024-05-24 23:53:02,788: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:53:02.788981785Z [2024-05-24 23:53:02,788: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:53:02.789115471Z [2024-05-24 23:53:02,788: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:53:02.811969757Z [2024-05-24 23:53:02,811: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:53:02.815350340Z [2024-05-24 23:53:02,814: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:53:02.840783953Z [2024-05-24 23:53:02,840: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:53:02.842430001Z [2024-05-24 23:53:02,842: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:53:02.842456401Z [2024-05-24 23:53:02,842: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:53:02.842571881Z [2024-05-24 23:53:02,842: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:53:02.842593269Z [2024-05-24 23:53:02,842: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:53:02.843001935Z [2024-05-24 23:53:02,842: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:53:02.843081901Z [2024-05-24 23:53:02,842: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:53:02.891165818Z [2024-05-24 23:53:02,890: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:53:02.944143754Z [2024-05-24 23:53:02,943: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:53:04.670103430Z [2024-05-24 23:53:04,669: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2449ab4a-caa4-49fb-a94d-3eb5094c1926] succeeded in 3.6071367209997334s: None 2024-05-24T23:53:05.097351174Z [2024-05-24 23:53:05,096: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[30ec3c84-acbe-4e72-927d-7342098f54a7] succeeded in 3.995604121999804s: None 2024-05-24T23:54:00.792322083Z [2024-05-24 23:54:00,791: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9164189-b884-4fcf-806f-d683b45594eb] received 2024-05-24T23:54:00.794025235Z [2024-05-24 23:54:00,793: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[092c23ef-96eb-42a8-beac-6c7327a56102] received 2024-05-24T23:54:00.796429083Z [2024-05-24 23:54:00,796: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb33fd33-6470-4164-90be-d5b88fb2faf7] received 2024-05-24T23:54:00.801571930Z [2024-05-24 23:54:00,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[370b1b92-c3b7-4509-b78e-383859e14f2a] received 2024-05-24T23:54:00.805830402Z [2024-05-24 23:54:00,805: INFO/ForkPoolWorker-15] [d9164189-b884-4fcf-806f-d683b45594eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:54:00.812172981Z [2024-05-24 23:54:00,811: INFO/ForkPoolWorker-16] [092c23ef-96eb-42a8-beac-6c7327a56102] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:54:00.818683696Z [2024-05-24 23:54:00,818: INFO/ForkPoolWorker-1] [cb33fd33-6470-4164-90be-d5b88fb2faf7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:54:00.819050607Z [2024-05-24 23:54:00,818: INFO/ForkPoolWorker-2] [370b1b92-c3b7-4509-b78e-383859e14f2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:54:01.168007131Z [2024-05-24 23:54:01,164: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:54:01.184884062Z [2024-05-24 23:54:01,180: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:54:01.185734796Z [2024-05-24 23:54:01,181: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:54:01.243307833Z [2024-05-24 23:54:01,238: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:54:01.444898119Z [2024-05-24 23:54:01,444: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-24T23:54:01.449437879Z [2024-05-24 23:54:01,448: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:54:01.485975848Z [2024-05-24 23:54:01,485: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:54:01.488613742Z [2024-05-24 23:54:01,488: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:54:01.488897148Z [2024-05-24 23:54:01,488: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:54:01.489093422Z [2024-05-24 23:54:01,488: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-24T23:54:01.489583739Z [2024-05-24 23:54:01,489: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:54:01.567093980Z [2024-05-24 23:54:01,566: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:54:01.588857826Z [2024-05-24 23:54:01,588: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:54:02.158572023Z [2024-05-24 23:54:02,158: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cb33fd33-6470-4164-90be-d5b88fb2faf7] succeeded in 1.3511471719994006s: None 2024-05-24T23:54:02.164309179Z [2024-05-24 23:54:02,163: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d9164189-b884-4fcf-806f-d683b45594eb] succeeded in 1.366384509999989s: None 2024-05-24T23:54:02.555891731Z [2024-05-24 23:54:02,555: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:54:02.559409402Z [2024-05-24 23:54:02,558: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:54:02.591055305Z [2024-05-24 23:54:02,590: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:54:02.594533779Z [2024-05-24 23:54:02,594: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:54:02.594948539Z [2024-05-24 23:54:02,594: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:54:02.598682029Z [2024-05-24 23:54:02,598: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:54:02.598786928Z [2024-05-24 23:54:02,598: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:54:02.598949530Z [2024-05-24 23:54:02,598: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:54:02.599088274Z [2024-05-24 23:54:02,598: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:54:02.599509146Z [2024-05-24 23:54:02,599: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:54:02.599633623Z [2024-05-24 23:54:02,599: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:54:02.622218885Z [2024-05-24 23:54:02,621: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:54:02.623894925Z [2024-05-24 23:54:02,623: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:54:02.623941467Z [2024-05-24 23:54:02,623: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:54:02.624091309Z [2024-05-24 23:54:02,623: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:54:02.624137359Z [2024-05-24 23:54:02,624: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:54:02.624452689Z [2024-05-24 23:54:02,624: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:54:02.624497355Z [2024-05-24 23:54:02,624: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:54:02.725043464Z [2024-05-24 23:54:02,724: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:54:02.735676534Z [2024-05-24 23:54:02,735: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:54:04.357851940Z [2024-05-24 23:54:04,356: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[092c23ef-96eb-42a8-beac-6c7327a56102] succeeded in 3.55927465700006s: None 2024-05-24T23:54:04.654366312Z [2024-05-24 23:54:04,653: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[370b1b92-c3b7-4509-b78e-383859e14f2a] succeeded in 3.847341064999455s: None 2024-05-24T23:55:01.032432309Z [2024-05-24 23:55:01,031: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf6ec85e-1c83-4cb2-83f7-ab8f49a972c4] received 2024-05-24T23:55:01.040228314Z [2024-05-24 23:55:01,039: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58f3ce2b-8134-4dce-ac48-68aad687a293] received 2024-05-24T23:55:01.054338664Z [2024-05-24 23:55:01,054: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f16da957-9612-48b2-bb0a-82e5d90d9655] received 2024-05-24T23:55:01.055207044Z [2024-05-24 23:55:01,054: INFO/ForkPoolWorker-15] [bf6ec85e-1c83-4cb2-83f7-ab8f49a972c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:55:01.065348572Z [2024-05-24 23:55:01,065: INFO/ForkPoolWorker-16] [58f3ce2b-8134-4dce-ac48-68aad687a293] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:55:01.069082892Z [2024-05-24 23:55:01,068: INFO/ForkPoolWorker-1] [f16da957-9612-48b2-bb0a-82e5d90d9655] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:55:01.069478881Z [2024-05-24 23:55:01,069: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4bb52d68-e3ec-4e52-8cc1-dded7dfa2ecf] received 2024-05-24T23:55:01.081803563Z [2024-05-24 23:55:01,081: INFO/ForkPoolWorker-2] [4bb52d68-e3ec-4e52-8cc1-dded7dfa2ecf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:55:01.381963698Z [2024-05-24 23:55:01,377: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:55:01.432024517Z [2024-05-24 23:55:01,428: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:55:01.438697882Z [2024-05-24 23:55:01,434: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:55:01.500347895Z [2024-05-24 23:55:01,496: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:55:01.610854581Z [2024-05-24 23:55:01,609: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-24T23:55:01.616492870Z [2024-05-24 23:55:01,616: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:55:01.680777503Z [2024-05-24 23:55:01,680: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:55:01.682033973Z [2024-05-24 23:55:01,681: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:55:01.682341153Z [2024-05-24 23:55:01,681: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:55:01.682473033Z [2024-05-24 23:55:01,682: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-24T23:55:01.682728012Z [2024-05-24 23:55:01,682: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:55:01.794178952Z [2024-05-24 23:55:01,793: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:55:02.704016321Z [2024-05-24 23:55:02,703: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4bb52d68-e3ec-4e52-8cc1-dded7dfa2ecf] succeeded in 1.631469724999988s: None 2024-05-24T23:55:02.851283864Z [2024-05-24 23:55:02,850: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:55:02.855693779Z [2024-05-24 23:55:02,855: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:55:02.881669355Z [2024-05-24 23:55:02,881: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:55:02.882930853Z [2024-05-24 23:55:02,882: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:55:02.882948539Z [2024-05-24 23:55:02,882: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:55:02.883026001Z [2024-05-24 23:55:02,882: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:55:02.883093366Z [2024-05-24 23:55:02,883: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:55:02.883266115Z [2024-05-24 23:55:02,883: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:55:02.883281089Z [2024-05-24 23:55:02,883: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:55:02.907236924Z [2024-05-24 23:55:02,906: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:55:02.910765571Z [2024-05-24 23:55:02,910: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:55:02.935117060Z [2024-05-24 23:55:02,934: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:55:02.936589333Z [2024-05-24 23:55:02,936: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:55:02.936781446Z [2024-05-24 23:55:02,936: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:55:02.936994699Z [2024-05-24 23:55:02,936: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:55:02.937128977Z [2024-05-24 23:55:02,936: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:55:02.937516839Z [2024-05-24 23:55:02,937: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:55:02.938013874Z [2024-05-24 23:55:02,937: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:55:02.981932095Z [2024-05-24 23:55:02,981: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:55:03.011410873Z [2024-05-24 23:55:03,011: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:55:03.038789945Z [2024-05-24 23:55:03,038: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:55:03.042305284Z [2024-05-24 23:55:03,041: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:55:03.062117151Z [2024-05-24 23:55:03,061: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:55:03.064544565Z [2024-05-24 23:55:03,064: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:55:03.064623481Z [2024-05-24 23:55:03,064: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:55:03.064777013Z [2024-05-24 23:55:03,064: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:55:03.064855168Z [2024-05-24 23:55:03,064: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:55:03.065122205Z [2024-05-24 23:55:03,065: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:55:03.065248227Z [2024-05-24 23:55:03,065: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:55:03.175615239Z [2024-05-24 23:55:03,175: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:55:03.578579931Z [2024-05-24 23:55:03,578: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bf6ec85e-1c83-4cb2-83f7-ab8f49a972c4] succeeded in 2.5357656979995227s: None 2024-05-24T23:55:04.412038058Z [2024-05-24 23:55:04,411: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6cf49fdc-dd8b-44b4-98ca-01cb3e4333ee] received 2024-05-24T23:55:04.423634038Z [2024-05-24 23:55:04,423: INFO/ForkPoolWorker-15] [6cf49fdc-dd8b-44b4-98ca-01cb3e4333ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:55:04.728473680Z [2024-05-24 23:55:04,728: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f16da957-9612-48b2-bb0a-82e5d90d9655] succeeded in 3.665748440999778s: None 2024-05-24T23:55:04.748919255Z [2024-05-24 23:55:04,746: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:55:04.984802344Z [2024-05-24 23:55:04,984: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[58f3ce2b-8134-4dce-ac48-68aad687a293] succeeded in 3.937430551000034s: None 2024-05-24T23:55:05.906041209Z [2024-05-24 23:55:05,905: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:55:05.909412936Z [2024-05-24 23:55:05,908: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:55:05.936884991Z [2024-05-24 23:55:05,936: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:55:05.938888277Z [2024-05-24 23:55:05,938: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:55:05.939067390Z [2024-05-24 23:55:05,938: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:55:05.939358619Z [2024-05-24 23:55:05,938: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:55:05.939515659Z [2024-05-24 23:55:05,939: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:55:05.939945409Z [2024-05-24 23:55:05,939: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:55:05.940197852Z [2024-05-24 23:55:05,939: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:55:06.055920280Z [2024-05-24 23:55:06,049: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:55:06.776213760Z [2024-05-24 23:55:06,774: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6cf49fdc-dd8b-44b4-98ca-01cb3e4333ee] succeeded in 2.357213596999827s: None 2024-05-24T23:55:07.179225559Z [2024-05-24 23:55:07,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7921660-f623-491a-961b-941ecc4659fd] received 2024-05-24T23:55:07.196941006Z [2024-05-24 23:55:07,196: INFO/ForkPoolWorker-15] [f7921660-f623-491a-961b-941ecc4659fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-24T23:55:07.496535498Z [2024-05-24 23:55:07,493: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:55:08.731970864Z [2024-05-24 23:55:08,731: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:55:08.735255475Z [2024-05-24 23:55:08,734: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:55:08.784641358Z [2024-05-24 23:55:08,784: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:55:08.786786081Z [2024-05-24 23:55:08,786: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:55:08.787200716Z [2024-05-24 23:55:08,787: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:55:08.787796264Z [2024-05-24 23:55:08,787: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:55:08.788234125Z [2024-05-24 23:55:08,788: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:55:08.788904797Z [2024-05-24 23:55:08,788: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:55:08.789161578Z [2024-05-24 23:55:08,789: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:55:08.886357789Z [2024-05-24 23:55:08,885: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:55:09.520233272Z [2024-05-24 23:55:09,519: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f7921660-f623-491a-961b-941ecc4659fd] succeeded in 2.3384619039998142s: None 2024-05-24T23:55:09.532081097Z [2024-05-24 23:55:09,531: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab82a493-ad6a-4b5e-850a-208f98ff21b9] received 2024-05-24T23:55:09.539968365Z [2024-05-24 23:55:09,539: INFO/ForkPoolWorker-15] [ab82a493-ad6a-4b5e-850a-208f98ff21b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-24T23:55:09.798107441Z [2024-05-24 23:55:09,795: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-24T23:55:10.941376318Z [2024-05-24 23:55:10,935: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:55:10.941460506Z [2024-05-24 23:55:10,938: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:55:10.974581626Z [2024-05-24 23:55:10,974: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:55:10.978723689Z [2024-05-24 23:55:10,978: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:55:10.978753577Z [2024-05-24 23:55:10,978: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:55:10.978892621Z [2024-05-24 23:55:10,978: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:55:10.978976289Z [2024-05-24 23:55:10,978: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:55:10.979207641Z [2024-05-24 23:55:10,979: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-24T23:55:10.979266706Z [2024-05-24 23:55:10,979: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:55:11.064633780Z [2024-05-24 23:55:11,064: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:55:11.704898145Z [2024-05-24 23:55:11,704: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ab82a493-ad6a-4b5e-850a-208f98ff21b9] succeeded in 2.168903327999942s: None 2024-05-24T23:56:01.240412450Z [2024-05-24 23:56:01,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[757737dc-93af-4375-81d0-fa2bc13f8570] received 2024-05-24T23:56:01.246783451Z [2024-05-24 23:56:01,246: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90ea3917-da3b-462d-84c4-d7ba7752d4e1] received 2024-05-24T23:56:01.249881502Z [2024-05-24 23:56:01,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29f04b18-21df-4bd0-b8dd-06e491e578f0] received 2024-05-24T23:56:01.252041593Z [2024-05-24 23:56:01,251: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aeece0c6-081e-47bd-a95e-b1338292bd95] received 2024-05-24T23:56:01.264306414Z [2024-05-24 23:56:01,263: INFO/ForkPoolWorker-16] [90ea3917-da3b-462d-84c4-d7ba7752d4e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:56:01.268805196Z [2024-05-24 23:56:01,268: INFO/ForkPoolWorker-2] [aeece0c6-081e-47bd-a95e-b1338292bd95] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:56:01.273870583Z [2024-05-24 23:56:01,273: INFO/ForkPoolWorker-1] [29f04b18-21df-4bd0-b8dd-06e491e578f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:56:01.274848646Z [2024-05-24 23:56:01,274: INFO/ForkPoolWorker-15] [757737dc-93af-4375-81d0-fa2bc13f8570] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:56:01.641599630Z [2024-05-24 23:56:01,637: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:56:01.777403631Z [2024-05-24 23:56:01,762: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:56:01.824811738Z [2024-05-24 23:56:01,817: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:56:01.882856846Z [2024-05-24 23:56:01,879: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:56:01.995682589Z [2024-05-24 23:56:01,994: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:56:02.156295784Z [2024-05-24 23:56:02,155: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-24T23:56:02.180952130Z [2024-05-24 23:56:02,180: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:56:02.342088560Z [2024-05-24 23:56:02,341: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:56:02.345284788Z [2024-05-24 23:56:02,345: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:56:02.345627852Z [2024-05-24 23:56:02,345: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:56:02.345760026Z [2024-05-24 23:56:02,345: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-24T23:56:02.346138578Z [2024-05-24 23:56:02,345: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:56:02.481609903Z [2024-05-24 23:56:02,481: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:56:02.731581322Z [2024-05-24 23:56:02,731: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[757737dc-93af-4375-81d0-fa2bc13f8570] succeeded in 1.4857761829998708s: None 2024-05-24T23:56:03.189395558Z [2024-05-24 23:56:03,188: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[29f04b18-21df-4bd0-b8dd-06e491e578f0] succeeded in 1.937252437999632s: None 2024-05-24T23:56:03.353077706Z [2024-05-24 23:56:03,352: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:56:03.356125828Z [2024-05-24 23:56:03,355: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:56:03.379951319Z [2024-05-24 23:56:03,379: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:56:03.381614090Z [2024-05-24 23:56:03,381: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:56:03.381649594Z [2024-05-24 23:56:03,381: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:56:03.381934152Z [2024-05-24 23:56:03,381: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:56:03.382104522Z [2024-05-24 23:56:03,381: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:56:03.382498751Z [2024-05-24 23:56:03,382: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:56:03.382717868Z [2024-05-24 23:56:03,382: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:56:03.478156253Z [2024-05-24 23:56:03,477: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:56:03.617591750Z [2024-05-24 23:56:03,617: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:56:03.620851400Z [2024-05-24 23:56:03,620: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:56:03.640971682Z [2024-05-24 23:56:03,640: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:56:03.642180149Z [2024-05-24 23:56:03,641: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:56:03.642191312Z [2024-05-24 23:56:03,642: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:56:03.642332346Z [2024-05-24 23:56:03,642: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:56:03.642341487Z [2024-05-24 23:56:03,642: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:56:03.642681076Z [2024-05-24 23:56:03,642: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:56:03.642684577Z [2024-05-24 23:56:03,642: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:56:03.736990733Z [2024-05-24 23:56:03,736: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:56:05.329278078Z [2024-05-24 23:56:05,328: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[90ea3917-da3b-462d-84c4-d7ba7752d4e1] succeeded in 4.078129357000762s: None 2024-05-24T23:56:05.461116587Z [2024-05-24 23:56:05,460: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[aeece0c6-081e-47bd-a95e-b1338292bd95] succeeded in 4.2059386150003775s: None 2024-05-24T23:57:00.210080494Z [2024-05-24 23:57:00,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0c8a1b9-ed7d-4d4c-b6f6-b4c2a61e09d9] received 2024-05-24T23:57:00.215210810Z [2024-05-24 23:57:00,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bfda0ea9-bf69-4c54-91ab-57805b0e073a] received 2024-05-24T23:57:00.221972053Z [2024-05-24 23:57:00,221: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46b076e7-a3b2-40e4-b024-f0283323dc97] received 2024-05-24T23:57:00.223824487Z [2024-05-24 23:57:00,223: INFO/ForkPoolWorker-15] [e0c8a1b9-ed7d-4d4c-b6f6-b4c2a61e09d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:57:00.228586509Z [2024-05-24 23:57:00,228: INFO/ForkPoolWorker-16] [bfda0ea9-bf69-4c54-91ab-57805b0e073a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:57:00.232183556Z [2024-05-24 23:57:00,231: INFO/ForkPoolWorker-1] [46b076e7-a3b2-40e4-b024-f0283323dc97] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:57:00.537992515Z [2024-05-24 23:57:00,534: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:57:00.543014436Z [2024-05-24 23:57:00,539: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:57:00.561812867Z [2024-05-24 23:57:00,557: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:57:00.696466939Z [2024-05-24 23:57:00,696: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-24T23:57:00.700476727Z [2024-05-24 23:57:00,700: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:57:00.722196589Z [2024-05-24 23:57:00,721: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:57:00.723916347Z [2024-05-24 23:57:00,723: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:57:00.724221153Z [2024-05-24 23:57:00,723: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:57:00.724413414Z [2024-05-24 23:57:00,724: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-24T23:57:00.724869529Z [2024-05-24 23:57:00,724: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:57:00.811528490Z [2024-05-24 23:57:00,811: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:57:01.424850746Z [2024-05-24 23:57:01,424: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e0c8a1b9-ed7d-4d4c-b6f6-b4c2a61e09d9] succeeded in 1.2131858809998448s: None 2024-05-24T23:57:01.714003560Z [2024-05-24 23:57:01,713: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:57:01.717328775Z [2024-05-24 23:57:01,716: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:57:01.738328374Z [2024-05-24 23:57:01,738: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:57:01.739679369Z [2024-05-24 23:57:01,739: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:57:01.739880147Z [2024-05-24 23:57:01,739: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:57:01.740098867Z [2024-05-24 23:57:01,739: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:57:01.740175265Z [2024-05-24 23:57:01,740: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:57:01.740778968Z [2024-05-24 23:57:01,740: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:57:01.740866341Z [2024-05-24 23:57:01,740: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:57:01.801345393Z [2024-05-24 23:57:01,800: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-24T23:57:01.804334609Z [2024-05-24 23:57:01,803: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:57:01.828107247Z [2024-05-24 23:57:01,827: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:57:01.831203549Z [2024-05-24 23:57:01,830: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:57:01.831396903Z [2024-05-24 23:57:01,831: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:57:01.831789234Z [2024-05-24 23:57:01,831: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:57:01.832146289Z [2024-05-24 23:57:01,831: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-24T23:57:01.832246061Z [2024-05-24 23:57:01,832: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:57:01.833319846Z [2024-05-24 23:57:01,832: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:57:01.833578936Z [2024-05-24 23:57:01,833: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:57:01.930843552Z [2024-05-24 23:57:01,930: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:57:03.419350513Z [2024-05-24 23:57:03,418: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bfda0ea9-bf69-4c54-91ab-57805b0e073a] succeeded in 3.2016713220000383s: None 2024-05-24T23:57:03.820713248Z [2024-05-24 23:57:03,820: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[46b076e7-a3b2-40e4-b024-f0283323dc97] succeeded in 3.595097175999399s: None 2024-05-24T23:58:00.948656168Z [2024-05-24 23:58:00,948: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c622b816-cd99-4ea1-ad59-8c90c15f7ba5] received 2024-05-24T23:58:00.951357927Z [2024-05-24 23:58:00,951: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9782d731-54fd-4808-8429-572536a60fc6] received 2024-05-24T23:58:00.953864648Z [2024-05-24 23:58:00,952: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[557c1713-35e4-401c-b260-66423eae7943] received 2024-05-24T23:58:00.955049790Z [2024-05-24 23:58:00,954: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59b4700a-654f-46d5-a53f-75816b19a1b6] received 2024-05-24T23:58:00.966483451Z [2024-05-24 23:58:00,966: INFO/ForkPoolWorker-15] [c622b816-cd99-4ea1-ad59-8c90c15f7ba5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-24T23:58:00.967825498Z [2024-05-24 23:58:00,967: INFO/ForkPoolWorker-1] [557c1713-35e4-401c-b260-66423eae7943] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:58:00.974053154Z [2024-05-24 23:58:00,973: INFO/ForkPoolWorker-2] [59b4700a-654f-46d5-a53f-75816b19a1b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:58:00.978216343Z [2024-05-24 23:58:00,977: INFO/ForkPoolWorker-16] [9782d731-54fd-4808-8429-572536a60fc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:58:01.265404001Z [2024-05-24 23:58:01,261: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:58:01.278506742Z [2024-05-24 23:58:01,275: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:58:01.409427861Z [2024-05-24 23:58:01,384: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-24T23:58:01.440268070Z [2024-05-24 23:58:01,433: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:58:01.640335671Z [2024-05-24 23:58:01,639: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-24T23:58:01.645933267Z [2024-05-24 23:58:01,645: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:58:01.684466995Z [2024-05-24 23:58:01,684: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:58:01.695227758Z [2024-05-24 23:58:01,695: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:58:01.696510936Z [2024-05-24 23:58:01,696: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:58:01.696665098Z [2024-05-24 23:58:01,696: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:58:01.696731959Z [2024-05-24 23:58:01,696: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-24T23:58:01.696974427Z [2024-05-24 23:58:01,696: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:58:01.843753205Z [2024-05-24 23:58:01,843: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:58:02.616075072Z [2024-05-24 23:58:02,615: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c622b816-cd99-4ea1-ad59-8c90c15f7ba5] succeeded in 1.6652571140002692s: None 2024-05-24T23:58:02.646850649Z [2024-05-24 23:58:02,646: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-24T23:58:02.650224718Z [2024-05-24 23:58:02,649: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:58:02.670012165Z [2024-05-24 23:58:02,669: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-24T23:58:02.674209053Z [2024-05-24 23:58:02,673: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:58:02.674293348Z [2024-05-24 23:58:02,674: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:58:02.674460823Z [2024-05-24 23:58:02,674: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:58:02.674532336Z [2024-05-24 23:58:02,674: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-24T23:58:02.674797847Z [2024-05-24 23:58:02,674: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:58:02.674878039Z [2024-05-24 23:58:02,674: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:58:02.742797551Z [2024-05-24 23:58:02,742: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[557c1713-35e4-401c-b260-66423eae7943] succeeded in 1.7878309049992822s: None 2024-05-24T23:58:02.797862479Z [2024-05-24 23:58:02,797: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:58:03.035193672Z [2024-05-24 23:58:03,034: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:58:03.038741375Z [2024-05-24 23:58:03,038: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:58:03.064138361Z [2024-05-24 23:58:03,063: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:58:03.065750797Z [2024-05-24 23:58:03,065: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:58:03.065907609Z [2024-05-24 23:58:03,065: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:58:03.066166116Z [2024-05-24 23:58:03,065: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:58:03.066322270Z [2024-05-24 23:58:03,066: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:58:03.066686040Z [2024-05-24 23:58:03,066: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:58:03.066826764Z [2024-05-24 23:58:03,066: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:58:03.157270980Z [2024-05-24 23:58:03,156: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:58:04.625517575Z [2024-05-24 23:58:04,625: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9782d731-54fd-4808-8429-572536a60fc6] succeeded in 3.666020364999895s: None 2024-05-24T23:58:04.698640558Z [2024-05-24 23:58:04,698: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[59b4700a-654f-46d5-a53f-75816b19a1b6] succeeded in 3.7376708869996946s: None 2024-05-24T23:59:00.249782762Z [2024-05-24 23:59:00,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f23fb844-435e-42c0-9f58-0bee8e6081b5] received 2024-05-24T23:59:00.256060069Z [2024-05-24 23:59:00,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b3e2cad-a827-47ce-99db-5c8b56a95985] received 2024-05-24T23:59:00.263216843Z [2024-05-24 23:59:00,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6aaeb1d1-9838-45d0-802d-193e01ff775e] received 2024-05-24T23:59:00.265149226Z [2024-05-24 23:59:00,264: INFO/ForkPoolWorker-15] [f23fb844-435e-42c0-9f58-0bee8e6081b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-24T23:59:00.265268629Z [2024-05-24 23:59:00,265: INFO/ForkPoolWorker-16] [1b3e2cad-a827-47ce-99db-5c8b56a95985] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-24T23:59:00.279862800Z [2024-05-24 23:59:00,279: INFO/ForkPoolWorker-1] [6aaeb1d1-9838-45d0-802d-193e01ff775e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-24T23:59:00.565923850Z [2024-05-24 23:59:00,562: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-24T23:59:00.569801596Z [2024-05-24 23:59:00,566: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-24T23:59:00.597070113Z [2024-05-24 23:59:00,591: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-24T23:59:00.725825164Z [2024-05-24 23:59:00,725: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-24T23:59:00.730840314Z [2024-05-24 23:59:00,730: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:59:00.769191927Z [2024-05-24 23:59:00,768: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-24T23:59:00.773414491Z [2024-05-24 23:59:00,773: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-24T23:59:00.773531995Z [2024-05-24 23:59:00,773: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-24T23:59:00.773580876Z [2024-05-24 23:59:00,773: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-24T23:59:00.773782980Z [2024-05-24 23:59:00,773: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-24T23:59:00.861704456Z [2024-05-24 23:59:00,861: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:59:01.422337834Z [2024-05-24 23:59:01,421: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6aaeb1d1-9838-45d0-802d-193e01ff775e] succeeded in 1.1552795050001805s: None 2024-05-24T23:59:01.760166129Z [2024-05-24 23:59:01,759: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-24T23:59:01.763716598Z [2024-05-24 23:59:01,763: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:59:01.782316500Z [2024-05-24 23:59:01,781: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-24T23:59:01.786898908Z [2024-05-24 23:59:01,786: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-24T23:59:01.787852320Z [2024-05-24 23:59:01,787: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-24T23:59:01.789351713Z [2024-05-24 23:59:01,789: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:59:01.789456563Z [2024-05-24 23:59:01,789: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:59:01.789656695Z [2024-05-24 23:59:01,789: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:59:01.789740747Z [2024-05-24 23:59:01,789: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-24T23:59:01.790058467Z [2024-05-24 23:59:01,789: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-24T23:59:01.790527802Z [2024-05-24 23:59:01,790: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:59:01.807324720Z [2024-05-24 23:59:01,807: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-24T23:59:01.810396999Z [2024-05-24 23:59:01,810: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-24T23:59:01.810427344Z [2024-05-24 23:59:01,810: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-24T23:59:01.810757932Z [2024-05-24 23:59:01,810: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-24T23:59:01.810786348Z [2024-05-24 23:59:01,810: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-24T23:59:01.811395580Z [2024-05-24 23:59:01,811: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-24T23:59:01.811690855Z [2024-05-24 23:59:01,811: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-24T23:59:01.892803903Z [2024-05-24 23:59:01,892: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:59:01.900185872Z [2024-05-24 23:59:01,899: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-24T23:59:03.536270307Z [2024-05-24 23:59:03,535: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1b3e2cad-a827-47ce-99db-5c8b56a95985] succeeded in 3.278182621999804s: None 2024-05-24T23:59:03.840796831Z [2024-05-24 23:59:03,840: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f23fb844-435e-42c0-9f58-0bee8e6081b5] succeeded in 3.5884403919999386s: None 2024-05-25T00:00:00.733016748Z [2024-05-25 00:00:00,732: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e95af48-e0dd-44ee-94e3-b6899b9227dc] received 2024-05-25T00:00:00.735935706Z [2024-05-25 00:00:00,735: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10fb08b3-421b-4a96-af99-6d5118603cb6] received 2024-05-25T00:00:00.746359978Z [2024-05-25 00:00:00,745: INFO/ForkPoolWorker-15] [9e95af48-e0dd-44ee-94e3-b6899b9227dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-24T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:00:00.748521277Z [2024-05-25 00:00:00,748: INFO/ForkPoolWorker-16] [10fb08b3-421b-4a96-af99-6d5118603cb6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-24T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:00:00.757227201Z [2024-05-25 00:00:00,747: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb401bc1-8b75-429e-b637-9e9028dedc78] received 2024-05-25T00:00:00.760331137Z [2024-05-25 00:00:00,760: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16d68576-c172-446f-ac96-72a0004e5b81] received 2024-05-25T00:00:00.763166414Z [2024-05-25 00:00:00,762: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a7f4dd4-281e-4e93-8e1c-874e9afe8a5b] received 2024-05-25T00:00:00.769785763Z [2024-05-25 00:00:00,769: INFO/ForkPoolWorker-1] [cb401bc1-8b75-429e-b637-9e9028dedc78] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:00:00.780955527Z [2024-05-25 00:00:00,780: INFO/ForkPoolWorker-2] [16d68576-c172-446f-ac96-72a0004e5b81] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:00:00.790378775Z [2024-05-25 00:00:00,789: INFO/ForkPoolWorker-3] [8a7f4dd4-281e-4e93-8e1c-874e9afe8a5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-24T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:00:01.104893039Z [2024-05-25 00:00:01,101: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:00:01.191671699Z [2024-05-25 00:00:01,185: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:00:01.222773770Z [2024-05-25 00:00:01,212: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:00:01.271415297Z [2024-05-25 00:00:01,267: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:00:01.464907513Z [2024-05-25 00:00:01,458: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:00:01.654626801Z [2024-05-25 00:00:01,654: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T00:00:01.668828904Z [2024-05-25 00:00:01,668: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:00:01.776071591Z [2024-05-25 00:00:01,775: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:00:01.779254661Z [2024-05-25 00:00:01,778: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:00:01.779350893Z [2024-05-25 00:00:01,779: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:00:01.779356376Z [2024-05-25 00:00:01,779: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T00:00:01.779577471Z [2024-05-25 00:00:01,779: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:00:01.944053545Z [2024-05-25 00:00:01,943: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:00:01.990672753Z [2024-05-25 00:00:01,990: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:00:02.802535446Z [2024-05-25 00:00:02,802: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[16d68576-c172-446f-ac96-72a0004e5b81] succeeded in 2.038630218000435s: None 2024-05-25T00:00:02.829795816Z [2024-05-25 00:00:02,829: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:00:02.833778973Z [2024-05-25 00:00:02,833: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:00:02.871854515Z [2024-05-25 00:00:02,871: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:00:02.873954406Z [2024-05-25 00:00:02,873: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:00:02.874216656Z [2024-05-25 00:00:02,874: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:00:02.874516832Z [2024-05-25 00:00:02,874: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:00:02.874849385Z [2024-05-25 00:00:02,874: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:00:02.875436442Z [2024-05-25 00:00:02,875: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:00:02.875691866Z [2024-05-25 00:00:02,875: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:00:02.876460302Z [2024-05-25 00:00:02,876: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[10fb08b3-421b-4a96-af99-6d5118603cb6] succeeded in 2.1339199439998993s: None 2024-05-25T00:00:02.988502613Z [2024-05-25 00:00:02,988: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:00:03.039996045Z [2024-05-25 00:00:03,039: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:00:03.043155272Z [2024-05-25 00:00:03,042: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:00:03.069473723Z [2024-05-25 00:00:03,069: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:00:03.072036268Z [2024-05-25 00:00:03,071: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:00:03.072191667Z [2024-05-25 00:00:03,071: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:00:03.072481125Z [2024-05-25 00:00:03,072: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:00:03.072665457Z [2024-05-25 00:00:03,072: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:00:03.073145378Z [2024-05-25 00:00:03,072: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:00:03.073373604Z [2024-05-25 00:00:03,073: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:00:03.166342186Z [2024-05-25 00:00:03,166: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:00:03.373328539Z [2024-05-25 00:00:03,372: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-25T00:00:03.376516593Z [2024-05-25 00:00:03,376: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:00:03.401566099Z [2024-05-25 00:00:03,401: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T00:00:03.408353070Z [2024-05-25 00:00:03,402: INFO/ForkPoolWorker-3] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:00:03.408413168Z [2024-05-25 00:00:03,408: INFO/ForkPoolWorker-3] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:00:03.408678245Z [2024-05-25 00:00:03,408: INFO/ForkPoolWorker-3] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:00:03.408742222Z [2024-05-25 00:00:03,408: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-25T00:00:03.409169487Z [2024-05-25 00:00:03,409: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:00:03.409743364Z [2024-05-25 00:00:03,409: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:00:03.506907876Z [2024-05-25 00:00:03,506: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:00:03.590140085Z [2024-05-25 00:00:03,589: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9e95af48-e0dd-44ee-94e3-b6899b9227dc] succeeded in 2.85144795800079s: None 2024-05-25T00:00:04.130967625Z [2024-05-25 00:00:04,130: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0cf68afe-662e-4537-b102-079c0ad81137] received 2024-05-25T00:00:04.137065054Z [2024-05-25 00:00:04,136: INFO/ForkPoolWorker-15] [0cf68afe-662e-4537-b102-079c0ad81137] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-24T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:00:04.440869667Z [2024-05-25 00:00:04,437: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:00:04.670596047Z [2024-05-25 00:00:04,669: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cb401bc1-8b75-429e-b637-9e9028dedc78] succeeded in 3.911100938000345s: None 2024-05-25T00:00:05.670530174Z [2024-05-25 00:00:05,670: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:00:05.673847192Z [2024-05-25 00:00:05,673: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:00:05.696225052Z [2024-05-25 00:00:05,695: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:00:05.697731266Z [2024-05-25 00:00:05,697: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:00:05.697753707Z [2024-05-25 00:00:05,697: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:00:05.697944907Z [2024-05-25 00:00:05,697: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:00:05.697963059Z [2024-05-25 00:00:05,697: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:00:05.698326147Z [2024-05-25 00:00:05,698: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:00:05.698384693Z [2024-05-25 00:00:05,698: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:00:05.786756655Z [2024-05-25 00:00:05,786: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:00:06.542046481Z [2024-05-25 00:00:06,538: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c2a74ca-104a-433c-8aab-d86cbff569ed] received 2024-05-25T00:00:06.546978107Z [2024-05-25 00:00:06,546: INFO/ForkPoolWorker-16] [7c2a74ca-104a-433c-8aab-d86cbff569ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-24T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T00:00:06.555672071Z [2024-05-25 00:00:06,555: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0cf68afe-662e-4537-b102-079c0ad81137] succeeded in 2.4225992319998113s: None 2024-05-25T00:00:06.879306015Z [2024-05-25 00:00:06,876: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:00:07.058630377Z [2024-05-25 00:00:07,058: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[8a7f4dd4-281e-4e93-8e1c-874e9afe8a5b] succeeded in 6.290528956999879s: None 2024-05-25T00:00:07.996331989Z [2024-05-25 00:00:07,995: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:00:07.999779941Z [2024-05-25 00:00:07,999: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:00:08.021540337Z [2024-05-25 00:00:08,021: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:00:08.022734457Z [2024-05-25 00:00:08,022: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:00:08.022760986Z [2024-05-25 00:00:08,022: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:00:08.022918293Z [2024-05-25 00:00:08,022: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:00:08.023001465Z [2024-05-25 00:00:08,022: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:00:08.023225750Z [2024-05-25 00:00:08,023: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:00:08.023577530Z [2024-05-25 00:00:08,023: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:00:08.109317916Z [2024-05-25 00:00:08,104: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:00:08.711758276Z [2024-05-25 00:00:08,711: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7c2a74ca-104a-433c-8aab-d86cbff569ed] succeeded in 2.171208579999984s: None 2024-05-25T00:00:09.600954688Z [2024-05-25 00:00:09,600: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4433394a-118a-4012-884c-4aab5f09bf76] received 2024-05-25T00:00:09.610365258Z [2024-05-25 00:00:09,609: INFO/ForkPoolWorker-15] [4433394a-118a-4012-884c-4aab5f09bf76] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-24T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:00:09.918111335Z [2024-05-25 00:00:09,915: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:00:10.993479997Z [2024-05-25 00:00:10,993: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:00:10.996692816Z [2024-05-25 00:00:10,996: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:00:11.028425007Z [2024-05-25 00:00:11,028: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:00:11.031279035Z [2024-05-25 00:00:11,030: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:00:11.031365953Z [2024-05-25 00:00:11,031: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:00:11.031547189Z [2024-05-25 00:00:11,031: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:00:11.031638251Z [2024-05-25 00:00:11,031: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:00:11.031972558Z [2024-05-25 00:00:11,031: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:00:11.032008786Z [2024-05-25 00:00:11,031: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:00:11.102068662Z [2024-05-25 00:00:11,101: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:00:11.667610236Z [2024-05-25 00:00:11,667: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4433394a-118a-4012-884c-4aab5f09bf76] succeeded in 2.0648565779993078s: None 2024-05-25T00:01:01.104638708Z [2024-05-25 00:01:01,104: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27e7d970-acb5-404b-b850-10ccc47a0c80] received 2024-05-25T00:01:01.107945054Z [2024-05-25 00:01:01,107: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79fd9ea2-4c3f-43f6-9053-da93b35ec626] received 2024-05-25T00:01:01.117776152Z [2024-05-25 00:01:01,117: INFO/ForkPoolWorker-15] [27e7d970-acb5-404b-b850-10ccc47a0c80] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:01:01.119551671Z [2024-05-25 00:01:01,119: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5aab3941-ba37-4753-91b4-25d9b415624f] received 2024-05-25T00:01:01.129722622Z [2024-05-25 00:01:01,129: INFO/ForkPoolWorker-16] [79fd9ea2-4c3f-43f6-9053-da93b35ec626] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:01:01.131357393Z [2024-05-25 00:01:01,131: INFO/ForkPoolWorker-1] [5aab3941-ba37-4753-91b4-25d9b415624f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:01:01.405310353Z [2024-05-25 00:01:01,398: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:01:01.432647448Z [2024-05-25 00:01:01,428: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:01:01.437849108Z [2024-05-25 00:01:01,434: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:01:01.555936192Z [2024-05-25 00:01:01,555: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T00:01:01.560905007Z [2024-05-25 00:01:01,560: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:01:01.587250965Z [2024-05-25 00:01:01,587: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:01:01.588452440Z [2024-05-25 00:01:01,588: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:01:01.588648013Z [2024-05-25 00:01:01,588: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:01:01.588775418Z [2024-05-25 00:01:01,588: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T00:01:01.589416740Z [2024-05-25 00:01:01,589: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:01:01.670042711Z [2024-05-25 00:01:01,669: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:01:02.275859338Z [2024-05-25 00:01:02,275: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[27e7d970-acb5-404b-b850-10ccc47a0c80] succeeded in 1.1658417890002966s: None 2024-05-25T00:01:02.663395919Z [2024-05-25 00:01:02,663: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:01:02.666840656Z [2024-05-25 00:01:02,666: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:01:02.691969970Z [2024-05-25 00:01:02,691: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:01:02.693876604Z [2024-05-25 00:01:02,693: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:01:02.694010940Z [2024-05-25 00:01:02,693: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:01:02.694201291Z [2024-05-25 00:01:02,693: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:01:02.694451735Z [2024-05-25 00:01:02,694: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:01:02.694886461Z [2024-05-25 00:01:02,694: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:01:02.694969184Z [2024-05-25 00:01:02,694: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:01:02.742344698Z [2024-05-25 00:01:02,742: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:01:02.746178210Z [2024-05-25 00:01:02,745: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:01:02.767188471Z [2024-05-25 00:01:02,766: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:01:02.769497386Z [2024-05-25 00:01:02,769: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:01:02.769513667Z [2024-05-25 00:01:02,769: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:01:02.769651854Z [2024-05-25 00:01:02,769: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:01:02.769726038Z [2024-05-25 00:01:02,769: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:01:02.770028762Z [2024-05-25 00:01:02,769: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:01:02.770046422Z [2024-05-25 00:01:02,769: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:01:02.770935575Z [2024-05-25 00:01:02,770: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:01:02.866594458Z [2024-05-25 00:01:02,866: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:01:04.522671750Z [2024-05-25 00:01:04,522: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[79fd9ea2-4c3f-43f6-9053-da93b35ec626] succeeded in 3.4038362119999874s: None 2024-05-25T00:01:04.571271120Z [2024-05-25 00:01:04,570: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5aab3941-ba37-4753-91b4-25d9b415624f] succeeded in 3.4482658169999922s: None 2024-05-25T00:02:00.531053879Z [2024-05-25 00:02:00,529: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c073de0-d579-4e50-b288-bbdfacfa3365] received 2024-05-25T00:02:00.541691352Z [2024-05-25 00:02:00,541: INFO/ForkPoolWorker-15] [6c073de0-d579-4e50-b288-bbdfacfa3365] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:02:00.546350978Z [2024-05-25 00:02:00,535: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7773adbf-363e-4dd0-b56a-7af1f78989e2] received 2024-05-25T00:02:00.556818423Z [2024-05-25 00:02:00,556: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a4d1d27-4e19-42ed-a6ec-f300f7a9b9e0] received 2024-05-25T00:02:00.557668162Z [2024-05-25 00:02:00,557: INFO/ForkPoolWorker-16] [7773adbf-363e-4dd0-b56a-7af1f78989e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:02:00.559682552Z [2024-05-25 00:02:00,559: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8290c43f-4519-4df6-ab33-d53214d288f3] received 2024-05-25T00:02:00.578216038Z [2024-05-25 00:02:00,577: INFO/ForkPoolWorker-1] [5a4d1d27-4e19-42ed-a6ec-f300f7a9b9e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:02:00.581716129Z [2024-05-25 00:02:00,581: INFO/ForkPoolWorker-2] [8290c43f-4519-4df6-ab33-d53214d288f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:02:00.864734093Z [2024-05-25 00:02:00,854: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:02:00.910186661Z [2024-05-25 00:02:00,906: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:02:00.971619459Z [2024-05-25 00:02:00,967: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:02:01.012302144Z [2024-05-25 00:02:01,008: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:02:01.212370031Z [2024-05-25 00:02:01,211: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T00:02:01.216810051Z [2024-05-25 00:02:01,216: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:02:01.243640884Z [2024-05-25 00:02:01,243: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:02:01.245604469Z [2024-05-25 00:02:01,245: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:02:01.245839178Z [2024-05-25 00:02:01,245: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:02:01.246056851Z [2024-05-25 00:02:01,245: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T00:02:01.246385157Z [2024-05-25 00:02:01,246: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:02:01.251166737Z [2024-05-25 00:02:01,250: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:02:01.413902905Z [2024-05-25 00:02:01,413: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:02:01.907595641Z [2024-05-25 00:02:01,907: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5a4d1d27-4e19-42ed-a6ec-f300f7a9b9e0] succeeded in 1.3460243539993826s: None 2024-05-25T00:02:02.107179803Z [2024-05-25 00:02:02,106: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8290c43f-4519-4df6-ab33-d53214d288f3] succeeded in 1.5393567869996332s: None 2024-05-25T00:02:02.235567782Z [2024-05-25 00:02:02,235: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:02:02.255690461Z [2024-05-25 00:02:02,239: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:02:02.270999883Z [2024-05-25 00:02:02,270: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:02:02.274347643Z [2024-05-25 00:02:02,273: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:02:02.286910739Z [2024-05-25 00:02:02,286: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:02:02.288654388Z [2024-05-25 00:02:02,288: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:02:02.288753062Z [2024-05-25 00:02:02,288: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:02:02.288882135Z [2024-05-25 00:02:02,288: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:02:02.288941902Z [2024-05-25 00:02:02,288: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:02:02.289487443Z [2024-05-25 00:02:02,289: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:02:02.289561063Z [2024-05-25 00:02:02,289: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:02:02.303244424Z [2024-05-25 00:02:02,303: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:02:02.304686728Z [2024-05-25 00:02:02,304: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:02:02.304739123Z [2024-05-25 00:02:02,304: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:02:02.304876211Z [2024-05-25 00:02:02,304: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:02:02.304917744Z [2024-05-25 00:02:02,304: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:02:02.305162154Z [2024-05-25 00:02:02,305: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:02:02.305223932Z [2024-05-25 00:02:02,305: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:02:02.396246035Z [2024-05-25 00:02:02,395: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:02:02.402151748Z [2024-05-25 00:02:02,401: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:02:04.047911000Z [2024-05-25 00:02:04,047: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7773adbf-363e-4dd0-b56a-7af1f78989e2] succeeded in 3.496423849999701s: None 2024-05-25T00:02:04.333008585Z [2024-05-25 00:02:04,332: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6c073de0-d579-4e50-b288-bbdfacfa3365] succeeded in 3.798006674000135s: None 2024-05-25T00:03:00.933327923Z [2024-05-25 00:03:00,932: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7db28573-4fc7-4a42-b61b-0ad0c99c1f3d] received 2024-05-25T00:03:00.935672013Z [2024-05-25 00:03:00,935: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe910d53-ac01-46b6-a3b6-0f1ba030d91f] received 2024-05-25T00:03:00.945970280Z [2024-05-25 00:03:00,945: INFO/ForkPoolWorker-15] [7db28573-4fc7-4a42-b61b-0ad0c99c1f3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:03:00.946383708Z [2024-05-25 00:03:00,946: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c51b18b5-54ea-4947-bd38-3f4f283915c3] received 2024-05-25T00:03:00.947260961Z [2024-05-25 00:03:00,946: INFO/ForkPoolWorker-16] [fe910d53-ac01-46b6-a3b6-0f1ba030d91f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:03:00.969316030Z [2024-05-25 00:03:00,968: INFO/ForkPoolWorker-1] [c51b18b5-54ea-4947-bd38-3f4f283915c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:03:01.245377086Z [2024-05-25 00:03:01,242: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:03:01.296408052Z [2024-05-25 00:03:01,292: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:03:01.299142479Z [2024-05-25 00:03:01,295: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:03:01.524860220Z [2024-05-25 00:03:01,524: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T00:03:01.529990924Z [2024-05-25 00:03:01,529: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:03:01.553924236Z [2024-05-25 00:03:01,553: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:03:01.555520205Z [2024-05-25 00:03:01,555: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:03:01.555711299Z [2024-05-25 00:03:01,555: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:03:01.555895088Z [2024-05-25 00:03:01,555: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T00:03:01.556250555Z [2024-05-25 00:03:01,556: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:03:01.668305025Z [2024-05-25 00:03:01,668: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:03:02.365536424Z [2024-05-25 00:03:02,364: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7db28573-4fc7-4a42-b61b-0ad0c99c1f3d] succeeded in 1.4278572679995705s: None 2024-05-25T00:03:02.570670087Z [2024-05-25 00:03:02,570: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:03:02.574221744Z [2024-05-25 00:03:02,573: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:03:02.593974012Z [2024-05-25 00:03:02,593: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:03:02.597673714Z [2024-05-25 00:03:02,597: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:03:02.597863709Z [2024-05-25 00:03:02,597: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:03:02.599578206Z [2024-05-25 00:03:02,599: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:03:02.599693456Z [2024-05-25 00:03:02,599: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:03:02.600002806Z [2024-05-25 00:03:02,599: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:03:02.600014154Z [2024-05-25 00:03:02,599: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:03:02.600300538Z [2024-05-25 00:03:02,600: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:03:02.600444738Z [2024-05-25 00:03:02,600: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:03:02.618319606Z [2024-05-25 00:03:02,618: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:03:02.620561699Z [2024-05-25 00:03:02,620: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:03:02.621313623Z [2024-05-25 00:03:02,620: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:03:02.621597448Z [2024-05-25 00:03:02,621: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:03:02.621784449Z [2024-05-25 00:03:02,621: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:03:02.622379498Z [2024-05-25 00:03:02,622: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:03:02.622613945Z [2024-05-25 00:03:02,622: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:03:02.685955307Z [2024-05-25 00:03:02,685: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:03:02.725667004Z [2024-05-25 00:03:02,725: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:03:04.377899805Z [2024-05-25 00:03:04,377: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c51b18b5-54ea-4947-bd38-3f4f283915c3] succeeded in 3.424625855999693s: None 2024-05-25T00:03:04.949456097Z [2024-05-25 00:03:04,948: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fe910d53-ac01-46b6-a3b6-0f1ba030d91f] succeeded in 4.008099968999886s: None 2024-05-25T00:04:00.996585847Z [2024-05-25 00:04:00,996: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8bd23958-928b-4282-b998-089166b7f6f0] received 2024-05-25T00:04:01.000794630Z [2024-05-25 00:04:01,000: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[debe9c0b-4cbd-4372-85a5-23fb6821e707] received 2024-05-25T00:04:01.011717651Z [2024-05-25 00:04:01,011: INFO/ForkPoolWorker-15] [8bd23958-928b-4282-b998-089166b7f6f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:04:01.020724986Z [2024-05-25 00:04:01,020: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84fdc66a-1266-416f-b596-edbf2916a782] received 2024-05-25T00:04:01.021371937Z [2024-05-25 00:04:01,021: INFO/ForkPoolWorker-16] [debe9c0b-4cbd-4372-85a5-23fb6821e707] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:04:01.025698082Z [2024-05-25 00:04:01,025: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[448ca8f0-69a8-4d67-b6fb-84059c5dee9c] received 2024-05-25T00:04:01.043893442Z [2024-05-25 00:04:01,043: INFO/ForkPoolWorker-1] [84fdc66a-1266-416f-b596-edbf2916a782] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:04:01.049639887Z [2024-05-25 00:04:01,049: INFO/ForkPoolWorker-2] [448ca8f0-69a8-4d67-b6fb-84059c5dee9c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:04:01.500780674Z [2024-05-25 00:04:01,482: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:04:01.532552662Z [2024-05-25 00:04:01,518: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:04:01.594457299Z [2024-05-25 00:04:01,590: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:04:01.604815440Z [2024-05-25 00:04:01,601: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:04:01.865173355Z [2024-05-25 00:04:01,864: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T00:04:01.877376912Z [2024-05-25 00:04:01,876: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:04:01.909258032Z [2024-05-25 00:04:01,908: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:04:01.946213923Z [2024-05-25 00:04:01,945: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:04:01.947298985Z [2024-05-25 00:04:01,947: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:04:01.947401050Z [2024-05-25 00:04:01,947: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:04:01.947460599Z [2024-05-25 00:04:01,947: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T00:04:01.947662903Z [2024-05-25 00:04:01,947: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:04:02.087326337Z [2024-05-25 00:04:02,087: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:04:02.715135357Z [2024-05-25 00:04:02,714: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8bd23958-928b-4282-b998-089166b7f6f0] succeeded in 1.7148156610001024s: None 2024-05-25T00:04:02.875822375Z [2024-05-25 00:04:02,875: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[448ca8f0-69a8-4d67-b6fb-84059c5dee9c] succeeded in 1.8470456820004983s: None 2024-05-25T00:04:03.309444791Z [2024-05-25 00:04:03,309: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:04:03.313037816Z [2024-05-25 00:04:03,312: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:04:03.339372535Z [2024-05-25 00:04:03,339: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:04:03.341179627Z [2024-05-25 00:04:03,340: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:04:03.342310249Z [2024-05-25 00:04:03,341: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:04:03.342779494Z [2024-05-25 00:04:03,342: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:04:03.343032932Z [2024-05-25 00:04:03,342: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:04:03.343509057Z [2024-05-25 00:04:03,343: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:04:03.344316808Z [2024-05-25 00:04:03,343: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:04:03.404227222Z [2024-05-25 00:04:03,403: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:04:03.407312544Z [2024-05-25 00:04:03,406: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:04:03.429072099Z [2024-05-25 00:04:03,428: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:04:03.429413223Z [2024-05-25 00:04:03,429: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:04:03.430615314Z [2024-05-25 00:04:03,430: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:04:03.430622446Z [2024-05-25 00:04:03,430: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:04:03.430761801Z [2024-05-25 00:04:03,430: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:04:03.430766846Z [2024-05-25 00:04:03,430: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:04:03.430970066Z [2024-05-25 00:04:03,430: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:04:03.430978328Z [2024-05-25 00:04:03,430: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:04:03.513936751Z [2024-05-25 00:04:03,513: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:04:05.189312279Z [2024-05-25 00:04:05,188: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[84fdc66a-1266-416f-b596-edbf2916a782] succeeded in 4.166482022999844s: None 2024-05-25T00:04:05.471717870Z [2024-05-25 00:04:05,471: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[debe9c0b-4cbd-4372-85a5-23fb6821e707] succeeded in 4.464933631000349s: None 2024-05-25T00:05:00.753053438Z [2024-05-25 00:05:00,752: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9145038b-d4a7-4ed2-87f4-dfc43493002b] received 2024-05-25T00:05:00.755793287Z [2024-05-25 00:05:00,755: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b96655c7-d149-4c3e-8983-decc2e2922f5] received 2024-05-25T00:05:00.763090067Z [2024-05-25 00:05:00,762: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[259805fa-845c-44ef-bdb8-73b1f9aa2903] received 2024-05-25T00:05:00.770330012Z [2024-05-25 00:05:00,770: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7862fd96-47d6-4ceb-b86f-96d391837bc4] received 2024-05-25T00:05:00.774053637Z [2024-05-25 00:05:00,773: INFO/ForkPoolWorker-15] [9145038b-d4a7-4ed2-87f4-dfc43493002b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:05:00.812226682Z [2024-05-25 00:05:00,811: INFO/ForkPoolWorker-1] [259805fa-845c-44ef-bdb8-73b1f9aa2903] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:05:00.816607860Z [2024-05-25 00:05:00,812: INFO/ForkPoolWorker-2] [7862fd96-47d6-4ceb-b86f-96d391837bc4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:05:00.825480829Z [2024-05-25 00:05:00,817: INFO/ForkPoolWorker-16] [b96655c7-d149-4c3e-8983-decc2e2922f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:05:01.247930790Z [2024-05-25 00:05:01,222: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:05:01.298114492Z [2024-05-25 00:05:01,294: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:05:01.349364961Z [2024-05-25 00:05:01,340: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:05:01.531901214Z [2024-05-25 00:05:01,528: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:05:01.802022605Z [2024-05-25 00:05:01,801: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T00:05:01.811023517Z [2024-05-25 00:05:01,810: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:05:01.887344698Z [2024-05-25 00:05:01,887: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:05:01.889742684Z [2024-05-25 00:05:01,889: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:05:01.889824720Z [2024-05-25 00:05:01,889: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:05:01.889919436Z [2024-05-25 00:05:01,889: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T00:05:01.890206009Z [2024-05-25 00:05:01,890: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:05:02.042017407Z [2024-05-25 00:05:02,041: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:05:02.846857631Z [2024-05-25 00:05:02,846: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b96655c7-d149-4c3e-8983-decc2e2922f5] succeeded in 2.0873703360002764s: None 2024-05-25T00:05:02.977152589Z [2024-05-25 00:05:02,976: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T00:05:02.981107962Z [2024-05-25 00:05:02,980: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:05:03.025086977Z [2024-05-25 00:05:03,024: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:05:03.026545011Z [2024-05-25 00:05:03,026: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:05:03.026714083Z [2024-05-25 00:05:03,026: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:05:03.026872610Z [2024-05-25 00:05:03,026: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:05:03.027437637Z [2024-05-25 00:05:03,027: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T00:05:03.027702588Z [2024-05-25 00:05:03,027: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:05:03.027815280Z [2024-05-25 00:05:03,027: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:05:03.124507241Z [2024-05-25 00:05:03,124: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:05:03.168411058Z [2024-05-25 00:05:03,168: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:05:03.171896023Z [2024-05-25 00:05:03,171: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:05:03.172588696Z [2024-05-25 00:05:03,172: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:05:03.176152965Z [2024-05-25 00:05:03,175: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:05:03.198779697Z [2024-05-25 00:05:03,198: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:05:03.200196631Z [2024-05-25 00:05:03,199: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:05:03.200996596Z [2024-05-25 00:05:03,200: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:05:03.201010228Z [2024-05-25 00:05:03,200: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:05:03.201134417Z [2024-05-25 00:05:03,201: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:05:03.201163838Z [2024-05-25 00:05:03,201: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:05:03.201482294Z [2024-05-25 00:05:03,201: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:05:03.201512603Z [2024-05-25 00:05:03,201: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:05:03.201586453Z [2024-05-25 00:05:03,201: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:05:03.201679478Z [2024-05-25 00:05:03,201: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:05:03.201832123Z [2024-05-25 00:05:03,201: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:05:03.201909428Z [2024-05-25 00:05:03,201: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:05:03.202155540Z [2024-05-25 00:05:03,202: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:05:03.202305674Z [2024-05-25 00:05:03,202: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:05:03.282287277Z [2024-05-25 00:05:03,281: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:05:03.319676156Z [2024-05-25 00:05:03,319: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:05:04.206038532Z [2024-05-25 00:05:04,205: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9145038b-d4a7-4ed2-87f4-dfc43493002b] succeeded in 3.4491707130000577s: None 2024-05-25T00:05:04.725478253Z [2024-05-25 00:05:04,724: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[259805fa-845c-44ef-bdb8-73b1f9aa2903] succeeded in 3.9566040529998645s: None 2024-05-25T00:05:04.809573235Z [2024-05-25 00:05:04,809: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f59451d-05f4-4a5d-9d2b-48b594f764d9] received 2024-05-25T00:05:04.826317688Z [2024-05-25 00:05:04,825: INFO/ForkPoolWorker-15] [5f59451d-05f4-4a5d-9d2b-48b594f764d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:05:04.917068527Z [2024-05-25 00:05:04,916: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7862fd96-47d6-4ceb-b86f-96d391837bc4] succeeded in 4.143683300999328s: None 2024-05-25T00:05:05.098142332Z [2024-05-25 00:05:05,095: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:05:06.211646091Z [2024-05-25 00:05:06,211: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:05:06.214971955Z [2024-05-25 00:05:06,214: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:05:06.238628598Z [2024-05-25 00:05:06,238: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:05:06.240085171Z [2024-05-25 00:05:06,239: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:05:06.240162051Z [2024-05-25 00:05:06,240: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:05:06.240364930Z [2024-05-25 00:05:06,240: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:05:06.240435975Z [2024-05-25 00:05:06,240: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:05:06.240770470Z [2024-05-25 00:05:06,240: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:05:06.240872705Z [2024-05-25 00:05:06,240: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:05:06.317087488Z [2024-05-25 00:05:06,316: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:05:07.026683705Z [2024-05-25 00:05:07,026: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5f59451d-05f4-4a5d-9d2b-48b594f764d9] succeeded in 2.213713690000077s: None 2024-05-25T00:05:07.231289222Z [2024-05-25 00:05:07,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cd0f652-3fdf-4dbe-8c77-733c21b82799] received 2024-05-25T00:05:07.244265507Z [2024-05-25 00:05:07,243: INFO/ForkPoolWorker-15] [4cd0f652-3fdf-4dbe-8c77-733c21b82799] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T00:05:07.558061110Z [2024-05-25 00:05:07,555: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:05:08.675891969Z [2024-05-25 00:05:08,675: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:05:08.678982387Z [2024-05-25 00:05:08,678: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:05:08.703481453Z [2024-05-25 00:05:08,703: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:05:08.704660768Z [2024-05-25 00:05:08,704: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:05:08.704754618Z [2024-05-25 00:05:08,704: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:05:08.704938734Z [2024-05-25 00:05:08,704: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:05:08.705037181Z [2024-05-25 00:05:08,704: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:05:08.705383624Z [2024-05-25 00:05:08,705: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:05:08.705583811Z [2024-05-25 00:05:08,705: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:05:08.792149844Z [2024-05-25 00:05:08,791: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:05:09.364698642Z [2024-05-25 00:05:09,364: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4cd0f652-3fdf-4dbe-8c77-733c21b82799] succeeded in 2.1303420120002556s: None 2024-05-25T00:05:09.849051501Z [2024-05-25 00:05:09,848: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9f39871-72bf-481e-b0b7-b82fd3011137] received 2024-05-25T00:05:09.861553725Z [2024-05-25 00:05:09,861: INFO/ForkPoolWorker-15] [a9f39871-72bf-481e-b0b7-b82fd3011137] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:05:10.170594045Z [2024-05-25 00:05:10,167: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:05:11.247553738Z [2024-05-25 00:05:11,247: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:05:11.250910554Z [2024-05-25 00:05:11,250: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:05:11.289426242Z [2024-05-25 00:05:11,289: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:05:11.292617370Z [2024-05-25 00:05:11,292: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:05:11.292955383Z [2024-05-25 00:05:11,292: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:05:11.293484439Z [2024-05-25 00:05:11,293: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:05:11.293742283Z [2024-05-25 00:05:11,293: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:05:11.294231813Z [2024-05-25 00:05:11,294: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:05:11.294372983Z [2024-05-25 00:05:11,294: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:05:11.417905803Z [2024-05-25 00:05:11,417: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:05:11.932800714Z [2024-05-25 00:05:11,932: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a9f39871-72bf-481e-b0b7-b82fd3011137] succeeded in 2.080265980999684s: None 2024-05-25T00:06:00.684929054Z [2024-05-25 00:06:00,684: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc58d7aa-f1d7-4548-8cde-3746bb0f2ec4] received 2024-05-25T00:06:00.693184742Z [2024-05-25 00:06:00,692: INFO/ForkPoolWorker-15] [dc58d7aa-f1d7-4548-8cde-3746bb0f2ec4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:06:00.695483205Z [2024-05-25 00:06:00,695: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[376e9f1d-ce11-48ea-9816-867b29b2cf5a] received 2024-05-25T00:06:00.697943968Z [2024-05-25 00:06:00,697: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2a6cc21-e993-4a93-8894-d40cdb571d03] received 2024-05-25T00:06:00.702396791Z [2024-05-25 00:06:00,702: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d8bdcfb-3cf7-489c-9fef-39655cd2b039] received 2024-05-25T00:06:00.710725885Z [2024-05-25 00:06:00,710: INFO/ForkPoolWorker-1] [f2a6cc21-e993-4a93-8894-d40cdb571d03] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:06:00.714043229Z [2024-05-25 00:06:00,713: INFO/ForkPoolWorker-16] [376e9f1d-ce11-48ea-9816-867b29b2cf5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:06:00.721021887Z [2024-05-25 00:06:00,720: INFO/ForkPoolWorker-2] [2d8bdcfb-3cf7-489c-9fef-39655cd2b039] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:06:01.074378394Z [2024-05-25 00:06:01,071: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:06:01.114693648Z [2024-05-25 00:06:01,111: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:06:01.178012244Z [2024-05-25 00:06:01,163: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:06:01.368618421Z [2024-05-25 00:06:01,362: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:06:01.432344451Z [2024-05-25 00:06:01,432: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:06:01.576874802Z [2024-05-25 00:06:01,576: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T00:06:01.581575859Z [2024-05-25 00:06:01,581: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:06:01.613521670Z [2024-05-25 00:06:01,613: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:06:01.614487341Z [2024-05-25 00:06:01,614: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:06:01.614579431Z [2024-05-25 00:06:01,614: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:06:01.614586850Z [2024-05-25 00:06:01,614: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T00:06:01.614743781Z [2024-05-25 00:06:01,614: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:06:01.702756365Z [2024-05-25 00:06:01,702: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:06:02.009286807Z [2024-05-25 00:06:02,008: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dc58d7aa-f1d7-4548-8cde-3746bb0f2ec4] succeeded in 1.3221871129999272s: None 2024-05-25T00:06:02.431225041Z [2024-05-25 00:06:02,430: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[376e9f1d-ce11-48ea-9816-867b29b2cf5a] succeeded in 1.732097901999623s: None 2024-05-25T00:06:02.629699827Z [2024-05-25 00:06:02,629: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T00:06:02.633328747Z [2024-05-25 00:06:02,632: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:06:02.665966725Z [2024-05-25 00:06:02,665: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:06:02.667905704Z [2024-05-25 00:06:02,667: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:06:02.667983877Z [2024-05-25 00:06:02,667: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:06:02.668190036Z [2024-05-25 00:06:02,667: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:06:02.668265979Z [2024-05-25 00:06:02,668: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T00:06:02.668678700Z [2024-05-25 00:06:02,668: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:06:02.668722408Z [2024-05-25 00:06:02,668: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:06:02.686932842Z [2024-05-25 00:06:02,686: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:06:02.689955732Z [2024-05-25 00:06:02,689: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:06:02.712377597Z [2024-05-25 00:06:02,712: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:06:02.714523406Z [2024-05-25 00:06:02,714: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:06:02.714580886Z [2024-05-25 00:06:02,714: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:06:02.714773765Z [2024-05-25 00:06:02,714: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:06:02.714912527Z [2024-05-25 00:06:02,714: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:06:02.715138398Z [2024-05-25 00:06:02,715: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:06:02.715161529Z [2024-05-25 00:06:02,715: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:06:02.762281689Z [2024-05-25 00:06:02,762: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:06:02.795163474Z [2024-05-25 00:06:02,794: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:06:04.778898805Z [2024-05-25 00:06:04,778: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f2a6cc21-e993-4a93-8894-d40cdb571d03] succeeded in 4.0745499909999126s: None 2024-05-25T00:06:05.510865957Z [2024-05-25 00:06:05,510: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2d8bdcfb-3cf7-489c-9fef-39655cd2b039] succeeded in 4.805867149999358s: None 2024-05-25T00:07:00.566498721Z [2024-05-25 00:07:00,565: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1d35ec8-b69e-42c0-adfe-46eb9132dd4f] received 2024-05-25T00:07:00.577242889Z [2024-05-25 00:07:00,576: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad32a5ed-3103-441b-ad25-653cb639b7d6] received 2024-05-25T00:07:00.578437857Z [2024-05-25 00:07:00,578: INFO/ForkPoolWorker-15] [c1d35ec8-b69e-42c0-adfe-46eb9132dd4f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:07:00.588097844Z [2024-05-25 00:07:00,587: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d00998d7-0a0b-4944-b6a5-b9bfb78570e6] received 2024-05-25T00:07:00.606036136Z [2024-05-25 00:07:00,605: INFO/ForkPoolWorker-16] [ad32a5ed-3103-441b-ad25-653cb639b7d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:07:00.612675515Z [2024-05-25 00:07:00,608: INFO/ForkPoolWorker-1] [d00998d7-0a0b-4944-b6a5-b9bfb78570e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:07:00.920551637Z [2024-05-25 00:07:00,917: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:07:00.923441477Z [2024-05-25 00:07:00,919: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:07:00.931154808Z [2024-05-25 00:07:00,927: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:07:01.104508969Z [2024-05-25 00:07:01,104: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T00:07:01.108385916Z [2024-05-25 00:07:01,107: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:07:01.144072774Z [2024-05-25 00:07:01,143: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:07:01.145600558Z [2024-05-25 00:07:01,145: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:07:01.145802089Z [2024-05-25 00:07:01,145: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:07:01.145925135Z [2024-05-25 00:07:01,145: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T00:07:01.146459868Z [2024-05-25 00:07:01,146: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:07:01.253484166Z [2024-05-25 00:07:01,253: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:07:01.876214837Z [2024-05-25 00:07:01,875: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ad32a5ed-3103-441b-ad25-653cb639b7d6] succeeded in 1.2895429360005437s: None 2024-05-25T00:07:02.243681178Z [2024-05-25 00:07:02,240: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:07:02.246573984Z [2024-05-25 00:07:02,244: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:07:02.260332261Z [2024-05-25 00:07:02,257: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:07:02.265295385Z [2024-05-25 00:07:02,263: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:07:02.292031347Z [2024-05-25 00:07:02,291: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:07:02.302182876Z [2024-05-25 00:07:02,301: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:07:02.302205375Z [2024-05-25 00:07:02,302: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:07:02.302270576Z [2024-05-25 00:07:02,302: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:07:02.302312559Z [2024-05-25 00:07:02,302: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:07:02.302584073Z [2024-05-25 00:07:02,302: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:07:02.302587492Z [2024-05-25 00:07:02,302: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:07:02.371565575Z [2024-05-25 00:07:02,371: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:07:02.375055892Z [2024-05-25 00:07:02,374: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:07:02.375370310Z [2024-05-25 00:07:02,375: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:07:02.375539000Z [2024-05-25 00:07:02,375: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:07:02.376948946Z [2024-05-25 00:07:02,375: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:07:02.378438739Z [2024-05-25 00:07:02,378: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:07:02.381624694Z [2024-05-25 00:07:02,381: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:07:02.460686542Z [2024-05-25 00:07:02,460: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:07:02.552090763Z [2024-05-25 00:07:02,551: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:07:04.070396504Z [2024-05-25 00:07:04,069: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c1d35ec8-b69e-42c0-adfe-46eb9132dd4f] succeeded in 3.501044018000357s: None 2024-05-25T00:07:04.433912500Z [2024-05-25 00:07:04,433: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d00998d7-0a0b-4944-b6a5-b9bfb78570e6] succeeded in 3.841430209000464s: None 2024-05-25T00:08:00.366021129Z [2024-05-25 00:08:00,365: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0cbe1e9-3dd5-4127-8a41-53f73c6d824e] received 2024-05-25T00:08:00.367714418Z [2024-05-25 00:08:00,367: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea94ffab-ddfe-4ab9-b95b-024f53c24044] received 2024-05-25T00:08:00.370440533Z [2024-05-25 00:08:00,370: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b501a44-4232-4d08-b867-adf9e1bc66c2] received 2024-05-25T00:08:00.374851417Z [2024-05-25 00:08:00,374: INFO/ForkPoolWorker-15] [f0cbe1e9-3dd5-4127-8a41-53f73c6d824e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:08:00.380142003Z [2024-05-25 00:08:00,379: INFO/ForkPoolWorker-1] [8b501a44-4232-4d08-b867-adf9e1bc66c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:08:00.385659429Z [2024-05-25 00:08:00,385: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f533f03-26bc-495d-a05f-659996c36703] received 2024-05-25T00:08:00.386748018Z [2024-05-25 00:08:00,386: INFO/ForkPoolWorker-16] [ea94ffab-ddfe-4ab9-b95b-024f53c24044] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:08:00.407822231Z [2024-05-25 00:08:00,407: INFO/ForkPoolWorker-2] [9f533f03-26bc-495d-a05f-659996c36703] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:08:00.737513975Z [2024-05-25 00:08:00,733: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:08:00.776744784Z [2024-05-25 00:08:00,773: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:08:00.842507655Z [2024-05-25 00:08:00,838: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:08:01.020440612Z [2024-05-25 00:08:01,017: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:08:01.288798991Z [2024-05-25 00:08:01,288: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:08:01.351752700Z [2024-05-25 00:08:01,350: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T00:08:01.356347447Z [2024-05-25 00:08:01,355: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:08:01.391380765Z [2024-05-25 00:08:01,391: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:08:01.401339326Z [2024-05-25 00:08:01,392: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:08:01.401387325Z [2024-05-25 00:08:01,392: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:08:01.401391524Z [2024-05-25 00:08:01,392: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T00:08:01.401394635Z [2024-05-25 00:08:01,392: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:08:01.490203317Z [2024-05-25 00:08:01,489: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:08:02.425635166Z [2024-05-25 00:08:02,425: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8b501a44-4232-4d08-b867-adf9e1bc66c2] succeeded in 2.0522606040003666s: None 2024-05-25T00:08:02.666536941Z [2024-05-25 00:08:02,666: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ea94ffab-ddfe-4ab9-b95b-024f53c24044] succeeded in 2.2951634750006633s: None 2024-05-25T00:08:02.884158607Z [2024-05-25 00:08:02,883: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:08:02.887703138Z [2024-05-25 00:08:02,887: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:08:02.904223798Z [2024-05-25 00:08:02,903: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T00:08:02.907666924Z [2024-05-25 00:08:02,907: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:08:02.924760745Z [2024-05-25 00:08:02,924: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:08:02.926128615Z [2024-05-25 00:08:02,925: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:08:02.926179504Z [2024-05-25 00:08:02,926: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:08:02.926329237Z [2024-05-25 00:08:02,926: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:08:02.926391979Z [2024-05-25 00:08:02,926: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:08:02.926775579Z [2024-05-25 00:08:02,926: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:08:02.926964089Z [2024-05-25 00:08:02,926: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:08:02.940647589Z [2024-05-25 00:08:02,940: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:08:02.942176216Z [2024-05-25 00:08:02,942: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:08:02.942212489Z [2024-05-25 00:08:02,942: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:08:02.942369447Z [2024-05-25 00:08:02,942: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:08:02.942376737Z [2024-05-25 00:08:02,942: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T00:08:02.942603716Z [2024-05-25 00:08:02,942: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:08:02.942610818Z [2024-05-25 00:08:02,942: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:08:03.014294188Z [2024-05-25 00:08:03,014: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:08:03.047347368Z [2024-05-25 00:08:03,046: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:08:04.686552197Z [2024-05-25 00:08:04,686: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f0cbe1e9-3dd5-4127-8a41-53f73c6d824e] succeeded in 4.318757207999624s: None 2024-05-25T00:08:05.438037790Z [2024-05-25 00:08:05,437: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9f533f03-26bc-495d-a05f-659996c36703] succeeded in 5.0417795229996045s: None 2024-05-25T00:09:01.045019770Z [2024-05-25 00:09:01,044: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f56a32ee-09d4-4bda-968b-df3b3d6092bf] received 2024-05-25T00:09:01.054631505Z [2024-05-25 00:09:01,054: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa934c74-f8ae-4826-880e-8c2ffbf61753] received 2024-05-25T00:09:01.060627690Z [2024-05-25 00:09:01,060: INFO/ForkPoolWorker-15] [f56a32ee-09d4-4bda-968b-df3b3d6092bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:09:01.061658538Z [2024-05-25 00:09:01,061: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b32330fa-9367-4e1a-bc62-8769ecffb872] received 2024-05-25T00:09:01.074993516Z [2024-05-25 00:09:01,074: INFO/ForkPoolWorker-1] [b32330fa-9367-4e1a-bc62-8769ecffb872] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:09:01.078139653Z [2024-05-25 00:09:01,077: INFO/ForkPoolWorker-16] [fa934c74-f8ae-4826-880e-8c2ffbf61753] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:09:01.421418852Z [2024-05-25 00:09:01,410: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:09:01.471606956Z [2024-05-25 00:09:01,467: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:09:01.492974909Z [2024-05-25 00:09:01,489: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:09:01.640935715Z [2024-05-25 00:09:01,640: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T00:09:01.644921251Z [2024-05-25 00:09:01,644: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:09:01.682309239Z [2024-05-25 00:09:01,682: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:09:01.686113608Z [2024-05-25 00:09:01,685: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:09:01.686379157Z [2024-05-25 00:09:01,686: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:09:01.686442438Z [2024-05-25 00:09:01,686: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T00:09:01.686663458Z [2024-05-25 00:09:01,686: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:09:01.809587862Z [2024-05-25 00:09:01,809: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:09:02.524230045Z [2024-05-25 00:09:02,523: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b32330fa-9367-4e1a-bc62-8769ecffb872] succeeded in 1.4572283830002561s: None 2024-05-25T00:09:02.708678682Z [2024-05-25 00:09:02,708: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:09:02.711839619Z [2024-05-25 00:09:02,711: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:09:02.733058427Z [2024-05-25 00:09:02,732: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:09:02.734514144Z [2024-05-25 00:09:02,734: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:09:02.734569999Z [2024-05-25 00:09:02,734: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:09:02.734844040Z [2024-05-25 00:09:02,734: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:09:02.734874960Z [2024-05-25 00:09:02,734: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:09:02.735149152Z [2024-05-25 00:09:02,734: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:09:02.735356257Z [2024-05-25 00:09:02,735: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:09:02.756289300Z [2024-05-25 00:09:02,755: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:09:02.762519011Z [2024-05-25 00:09:02,761: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:09:02.794430359Z [2024-05-25 00:09:02,794: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:09:02.796288141Z [2024-05-25 00:09:02,796: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:09:02.796683596Z [2024-05-25 00:09:02,796: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:09:02.797041835Z [2024-05-25 00:09:02,796: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:09:02.797311409Z [2024-05-25 00:09:02,796: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:09:02.797796779Z [2024-05-25 00:09:02,797: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:09:02.798129157Z [2024-05-25 00:09:02,797: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:09:02.818138788Z [2024-05-25 00:09:02,817: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:09:02.900280505Z [2024-05-25 00:09:02,900: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:09:05.470374150Z [2024-05-25 00:09:05,469: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f56a32ee-09d4-4bda-968b-df3b3d6092bf] succeeded in 4.419961407000301s: None 2024-05-25T00:09:06.345708922Z [2024-05-25 00:09:06,345: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fa934c74-f8ae-4826-880e-8c2ffbf61753] succeeded in 5.288283583999146s: None 2024-05-25T00:10:01.089410001Z [2024-05-25 00:10:01,088: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d68cfe0a-b690-4a85-8282-df5032d14345] received 2024-05-25T00:10:01.092830027Z [2024-05-25 00:10:01,092: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c39d0430-b360-4fde-8f1f-14f2162c3a8c] received 2024-05-25T00:10:01.095290498Z [2024-05-25 00:10:01,095: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3321333-2ada-438c-842c-07308faff2ee] received 2024-05-25T00:10:01.103391096Z [2024-05-25 00:10:01,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edd94038-edd4-40e3-b928-c634dd030711] received 2024-05-25T00:10:01.106522371Z [2024-05-25 00:10:01,106: INFO/ForkPoolWorker-16] [c39d0430-b360-4fde-8f1f-14f2162c3a8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:10:01.111243356Z [2024-05-25 00:10:01,111: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5ed9f0c-21d5-456d-8548-a93eab6f8381] received 2024-05-25T00:10:01.114561937Z [2024-05-25 00:10:01,114: INFO/ForkPoolWorker-1] [a3321333-2ada-438c-842c-07308faff2ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:10:01.118394981Z [2024-05-25 00:10:01,118: INFO/ForkPoolWorker-15] [d68cfe0a-b690-4a85-8282-df5032d14345] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:10:01.139211297Z [2024-05-25 00:10:01,138: INFO/ForkPoolWorker-2] [edd94038-edd4-40e3-b928-c634dd030711] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:10:01.145841663Z [2024-05-25 00:10:01,145: INFO/ForkPoolWorker-3] [c5ed9f0c-21d5-456d-8548-a93eab6f8381] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:10:01.736651688Z [2024-05-25 00:10:01,731: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:10:01.804363578Z [2024-05-25 00:10:01,798: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:10:01.827115778Z [2024-05-25 00:10:01,823: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:10:01.906466043Z [2024-05-25 00:10:01,902: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:10:02.001369037Z [2024-05-25 00:10:01,998: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T00:10:02.015396884Z [2024-05-25 00:10:02,014: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:10:02.053553447Z [2024-05-25 00:10:02,048: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:10:02.093402809Z [2024-05-25 00:10:02,093: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:10:02.108551280Z [2024-05-25 00:10:02,108: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:10:02.112643767Z [2024-05-25 00:10:02,112: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:10:02.112757575Z [2024-05-25 00:10:02,112: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T00:10:02.113033792Z [2024-05-25 00:10:02,112: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:10:02.205312302Z [2024-05-25 00:10:02,205: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:10:02.451417337Z [2024-05-25 00:10:02,451: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:10:03.106833307Z [2024-05-25 00:10:03,106: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c39d0430-b360-4fde-8f1f-14f2162c3a8c] succeeded in 2.009327535999546s: None 2024-05-25T00:10:03.294647501Z [2024-05-25 00:10:03,294: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[edd94038-edd4-40e3-b928-c634dd030711] succeeded in 2.1888909670005887s: None 2024-05-25T00:10:04.329041018Z [2024-05-25 00:10:04,328: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:10:04.333638611Z [2024-05-25 00:10:04,333: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:10:04.359313185Z [2024-05-25 00:10:04,359: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:10:04.360891865Z [2024-05-25 00:10:04,360: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:10:04.361015352Z [2024-05-25 00:10:04,360: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:10:04.361201022Z [2024-05-25 00:10:04,361: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:10:04.361383398Z [2024-05-25 00:10:04,361: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:10:04.361667743Z [2024-05-25 00:10:04,361: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:10:04.362345866Z [2024-05-25 00:10:04,362: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:10:04.373589770Z [2024-05-25 00:10:04,373: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:10:04.376909024Z [2024-05-25 00:10:04,376: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:10:04.400017605Z [2024-05-25 00:10:04,399: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:10:04.401640439Z [2024-05-25 00:10:04,401: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:10:04.401706635Z [2024-05-25 00:10:04,401: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:10:04.401842870Z [2024-05-25 00:10:04,401: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:10:04.401963853Z [2024-05-25 00:10:04,401: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:10:04.402581100Z [2024-05-25 00:10:04,402: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:10:04.402628060Z [2024-05-25 00:10:04,402: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:10:04.446467506Z [2024-05-25 00:10:04,446: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-25T00:10:04.449972172Z [2024-05-25 00:10:04,449: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:10:04.475151706Z [2024-05-25 00:10:04,474: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:10:04.484703350Z [2024-05-25 00:10:04,484: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T00:10:04.489396677Z [2024-05-25 00:10:04,489: INFO/ForkPoolWorker-3] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:10:04.490463926Z [2024-05-25 00:10:04,489: INFO/ForkPoolWorker-3] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:10:04.491696375Z [2024-05-25 00:10:04,491: INFO/ForkPoolWorker-3] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:10:04.492503651Z [2024-05-25 00:10:04,491: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-25T00:10:04.492848996Z [2024-05-25 00:10:04,492: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:10:04.492976076Z [2024-05-25 00:10:04,492: INFO/ForkPoolWorker-3] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:10:04.518767042Z [2024-05-25 00:10:04,518: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:10:04.586616907Z [2024-05-25 00:10:04,586: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:10:05.117152383Z [2024-05-25 00:10:05,116: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[723eb287-a466-4b16-9c63-b87a70a2895a] received 2024-05-25T00:10:05.123475138Z [2024-05-25 00:10:05,123: INFO/ForkPoolWorker-16] [723eb287-a466-4b16-9c63-b87a70a2895a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:10:05.130981429Z [2024-05-25 00:10:05,130: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d68cfe0a-b690-4a85-8282-df5032d14345] succeeded in 4.037881068999923s: None 2024-05-25T00:10:05.382398231Z [2024-05-25 00:10:05,379: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:10:06.126340097Z [2024-05-25 00:10:06,125: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[c5ed9f0c-21d5-456d-8548-a93eab6f8381] succeeded in 5.010334278999835s: None 2024-05-25T00:10:06.259320876Z [2024-05-25 00:10:06,258: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a3321333-2ada-438c-842c-07308faff2ee] succeeded in 5.161092892999477s: None 2024-05-25T00:10:06.695096307Z [2024-05-25 00:10:06,688: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:10:06.695149193Z [2024-05-25 00:10:06,692: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:10:06.717876715Z [2024-05-25 00:10:06,717: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:10:06.720908363Z [2024-05-25 00:10:06,720: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:10:06.720924828Z [2024-05-25 00:10:06,720: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:10:06.720928902Z [2024-05-25 00:10:06,720: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:10:06.720932815Z [2024-05-25 00:10:06,720: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:10:06.721796307Z [2024-05-25 00:10:06,721: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:10:06.721806069Z [2024-05-25 00:10:06,721: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:10:06.837747511Z [2024-05-25 00:10:06,837: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:10:07.513382222Z [2024-05-25 00:10:07,511: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8514614-ce5a-4b66-9a8d-af13684c0ea0] received 2024-05-25T00:10:07.522076340Z [2024-05-25 00:10:07,521: INFO/ForkPoolWorker-15] [b8514614-ce5a-4b66-9a8d-af13684c0ea0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T00:10:07.551495076Z [2024-05-25 00:10:07,550: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[723eb287-a466-4b16-9c63-b87a70a2895a] succeeded in 2.4320585220002613s: None 2024-05-25T00:10:07.804670971Z [2024-05-25 00:10:07,801: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:10:08.976664359Z [2024-05-25 00:10:08,976: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:10:08.979825862Z [2024-05-25 00:10:08,979: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:10:09.010198116Z [2024-05-25 00:10:09,009: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:10:09.013731645Z [2024-05-25 00:10:09,013: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:10:09.014033585Z [2024-05-25 00:10:09,013: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:10:09.014440387Z [2024-05-25 00:10:09,014: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:10:09.014677254Z [2024-05-25 00:10:09,014: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:10:09.015240816Z [2024-05-25 00:10:09,015: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:10:09.015527964Z [2024-05-25 00:10:09,015: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:10:09.113081850Z [2024-05-25 00:10:09,112: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:10:09.796308065Z [2024-05-25 00:10:09,795: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b8514614-ce5a-4b66-9a8d-af13684c0ea0] succeeded in 2.280305813999803s: None 2024-05-25T00:10:10.265112281Z [2024-05-25 00:10:10,264: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b381fdd-20e4-4290-b427-8c3d7ab9e1f7] received 2024-05-25T00:10:10.282432283Z [2024-05-25 00:10:10,282: INFO/ForkPoolWorker-15] [0b381fdd-20e4-4290-b427-8c3d7ab9e1f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:10:10.549435419Z [2024-05-25 00:10:10,546: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:10:11.583934046Z [2024-05-25 00:10:11,583: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:10:11.587380141Z [2024-05-25 00:10:11,586: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:10:11.609939478Z [2024-05-25 00:10:11,609: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:10:11.611718424Z [2024-05-25 00:10:11,611: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:10:11.611902780Z [2024-05-25 00:10:11,611: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:10:11.612207528Z [2024-05-25 00:10:11,611: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:10:11.612453239Z [2024-05-25 00:10:11,612: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:10:11.612820413Z [2024-05-25 00:10:11,612: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:10:11.613037303Z [2024-05-25 00:10:11,612: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:10:11.725877227Z [2024-05-25 00:10:11,725: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:10:12.285414105Z [2024-05-25 00:10:12,284: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0b381fdd-20e4-4290-b427-8c3d7ab9e1f7] succeeded in 2.0121726590004982s: None 2024-05-25T00:11:01.232692216Z [2024-05-25 00:11:01,232: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78a9126c-d704-4451-86ce-a000751a8ce8] received 2024-05-25T00:11:01.240139458Z [2024-05-25 00:11:01,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df74170b-ef10-4f21-9f43-36ca28361634] received 2024-05-25T00:11:01.246621773Z [2024-05-25 00:11:01,246: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60fc43c0-5d5a-446e-9f71-3e354d205c8d] received 2024-05-25T00:11:01.247246992Z [2024-05-25 00:11:01,247: INFO/ForkPoolWorker-15] [78a9126c-d704-4451-86ce-a000751a8ce8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:11:01.251949943Z [2024-05-25 00:11:01,251: INFO/ForkPoolWorker-16] [df74170b-ef10-4f21-9f43-36ca28361634] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:11:01.257073862Z [2024-05-25 00:11:01,256: INFO/ForkPoolWorker-1] [60fc43c0-5d5a-446e-9f71-3e354d205c8d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:11:01.607397101Z [2024-05-25 00:11:01,604: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:11:01.630628060Z [2024-05-25 00:11:01,627: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:11:01.631918933Z [2024-05-25 00:11:01,628: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:11:01.777414949Z [2024-05-25 00:11:01,776: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T00:11:01.781984954Z [2024-05-25 00:11:01,781: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:11:01.806442575Z [2024-05-25 00:11:01,806: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:11:01.808152042Z [2024-05-25 00:11:01,807: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:11:01.808227549Z [2024-05-25 00:11:01,808: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:11:01.808379390Z [2024-05-25 00:11:01,808: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T00:11:01.809733297Z [2024-05-25 00:11:01,808: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:11:01.909019741Z [2024-05-25 00:11:01,908: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:11:02.534409577Z [2024-05-25 00:11:02,534: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[78a9126c-d704-4451-86ce-a000751a8ce8] succeeded in 1.299290939000457s: None 2024-05-25T00:11:02.856722113Z [2024-05-25 00:11:02,856: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:11:02.860138266Z [2024-05-25 00:11:02,859: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:11:02.877753618Z [2024-05-25 00:11:02,877: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:11:02.878985959Z [2024-05-25 00:11:02,878: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:11:02.879125259Z [2024-05-25 00:11:02,878: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:11:02.879329993Z [2024-05-25 00:11:02,879: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:11:02.879455002Z [2024-05-25 00:11:02,879: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:11:02.879722782Z [2024-05-25 00:11:02,879: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:11:02.879874814Z [2024-05-25 00:11:02,879: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:11:02.928321204Z [2024-05-25 00:11:02,927: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:11:02.931810936Z [2024-05-25 00:11:02,931: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:11:02.961436296Z [2024-05-25 00:11:02,961: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:11:02.970497244Z [2024-05-25 00:11:02,970: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:11:02.974177070Z [2024-05-25 00:11:02,973: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:11:02.974325051Z [2024-05-25 00:11:02,974: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:11:02.974491862Z [2024-05-25 00:11:02,974: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:11:02.974623329Z [2024-05-25 00:11:02,974: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:11:02.974901884Z [2024-05-25 00:11:02,974: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:11:02.975030384Z [2024-05-25 00:11:02,974: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:11:03.083187599Z [2024-05-25 00:11:03,082: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:11:05.140775182Z [2024-05-25 00:11:05,140: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[df74170b-ef10-4f21-9f43-36ca28361634] succeeded in 3.8983064789999844s: None 2024-05-25T00:11:05.499784579Z [2024-05-25 00:11:05,498: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[60fc43c0-5d5a-446e-9f71-3e354d205c8d] succeeded in 4.247849403000146s: None 2024-05-25T00:12:01.171532269Z [2024-05-25 00:12:01,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3e1398f-3ae4-413b-8335-f04cf0f6f64a] received 2024-05-25T00:12:01.176621076Z [2024-05-25 00:12:01,176: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9641d9c8-8304-4e5d-b682-221fd19bdcb1] received 2024-05-25T00:12:01.182602505Z [2024-05-25 00:12:01,182: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53dceaf0-b7f5-4cc2-9035-1f1a31192252] received 2024-05-25T00:12:01.185878560Z [2024-05-25 00:12:01,185: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9aee8c9b-d97b-437d-8e56-7b25d6739916] received 2024-05-25T00:12:01.189111257Z [2024-05-25 00:12:01,188: INFO/ForkPoolWorker-16] [9641d9c8-8304-4e5d-b682-221fd19bdcb1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:12:01.198028021Z [2024-05-25 00:12:01,197: INFO/ForkPoolWorker-2] [9aee8c9b-d97b-437d-8e56-7b25d6739916] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:12:01.199098151Z [2024-05-25 00:12:01,198: INFO/ForkPoolWorker-15] [f3e1398f-3ae4-413b-8335-f04cf0f6f64a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:12:01.201549108Z [2024-05-25 00:12:01,201: INFO/ForkPoolWorker-1] [53dceaf0-b7f5-4cc2-9035-1f1a31192252] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:12:01.516651194Z [2024-05-25 00:12:01,513: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:12:01.592840131Z [2024-05-25 00:12:01,587: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:12:01.619380740Z [2024-05-25 00:12:01,616: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:12:01.638792301Z [2024-05-25 00:12:01,635: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:12:01.783920341Z [2024-05-25 00:12:01,783: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:12:01.818239434Z [2024-05-25 00:12:01,817: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T00:12:01.823162431Z [2024-05-25 00:12:01,822: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:12:01.858023483Z [2024-05-25 00:12:01,857: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:12:01.860223631Z [2024-05-25 00:12:01,859: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:12:01.860361977Z [2024-05-25 00:12:01,860: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:12:01.860458949Z [2024-05-25 00:12:01,860: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T00:12:01.861655733Z [2024-05-25 00:12:01,861: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:12:01.994414444Z [2024-05-25 00:12:01,994: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:12:02.386157070Z [2024-05-25 00:12:02,385: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9641d9c8-8304-4e5d-b682-221fd19bdcb1] succeeded in 1.204959582999436s: None 2024-05-25T00:12:02.707323543Z [2024-05-25 00:12:02,706: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[53dceaf0-b7f5-4cc2-9035-1f1a31192252] succeeded in 1.5197225629999593s: None 2024-05-25T00:12:02.961172124Z [2024-05-25 00:12:02,960: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:12:02.964675074Z [2024-05-25 00:12:02,964: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:12:02.985692062Z [2024-05-25 00:12:02,985: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:12:02.987173306Z [2024-05-25 00:12:02,986: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:12:02.987196358Z [2024-05-25 00:12:02,987: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:12:02.987365306Z [2024-05-25 00:12:02,987: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:12:02.987496187Z [2024-05-25 00:12:02,987: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:12:02.987879714Z [2024-05-25 00:12:02,987: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:12:02.987904799Z [2024-05-25 00:12:02,987: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:12:03.014837982Z [2024-05-25 00:12:03,014: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T00:12:03.018634023Z [2024-05-25 00:12:03,018: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:12:03.044451667Z [2024-05-25 00:12:03,044: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:12:03.045721894Z [2024-05-25 00:12:03,045: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:12:03.045804397Z [2024-05-25 00:12:03,045: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:12:03.045919068Z [2024-05-25 00:12:03,045: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:12:03.045949382Z [2024-05-25 00:12:03,045: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T00:12:03.046265066Z [2024-05-25 00:12:03,046: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:12:03.046290914Z [2024-05-25 00:12:03,046: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:12:03.089866784Z [2024-05-25 00:12:03,089: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:12:03.154480290Z [2024-05-25 00:12:03,154: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:12:05.080385545Z [2024-05-25 00:12:05,079: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f3e1398f-3ae4-413b-8335-f04cf0f6f64a] succeeded in 3.9051304240001627s: None 2024-05-25T00:12:05.551236157Z [2024-05-25 00:12:05,550: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9aee8c9b-d97b-437d-8e56-7b25d6739916] succeeded in 4.3621866959992985s: None 2024-05-25T00:13:01.022233851Z [2024-05-25 00:13:01,021: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1930419e-9044-4bc5-a196-57a6cd4c9520] received 2024-05-25T00:13:01.025770378Z [2024-05-25 00:13:01,025: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3431746c-b1fc-42e0-ae86-5c937847656f] received 2024-05-25T00:13:01.032827034Z [2024-05-25 00:13:01,032: INFO/ForkPoolWorker-15] [1930419e-9044-4bc5-a196-57a6cd4c9520] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:13:01.037003454Z [2024-05-25 00:13:01,036: INFO/ForkPoolWorker-16] [3431746c-b1fc-42e0-ae86-5c937847656f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:13:01.069140570Z [2024-05-25 00:13:01,068: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c79346f3-082d-45af-bd2c-298ae99001f7] received 2024-05-25T00:13:01.088385620Z [2024-05-25 00:13:01,088: INFO/ForkPoolWorker-1] [c79346f3-082d-45af-bd2c-298ae99001f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:13:01.373368307Z [2024-05-25 00:13:01,363: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:13:01.482152567Z [2024-05-25 00:13:01,478: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:13:01.483250405Z [2024-05-25 00:13:01,478: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:13:01.681168380Z [2024-05-25 00:13:01,680: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T00:13:01.685263350Z [2024-05-25 00:13:01,684: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:13:01.714082942Z [2024-05-25 00:13:01,713: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:13:01.715232279Z [2024-05-25 00:13:01,715: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:13:01.715652370Z [2024-05-25 00:13:01,715: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:13:01.715720327Z [2024-05-25 00:13:01,715: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T00:13:01.715995157Z [2024-05-25 00:13:01,715: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:13:01.814448380Z [2024-05-25 00:13:01,814: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:13:02.468397507Z [2024-05-25 00:13:02,467: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c79346f3-082d-45af-bd2c-298ae99001f7] succeeded in 1.39635666400045s: None 2024-05-25T00:13:02.718879834Z [2024-05-25 00:13:02,718: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:13:02.722260198Z [2024-05-25 00:13:02,721: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:13:02.752112185Z [2024-05-25 00:13:02,751: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:13:02.753537028Z [2024-05-25 00:13:02,753: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:13:02.753732253Z [2024-05-25 00:13:02,753: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:13:02.753952844Z [2024-05-25 00:13:02,753: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:13:02.754099704Z [2024-05-25 00:13:02,753: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:13:02.754406959Z [2024-05-25 00:13:02,754: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:13:02.754622700Z [2024-05-25 00:13:02,754: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:13:02.793926896Z [2024-05-25 00:13:02,793: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:13:02.797450683Z [2024-05-25 00:13:02,796: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:13:02.829482038Z [2024-05-25 00:13:02,829: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:13:02.834380304Z [2024-05-25 00:13:02,833: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:13:02.834418942Z [2024-05-25 00:13:02,834: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:13:02.834582743Z [2024-05-25 00:13:02,834: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:13:02.834643004Z [2024-05-25 00:13:02,834: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:13:02.835122686Z [2024-05-25 00:13:02,834: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:13:02.835199279Z [2024-05-25 00:13:02,835: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:13:02.846953987Z [2024-05-25 00:13:02,846: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:13:02.953347340Z [2024-05-25 00:13:02,953: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:13:04.714450693Z [2024-05-25 00:13:04,713: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1930419e-9044-4bc5-a196-57a6cd4c9520] succeeded in 3.6877816670003085s: None 2024-05-25T00:13:05.049765028Z [2024-05-25 00:13:05,048: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3431746c-b1fc-42e0-ae86-5c937847656f] succeeded in 4.021039037999799s: None 2024-05-25T00:14:00.638772127Z [2024-05-25 00:14:00,638: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d83aeace-6aa5-4c06-9640-6bedca314989] received 2024-05-25T00:14:00.642574305Z [2024-05-25 00:14:00,642: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5e2bc73-6e95-4caf-b2a2-7ae2fbaf9a59] received 2024-05-25T00:14:00.646701525Z [2024-05-25 00:14:00,646: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1413e216-c03f-4e33-b365-6a3e75974b27] received 2024-05-25T00:14:00.647243238Z [2024-05-25 00:14:00,647: INFO/ForkPoolWorker-15] [d83aeace-6aa5-4c06-9640-6bedca314989] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:14:00.648250416Z [2024-05-25 00:14:00,648: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ae6abfb-8c25-427f-b85c-b03fcdf1a6f5] received 2024-05-25T00:14:00.653698941Z [2024-05-25 00:14:00,653: INFO/ForkPoolWorker-16] [b5e2bc73-6e95-4caf-b2a2-7ae2fbaf9a59] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:14:00.660061344Z [2024-05-25 00:14:00,659: INFO/ForkPoolWorker-2] [2ae6abfb-8c25-427f-b85c-b03fcdf1a6f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:14:00.674146557Z [2024-05-25 00:14:00,673: INFO/ForkPoolWorker-1] [1413e216-c03f-4e33-b365-6a3e75974b27] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:14:00.954612553Z [2024-05-25 00:14:00,950: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:14:01.016097261Z [2024-05-25 00:14:01,012: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:14:01.107261047Z [2024-05-25 00:14:01,103: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:14:01.124927347Z [2024-05-25 00:14:01,124: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T00:14:01.131179710Z [2024-05-25 00:14:01,127: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:14:01.131398213Z [2024-05-25 00:14:01,131: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:14:01.169239809Z [2024-05-25 00:14:01,169: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:14:01.173797033Z [2024-05-25 00:14:01,173: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:14:01.174734650Z [2024-05-25 00:14:01,173: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:14:01.174838060Z [2024-05-25 00:14:01,174: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T00:14:01.174997135Z [2024-05-25 00:14:01,174: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:14:01.285603397Z [2024-05-25 00:14:01,285: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:14:01.465186411Z [2024-05-25 00:14:01,464: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:14:01.896529005Z [2024-05-25 00:14:01,896: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b5e2bc73-6e95-4caf-b2a2-7ae2fbaf9a59] succeeded in 1.2515265590000126s: None 2024-05-25T00:14:01.996262566Z [2024-05-25 00:14:01,995: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1413e216-c03f-4e33-b365-6a3e75974b27] succeeded in 1.3454825919998257s: None 2024-05-25T00:14:02.364710221Z [2024-05-25 00:14:02,364: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:14:02.369767838Z [2024-05-25 00:14:02,369: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:14:02.408395689Z [2024-05-25 00:14:02,408: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:14:02.409758896Z [2024-05-25 00:14:02,409: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:14:02.409869273Z [2024-05-25 00:14:02,409: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:14:02.410035101Z [2024-05-25 00:14:02,409: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:14:02.410107254Z [2024-05-25 00:14:02,410: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:14:02.410424886Z [2024-05-25 00:14:02,410: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:14:02.410486052Z [2024-05-25 00:14:02,410: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:14:02.448521098Z [2024-05-25 00:14:02,448: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T00:14:02.451781040Z [2024-05-25 00:14:02,451: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:14:02.482859325Z [2024-05-25 00:14:02,482: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:14:02.484432630Z [2024-05-25 00:14:02,484: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:14:02.484693683Z [2024-05-25 00:14:02,484: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:14:02.484984147Z [2024-05-25 00:14:02,484: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:14:02.485161401Z [2024-05-25 00:14:02,484: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T00:14:02.485527843Z [2024-05-25 00:14:02,485: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:14:02.485782045Z [2024-05-25 00:14:02,485: INFO/ForkPoolWorker-2] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:14:02.523229045Z [2024-05-25 00:14:02,522: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:14:02.567700565Z [2024-05-25 00:14:02,567: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:14:04.063949186Z [2024-05-25 00:14:04,063: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2ae6abfb-8c25-427f-b85c-b03fcdf1a6f5] succeeded in 3.4133290479994685s: None 2024-05-25T00:14:04.428261285Z [2024-05-25 00:14:04,427: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d83aeace-6aa5-4c06-9640-6bedca314989] succeeded in 3.786647771999924s: None 2024-05-25T00:15:00.631448430Z [2024-05-25 00:15:00,631: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7dcae482-0a58-4988-a5f5-270526fa7f29] received 2024-05-25T00:15:00.633798208Z [2024-05-25 00:15:00,633: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d08773d6-3ced-42cb-9db5-8f49bb514774] received 2024-05-25T00:15:00.659045691Z [2024-05-25 00:15:00,658: INFO/ForkPoolWorker-15] [7dcae482-0a58-4988-a5f5-270526fa7f29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:15:00.662092402Z [2024-05-25 00:15:00,661: INFO/ForkPoolWorker-16] [d08773d6-3ced-42cb-9db5-8f49bb514774] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:15:00.696579582Z [2024-05-25 00:15:00,696: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97a74524-383f-4b1b-830d-755b81de379e] received 2024-05-25T00:15:00.701120063Z [2024-05-25 00:15:00,700: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed708ffa-d13d-4eef-abe6-b69815df4652] received 2024-05-25T00:15:00.708306175Z [2024-05-25 00:15:00,708: INFO/ForkPoolWorker-1] [97a74524-383f-4b1b-830d-755b81de379e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:15:00.718244691Z [2024-05-25 00:15:00,717: INFO/ForkPoolWorker-2] [ed708ffa-d13d-4eef-abe6-b69815df4652] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:15:01.181947073Z [2024-05-25 00:15:01,178: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:15:01.231817569Z [2024-05-25 00:15:01,228: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:15:01.490271185Z [2024-05-25 00:15:01,486: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:15:01.538972615Z [2024-05-25 00:15:01,535: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:15:01.692194366Z [2024-05-25 00:15:01,691: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T00:15:01.697129181Z [2024-05-25 00:15:01,696: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:15:01.765239375Z [2024-05-25 00:15:01,765: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:15:01.770075149Z [2024-05-25 00:15:01,769: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:15:01.770089958Z [2024-05-25 00:15:01,769: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:15:01.770094207Z [2024-05-25 00:15:01,769: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T00:15:01.770097577Z [2024-05-25 00:15:01,769: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:15:02.075177167Z [2024-05-25 00:15:02,074: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:15:03.202011047Z [2024-05-25 00:15:03,201: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ed708ffa-d13d-4eef-abe6-b69815df4652] succeeded in 2.4990269079999052s: None 2024-05-25T00:15:03.642730820Z [2024-05-25 00:15:03,641: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:15:03.646050293Z [2024-05-25 00:15:03,645: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:15:03.680498734Z [2024-05-25 00:15:03,680: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:15:03.684740604Z [2024-05-25 00:15:03,684: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:15:03.684751011Z [2024-05-25 00:15:03,684: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:15:03.684861059Z [2024-05-25 00:15:03,684: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:15:03.684877888Z [2024-05-25 00:15:03,684: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:15:03.685239618Z [2024-05-25 00:15:03,685: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:15:03.685281183Z [2024-05-25 00:15:03,685: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:15:03.802014125Z [2024-05-25 00:15:03,801: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:15:03.849815105Z [2024-05-25 00:15:03,848: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:15:03.854090604Z [2024-05-25 00:15:03,853: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:15:03.934995748Z [2024-05-25 00:15:03,933: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:15:03.937535174Z [2024-05-25 00:15:03,935: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:15:03.937551786Z [2024-05-25 00:15:03,935: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:15:03.937555878Z [2024-05-25 00:15:03,935: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:15:03.937559908Z [2024-05-25 00:15:03,935: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:15:03.937563239Z [2024-05-25 00:15:03,935: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:15:03.937566309Z [2024-05-25 00:15:03,935: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:15:04.090842508Z [2024-05-25 00:15:04,090: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:15:04.138522337Z [2024-05-25 00:15:04,138: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:15:04.144011340Z [2024-05-25 00:15:04,143: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:15:04.193028077Z [2024-05-25 00:15:04,192: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:15:04.206178406Z [2024-05-25 00:15:04,205: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:15:04.206250571Z [2024-05-25 00:15:04,206: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:15:04.206425606Z [2024-05-25 00:15:04,206: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:15:04.206504986Z [2024-05-25 00:15:04,206: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:15:04.206842319Z [2024-05-25 00:15:04,206: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:15:04.207124439Z [2024-05-25 00:15:04,206: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:15:04.374832145Z [2024-05-25 00:15:04,374: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:15:04.728196957Z [2024-05-25 00:15:04,727: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a3231fb-2759-46c2-8908-ba4d12418476] received 2024-05-25T00:15:04.735663590Z [2024-05-25 00:15:04,735: INFO/ForkPoolWorker-2] [4a3231fb-2759-46c2-8908-ba4d12418476] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:15:04.801904703Z [2024-05-25 00:15:04,801: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[97a74524-383f-4b1b-830d-755b81de379e] succeeded in 4.10310526899957s: None 2024-05-25T00:15:05.084800378Z [2024-05-25 00:15:05,081: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:15:05.897157303Z [2024-05-25 00:15:05,896: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7dcae482-0a58-4988-a5f5-270526fa7f29] succeeded in 5.261768041999858s: None 2024-05-25T00:15:06.614650885Z [2024-05-25 00:15:06,614: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d08773d6-3ced-42cb-9db5-8f49bb514774] succeeded in 5.976044371000171s: None 2024-05-25T00:15:06.633289502Z [2024-05-25 00:15:06,632: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T00:15:06.637007977Z [2024-05-25 00:15:06,636: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:15:06.698755368Z [2024-05-25 00:15:06,698: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:15:06.700009866Z [2024-05-25 00:15:06,699: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:15:06.700081834Z [2024-05-25 00:15:06,699: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:15:06.700263777Z [2024-05-25 00:15:06,700: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:15:06.700370283Z [2024-05-25 00:15:06,700: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T00:15:06.700766814Z [2024-05-25 00:15:06,700: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:15:06.700843649Z [2024-05-25 00:15:06,700: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:15:06.774677782Z [2024-05-25 00:15:06,774: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:15:07.633639371Z [2024-05-25 00:15:07,633: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4a3231fb-2759-46c2-8908-ba4d12418476] succeeded in 2.903627314000005s: None 2024-05-25T00:15:08.184493546Z [2024-05-25 00:15:08,183: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8e919b9-85fe-4a6b-92fd-541530632dbb] received 2024-05-25T00:15:08.205415681Z [2024-05-25 00:15:08,205: INFO/ForkPoolWorker-15] [c8e919b9-85fe-4a6b-92fd-541530632dbb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T00:15:08.707062548Z [2024-05-25 00:15:08,704: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:15:10.204985147Z [2024-05-25 00:15:10,204: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:15:10.208362392Z [2024-05-25 00:15:10,207: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:15:10.236226035Z [2024-05-25 00:15:10,235: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:15:10.238818297Z [2024-05-25 00:15:10,238: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:15:10.239090059Z [2024-05-25 00:15:10,238: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:15:10.239424559Z [2024-05-25 00:15:10,239: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:15:10.239691978Z [2024-05-25 00:15:10,239: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:15:10.240132229Z [2024-05-25 00:15:10,239: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:15:10.240394238Z [2024-05-25 00:15:10,240: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:15:10.358197657Z [2024-05-25 00:15:10,357: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:15:10.852012774Z [2024-05-25 00:15:10,851: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a564392e-79f1-4507-99dd-5ffa762a4a89] received 2024-05-25T00:15:10.869559602Z [2024-05-25 00:15:10,869: INFO/ForkPoolWorker-16] [a564392e-79f1-4507-99dd-5ffa762a4a89] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:15:10.961693494Z [2024-05-25 00:15:10,961: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c8e919b9-85fe-4a6b-92fd-541530632dbb] succeeded in 2.7765357770003902s: None 2024-05-25T00:15:11.226941527Z [2024-05-25 00:15:11,223: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:15:12.471136553Z [2024-05-25 00:15:12,470: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:15:12.475299300Z [2024-05-25 00:15:12,474: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:15:12.498177813Z [2024-05-25 00:15:12,497: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:15:12.499640522Z [2024-05-25 00:15:12,499: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:15:12.499764737Z [2024-05-25 00:15:12,499: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:15:12.500081761Z [2024-05-25 00:15:12,499: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:15:12.500244583Z [2024-05-25 00:15:12,500: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:15:12.500609745Z [2024-05-25 00:15:12,500: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:15:12.500780548Z [2024-05-25 00:15:12,500: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:15:12.606638032Z [2024-05-25 00:15:12,606: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:15:13.361846572Z [2024-05-25 00:15:13,359: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a564392e-79f1-4507-99dd-5ffa762a4a89] succeeded in 2.4996917019998364s: None 2024-05-25T00:16:00.782709837Z [2024-05-25 00:16:00,781: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[048bbd79-e466-4881-bfbb-cc3098a05bde] received 2024-05-25T00:16:00.786230798Z [2024-05-25 00:16:00,785: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52cec9fb-dee9-4d0a-a4a3-a43e82867520] received 2024-05-25T00:16:00.809983040Z [2024-05-25 00:16:00,809: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3032e1a-2ca0-4aa6-89aa-e3b36d0e6fd4] received 2024-05-25T00:16:00.810681334Z [2024-05-25 00:16:00,810: INFO/ForkPoolWorker-16] [52cec9fb-dee9-4d0a-a4a3-a43e82867520] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:16:00.812504503Z [2024-05-25 00:16:00,812: INFO/ForkPoolWorker-15] [048bbd79-e466-4881-bfbb-cc3098a05bde] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:16:00.825187025Z [2024-05-25 00:16:00,824: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b16ed5a-19ae-4ce2-9a59-c85ab5c23359] received 2024-05-25T00:16:00.833915262Z [2024-05-25 00:16:00,833: INFO/ForkPoolWorker-1] [c3032e1a-2ca0-4aa6-89aa-e3b36d0e6fd4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:16:00.840393860Z [2024-05-25 00:16:00,839: INFO/ForkPoolWorker-2] [8b16ed5a-19ae-4ce2-9a59-c85ab5c23359] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:16:01.174030128Z [2024-05-25 00:16:01,169: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:16:01.206381547Z [2024-05-25 00:16:01,201: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:16:01.354756068Z [2024-05-25 00:16:01,339: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:16:01.473773520Z [2024-05-25 00:16:01,470: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:16:01.637706853Z [2024-05-25 00:16:01,637: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:16:01.677932435Z [2024-05-25 00:16:01,677: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T00:16:01.682691044Z [2024-05-25 00:16:01,682: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:16:01.730663625Z [2024-05-25 00:16:01,730: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:16:01.734723096Z [2024-05-25 00:16:01,734: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:16:01.749624186Z [2024-05-25 00:16:01,744: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:16:01.749715451Z [2024-05-25 00:16:01,749: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T00:16:01.749927813Z [2024-05-25 00:16:01,749: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:16:01.861014006Z [2024-05-25 00:16:01,860: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:16:02.437985400Z [2024-05-25 00:16:02,437: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[048bbd79-e466-4881-bfbb-cc3098a05bde] succeeded in 1.6481406140001127s: None 2024-05-25T00:16:02.750330010Z [2024-05-25 00:16:02,749: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8b16ed5a-19ae-4ce2-9a59-c85ab5c23359] succeeded in 1.921918844999709s: None 2024-05-25T00:16:03.029185669Z [2024-05-25 00:16:03,028: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:16:03.032466906Z [2024-05-25 00:16:03,031: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:16:03.054185068Z [2024-05-25 00:16:03,053: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:16:03.055927150Z [2024-05-25 00:16:03,055: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:16:03.056317734Z [2024-05-25 00:16:03,055: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:16:03.056541500Z [2024-05-25 00:16:03,056: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:16:03.056553584Z [2024-05-25 00:16:03,056: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:16:03.057109224Z [2024-05-25 00:16:03,056: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:16:03.057180918Z [2024-05-25 00:16:03,057: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:16:03.144054070Z [2024-05-25 00:16:03,141: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:16:03.146123847Z [2024-05-25 00:16:03,145: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:16:03.160935844Z [2024-05-25 00:16:03,160: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:16:03.170776709Z [2024-05-25 00:16:03,170: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:16:03.175005531Z [2024-05-25 00:16:03,171: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:16:03.175023496Z [2024-05-25 00:16:03,171: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:16:03.175028179Z [2024-05-25 00:16:03,172: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:16:03.175032359Z [2024-05-25 00:16:03,172: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:16:03.175035529Z [2024-05-25 00:16:03,172: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:16:03.175038757Z [2024-05-25 00:16:03,172: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:16:03.306581536Z [2024-05-25 00:16:03,306: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:16:05.303431667Z [2024-05-25 00:16:05,302: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c3032e1a-2ca0-4aa6-89aa-e3b36d0e6fd4] succeeded in 4.488767832000121s: None 2024-05-25T00:16:05.719751702Z [2024-05-25 00:16:05,719: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[52cec9fb-dee9-4d0a-a4a3-a43e82867520] succeeded in 4.925298524999562s: None 2024-05-25T00:17:00.557948620Z [2024-05-25 00:17:00,557: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[955720a9-1c9a-4d52-abbc-26ec257c4c42] received 2024-05-25T00:17:00.560107454Z [2024-05-25 00:17:00,559: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d553f81-687e-4221-8228-8eff53aab4a2] received 2024-05-25T00:17:00.566753299Z [2024-05-25 00:17:00,566: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad4d3970-0303-4ba2-8e5a-53d474b08f99] received 2024-05-25T00:17:00.573733352Z [2024-05-25 00:17:00,573: INFO/ForkPoolWorker-15] [955720a9-1c9a-4d52-abbc-26ec257c4c42] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:17:00.579168471Z [2024-05-25 00:17:00,578: INFO/ForkPoolWorker-16] [9d553f81-687e-4221-8228-8eff53aab4a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:17:00.583196721Z [2024-05-25 00:17:00,582: INFO/ForkPoolWorker-1] [ad4d3970-0303-4ba2-8e5a-53d474b08f99] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:17:00.860836639Z [2024-05-25 00:17:00,857: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:17:00.881986862Z [2024-05-25 00:17:00,878: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:17:00.940082441Z [2024-05-25 00:17:00,936: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:17:01.015002119Z [2024-05-25 00:17:01,014: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T00:17:01.019518631Z [2024-05-25 00:17:01,018: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:17:01.055683523Z [2024-05-25 00:17:01,055: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:17:01.056653548Z [2024-05-25 00:17:01,056: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:17:01.056759896Z [2024-05-25 00:17:01,056: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:17:01.056850928Z [2024-05-25 00:17:01,056: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T00:17:01.057112227Z [2024-05-25 00:17:01,056: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:17:01.146334204Z [2024-05-25 00:17:01,146: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:17:01.714164192Z [2024-05-25 00:17:01,713: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9d553f81-687e-4221-8228-8eff53aab4a2] succeeded in 1.1511625000002823s: None 2024-05-25T00:17:02.093089210Z [2024-05-25 00:17:02,092: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:17:02.096565726Z [2024-05-25 00:17:02,096: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:17:02.120647876Z [2024-05-25 00:17:02,120: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:17:02.122173189Z [2024-05-25 00:17:02,121: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:17:02.122334633Z [2024-05-25 00:17:02,122: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:17:02.122652779Z [2024-05-25 00:17:02,122: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:17:02.122686251Z [2024-05-25 00:17:02,122: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:17:02.123059630Z [2024-05-25 00:17:02,122: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:17:02.123082529Z [2024-05-25 00:17:02,122: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:17:02.139699747Z [2024-05-25 00:17:02,139: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:17:02.142961229Z [2024-05-25 00:17:02,142: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:17:02.166130620Z [2024-05-25 00:17:02,165: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:17:02.168046489Z [2024-05-25 00:17:02,167: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:17:02.168406098Z [2024-05-25 00:17:02,168: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:17:02.168687420Z [2024-05-25 00:17:02,168: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:17:02.168852540Z [2024-05-25 00:17:02,168: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:17:02.170086943Z [2024-05-25 00:17:02,169: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:17:02.170191483Z [2024-05-25 00:17:02,170: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:17:02.249291550Z [2024-05-25 00:17:02,249: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:17:02.329628823Z [2024-05-25 00:17:02,329: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:17:03.916738127Z [2024-05-25 00:17:03,912: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[955720a9-1c9a-4d52-abbc-26ec257c4c42] succeeded in 3.351735070000359s: None 2024-05-25T00:17:04.120460651Z [2024-05-25 00:17:04,119: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ad4d3970-0303-4ba2-8e5a-53d474b08f99] succeeded in 3.550697556999694s: None 2024-05-25T00:18:00.958473805Z [2024-05-25 00:18:00,957: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1f2943b-f388-47f1-944f-b16af99011d3] received 2024-05-25T00:18:00.962964316Z [2024-05-25 00:18:00,962: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82078046-ebd7-497a-98fc-1cfd58c608ff] received 2024-05-25T00:18:00.964817212Z [2024-05-25 00:18:00,964: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5a031ee-5f36-4d15-8003-ab04427b6a56] received 2024-05-25T00:18:00.967253156Z [2024-05-25 00:18:00,967: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5862b70f-9bb4-433d-9f9b-245f9b5834a0] received 2024-05-25T00:18:00.975599177Z [2024-05-25 00:18:00,975: INFO/ForkPoolWorker-15] [b1f2943b-f388-47f1-944f-b16af99011d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:18:00.979967134Z [2024-05-25 00:18:00,979: INFO/ForkPoolWorker-1] [b5a031ee-5f36-4d15-8003-ab04427b6a56] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:18:00.981022355Z [2024-05-25 00:18:00,980: INFO/ForkPoolWorker-16] [82078046-ebd7-497a-98fc-1cfd58c608ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:18:00.990859698Z [2024-05-25 00:18:00,990: INFO/ForkPoolWorker-2] [5862b70f-9bb4-433d-9f9b-245f9b5834a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:18:01.362480221Z [2024-05-25 00:18:01,358: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:18:01.387121596Z [2024-05-25 00:18:01,382: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:18:01.432652949Z [2024-05-25 00:18:01,427: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:18:01.462605901Z [2024-05-25 00:18:01,459: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:18:01.627830302Z [2024-05-25 00:18:01,627: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T00:18:01.632530671Z [2024-05-25 00:18:01,632: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:18:01.659995683Z [2024-05-25 00:18:01,659: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:18:01.663456582Z [2024-05-25 00:18:01,663: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:18:01.663746643Z [2024-05-25 00:18:01,663: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:18:01.663947124Z [2024-05-25 00:18:01,663: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T00:18:01.664407065Z [2024-05-25 00:18:01,664: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:18:01.708430465Z [2024-05-25 00:18:01,708: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:18:01.799709834Z [2024-05-25 00:18:01,799: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:18:02.356230086Z [2024-05-25 00:18:02,355: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b1f2943b-f388-47f1-944f-b16af99011d3] succeeded in 1.3949086799993893s: None 2024-05-25T00:18:02.450823483Z [2024-05-25 00:18:02,450: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5862b70f-9bb4-433d-9f9b-245f9b5834a0] succeeded in 1.4787558470006843s: None 2024-05-25T00:18:02.825383515Z [2024-05-25 00:18:02,824: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:18:02.828730438Z [2024-05-25 00:18:02,828: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:18:02.839791465Z [2024-05-25 00:18:02,839: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:18:02.843666724Z [2024-05-25 00:18:02,843: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:18:02.857353898Z [2024-05-25 00:18:02,857: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:18:02.860070796Z [2024-05-25 00:18:02,859: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:18:02.860191843Z [2024-05-25 00:18:02,859: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:18:02.860312616Z [2024-05-25 00:18:02,860: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:18:02.860482415Z [2024-05-25 00:18:02,860: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:18:02.860776047Z [2024-05-25 00:18:02,860: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:18:02.860853829Z [2024-05-25 00:18:02,860: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:18:02.884702814Z [2024-05-25 00:18:02,884: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:18:02.886411721Z [2024-05-25 00:18:02,886: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:18:02.886537496Z [2024-05-25 00:18:02,886: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:18:02.886731325Z [2024-05-25 00:18:02,886: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:18:02.886820737Z [2024-05-25 00:18:02,886: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:18:02.887110169Z [2024-05-25 00:18:02,886: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:18:02.887233599Z [2024-05-25 00:18:02,887: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:18:02.950371010Z [2024-05-25 00:18:02,950: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:18:02.990808675Z [2024-05-25 00:18:02,990: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:18:04.788332190Z [2024-05-25 00:18:04,787: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[82078046-ebd7-497a-98fc-1cfd58c608ff] succeeded in 3.821687636999741s: None 2024-05-25T00:18:05.424655075Z [2024-05-25 00:18:05,423: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b5a031ee-5f36-4d15-8003-ab04427b6a56] succeeded in 4.456366655999773s: None 2024-05-25T00:19:00.379107549Z [2024-05-25 00:19:00,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15d52c1f-f9bc-410a-bc2f-c8d2611f9d23] received 2024-05-25T00:19:00.382391168Z [2024-05-25 00:19:00,382: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b6e6cf5-2c73-4909-bd6e-6e999596bd4b] received 2024-05-25T00:19:00.390243071Z [2024-05-25 00:19:00,389: INFO/ForkPoolWorker-15] [15d52c1f-f9bc-410a-bc2f-c8d2611f9d23] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:19:00.392555618Z [2024-05-25 00:19:00,392: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51ff2087-4555-4f58-945d-974f12e169a9] received 2024-05-25T00:19:00.413012527Z [2024-05-25 00:19:00,412: INFO/ForkPoolWorker-16] [2b6e6cf5-2c73-4909-bd6e-6e999596bd4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:19:00.421289989Z [2024-05-25 00:19:00,419: INFO/ForkPoolWorker-1] [51ff2087-4555-4f58-945d-974f12e169a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:19:00.797330726Z [2024-05-25 00:19:00,790: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:19:00.843286762Z [2024-05-25 00:19:00,839: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:19:00.896895941Z [2024-05-25 00:19:00,889: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:19:01.033304652Z [2024-05-25 00:19:01,030: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T00:19:01.036366308Z [2024-05-25 00:19:01,035: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:19:01.058342015Z [2024-05-25 00:19:01,058: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:19:01.059585978Z [2024-05-25 00:19:01,059: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:19:01.060120584Z [2024-05-25 00:19:01,059: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:19:01.060126671Z [2024-05-25 00:19:01,059: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T00:19:01.060130738Z [2024-05-25 00:19:01,059: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:19:01.183094350Z [2024-05-25 00:19:01,175: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:19:01.891294313Z [2024-05-25 00:19:01,890: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2b6e6cf5-2c73-4909-bd6e-6e999596bd4b] succeeded in 1.5058133439997619s: None 2024-05-25T00:19:02.061936734Z [2024-05-25 00:19:02,061: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:19:02.065484397Z [2024-05-25 00:19:02,064: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:19:02.089733644Z [2024-05-25 00:19:02,086: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:19:02.089743031Z [2024-05-25 00:19:02,087: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:19:02.089746850Z [2024-05-25 00:19:02,087: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:19:02.089752754Z [2024-05-25 00:19:02,087: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:19:02.089756719Z [2024-05-25 00:19:02,088: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:19:02.089759857Z [2024-05-25 00:19:02,088: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:19:02.089762976Z [2024-05-25 00:19:02,088: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:19:02.159391288Z [2024-05-25 00:19:02,159: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:19:02.351609748Z [2024-05-25 00:19:02,351: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:19:02.354722301Z [2024-05-25 00:19:02,354: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:19:02.424854646Z [2024-05-25 00:19:02,424: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:19:02.428579490Z [2024-05-25 00:19:02,425: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:19:02.428588651Z [2024-05-25 00:19:02,426: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:19:02.428598053Z [2024-05-25 00:19:02,426: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:19:02.428624249Z [2024-05-25 00:19:02,426: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:19:02.428629726Z [2024-05-25 00:19:02,426: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:19:02.428634965Z [2024-05-25 00:19:02,426: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:19:02.537059066Z [2024-05-25 00:19:02,533: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:19:03.716781139Z [2024-05-25 00:19:03,716: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[15d52c1f-f9bc-410a-bc2f-c8d2611f9d23] succeeded in 3.3325838569999178s: None 2024-05-25T00:19:05.526546357Z [2024-05-25 00:19:05,526: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[51ff2087-4555-4f58-945d-974f12e169a9] succeeded in 5.119308547999935s: None 2024-05-25T00:20:01.188204585Z [2024-05-25 00:20:01,187: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a73e9e8-e209-41b9-a3b8-f01253246cda] received 2024-05-25T00:20:01.200537668Z [2024-05-25 00:20:01,200: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61ea3e63-f6f8-48af-bcdd-edd4d011572e] received 2024-05-25T00:20:01.200745629Z [2024-05-25 00:20:01,200: INFO/ForkPoolWorker-15] [5a73e9e8-e209-41b9-a3b8-f01253246cda] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:20:01.211794164Z [2024-05-25 00:20:01,211: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[681bada7-e9c2-46f7-9428-df7f949444e7] received 2024-05-25T00:20:01.217272981Z [2024-05-25 00:20:01,216: INFO/ForkPoolWorker-16] [61ea3e63-f6f8-48af-bcdd-edd4d011572e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:20:01.221733747Z [2024-05-25 00:20:01,221: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dcd53ed8-1d63-44e9-8915-5fdb4985971c] received 2024-05-25T00:20:01.223412152Z [2024-05-25 00:20:01,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bcdd4755-be47-43be-bb00-014ee9c78a7d] received 2024-05-25T00:20:01.231479649Z [2024-05-25 00:20:01,231: INFO/ForkPoolWorker-1] [681bada7-e9c2-46f7-9428-df7f949444e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:20:01.242520724Z [2024-05-25 00:20:01,242: INFO/ForkPoolWorker-2] [dcd53ed8-1d63-44e9-8915-5fdb4985971c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:20:01.243509448Z [2024-05-25 00:20:01,242: INFO/ForkPoolWorker-3] [bcdd4755-be47-43be-bb00-014ee9c78a7d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:20:01.592217567Z [2024-05-25 00:20:01,588: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:20:01.753620215Z [2024-05-25 00:20:01,750: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:20:01.818403548Z [2024-05-25 00:20:01,814: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:20:01.871811153Z [2024-05-25 00:20:01,868: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:20:01.945284657Z [2024-05-25 00:20:01,941: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:20:02.029613604Z [2024-05-25 00:20:02,029: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T00:20:02.039458410Z [2024-05-25 00:20:02,038: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:20:02.078574333Z [2024-05-25 00:20:02,078: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:20:02.082177646Z [2024-05-25 00:20:02,081: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:20:02.082550990Z [2024-05-25 00:20:02,082: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:20:02.082690260Z [2024-05-25 00:20:02,082: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T00:20:02.082965522Z [2024-05-25 00:20:02,082: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:20:02.310558029Z [2024-05-25 00:20:02,310: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:20:02.766379076Z [2024-05-25 00:20:02,766: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:20:02.950508822Z [2024-05-25 00:20:02,950: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[dcd53ed8-1d63-44e9-8915-5fdb4985971c] succeeded in 1.7265045640006065s: None 2024-05-25T00:20:03.673127558Z [2024-05-25 00:20:03,672: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[61ea3e63-f6f8-48af-bcdd-edd4d011572e] succeeded in 2.4704054220001126s: None 2024-05-25T00:20:03.700412629Z [2024-05-25 00:20:03,700: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:20:03.703673430Z [2024-05-25 00:20:03,703: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:20:03.719800131Z [2024-05-25 00:20:03,719: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:20:03.721296160Z [2024-05-25 00:20:03,721: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:20:03.721358402Z [2024-05-25 00:20:03,721: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:20:03.721531495Z [2024-05-25 00:20:03,721: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:20:03.721593521Z [2024-05-25 00:20:03,721: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:20:03.722043215Z [2024-05-25 00:20:03,721: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:20:03.722054283Z [2024-05-25 00:20:03,721: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:20:03.735847768Z [2024-05-25 00:20:03,735: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:20:03.739385351Z [2024-05-25 00:20:03,738: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:20:03.770989800Z [2024-05-25 00:20:03,770: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:20:03.773660479Z [2024-05-25 00:20:03,773: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:20:03.773917465Z [2024-05-25 00:20:03,773: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:20:03.774172550Z [2024-05-25 00:20:03,773: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:20:03.774293574Z [2024-05-25 00:20:03,774: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:20:03.774681642Z [2024-05-25 00:20:03,774: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:20:03.775290157Z [2024-05-25 00:20:03,775: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:20:03.830370522Z [2024-05-25 00:20:03,830: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:20:03.832487015Z [2024-05-25 00:20:03,832: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-25T00:20:03.835773560Z [2024-05-25 00:20:03,835: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:20:03.876415286Z [2024-05-25 00:20:03,874: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T00:20:03.884068739Z [2024-05-25 00:20:03,877: INFO/ForkPoolWorker-3] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:20:03.884089975Z [2024-05-25 00:20:03,877: INFO/ForkPoolWorker-3] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:20:03.885949083Z [2024-05-25 00:20:03,877: INFO/ForkPoolWorker-3] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:20:03.885966892Z [2024-05-25 00:20:03,884: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-25T00:20:03.885971483Z [2024-05-25 00:20:03,885: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:20:03.885974746Z [2024-05-25 00:20:03,885: INFO/ForkPoolWorker-3] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:20:03.983534091Z [2024-05-25 00:20:03,972: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:20:04.099159025Z [2024-05-25 00:20:04,098: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:20:04.695008393Z [2024-05-25 00:20:04,694: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5a73e9e8-e209-41b9-a3b8-f01253246cda] succeeded in 3.502819904999342s: None 2024-05-25T00:20:05.182072665Z [2024-05-25 00:20:05,181: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48756e02-5e5d-4398-aa46-21682e878bb7] received 2024-05-25T00:20:05.195918198Z [2024-05-25 00:20:05,195: INFO/ForkPoolWorker-15] [48756e02-5e5d-4398-aa46-21682e878bb7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:20:05.476670528Z [2024-05-25 00:20:05,473: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:20:05.704404521Z [2024-05-25 00:20:05,703: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[bcdd4755-be47-43be-bb00-014ee9c78a7d] succeeded in 4.47750645799988s: None 2024-05-25T00:20:05.844273605Z [2024-05-25 00:20:05,843: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[681bada7-e9c2-46f7-9428-df7f949444e7] succeeded in 4.619633250000334s: None 2024-05-25T00:20:06.781204312Z [2024-05-25 00:20:06,780: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:20:06.784939041Z [2024-05-25 00:20:06,784: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:20:06.804660669Z [2024-05-25 00:20:06,804: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:20:06.806021241Z [2024-05-25 00:20:06,805: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:20:06.806081762Z [2024-05-25 00:20:06,805: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:20:06.806248831Z [2024-05-25 00:20:06,806: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:20:06.806305127Z [2024-05-25 00:20:06,806: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:20:06.806581214Z [2024-05-25 00:20:06,806: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:20:06.806677404Z [2024-05-25 00:20:06,806: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:20:06.904008425Z [2024-05-25 00:20:06,903: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:20:07.596649420Z [2024-05-25 00:20:07,596: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[48756e02-5e5d-4398-aa46-21682e878bb7] succeeded in 2.4116412490002404s: None 2024-05-25T00:20:07.639246290Z [2024-05-25 00:20:07,639: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f22511ac-574c-41f7-b925-1138a3ed8479] received 2024-05-25T00:20:07.649961475Z [2024-05-25 00:20:07,649: INFO/ForkPoolWorker-15] [f22511ac-574c-41f7-b925-1138a3ed8479] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T00:20:08.127950830Z [2024-05-25 00:20:08,124: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:20:09.265056848Z [2024-05-25 00:20:09,264: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:20:09.268485544Z [2024-05-25 00:20:09,268: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:20:09.291781312Z [2024-05-25 00:20:09,291: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:20:09.293404737Z [2024-05-25 00:20:09,293: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:20:09.293440016Z [2024-05-25 00:20:09,293: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:20:09.293597979Z [2024-05-25 00:20:09,293: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:20:09.293638327Z [2024-05-25 00:20:09,293: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:20:09.293923661Z [2024-05-25 00:20:09,293: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:20:09.293962123Z [2024-05-25 00:20:09,293: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:20:09.388438861Z [2024-05-25 00:20:09,388: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:20:10.009681012Z [2024-05-25 00:20:10,008: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f22511ac-574c-41f7-b925-1138a3ed8479] succeeded in 2.3650668700001916s: None 2024-05-25T00:20:10.282637504Z [2024-05-25 00:20:10,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b38656ae-5401-4841-8ed6-ad323579f4f5] received 2024-05-25T00:20:10.294976652Z [2024-05-25 00:20:10,294: INFO/ForkPoolWorker-15] [b38656ae-5401-4841-8ed6-ad323579f4f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:20:10.578754080Z [2024-05-25 00:20:10,575: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:20:11.653713037Z [2024-05-25 00:20:11,653: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:20:11.656837971Z [2024-05-25 00:20:11,656: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:20:11.679516067Z [2024-05-25 00:20:11,679: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:20:11.680989821Z [2024-05-25 00:20:11,680: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:20:11.681013185Z [2024-05-25 00:20:11,680: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:20:11.681263247Z [2024-05-25 00:20:11,680: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:20:11.681297237Z [2024-05-25 00:20:11,681: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:20:11.681588226Z [2024-05-25 00:20:11,681: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:20:11.681609184Z [2024-05-25 00:20:11,681: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:20:11.784635042Z [2024-05-25 00:20:11,784: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:20:12.513429943Z [2024-05-25 00:20:12,512: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b38656ae-5401-4841-8ed6-ad323579f4f5] succeeded in 2.2287598129996695s: None 2024-05-25T00:21:01.178504628Z [2024-05-25 00:21:01,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4791dc92-252a-4944-a363-26efe55924ae] received 2024-05-25T00:21:01.185825324Z [2024-05-25 00:21:01,185: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ebafd8f-4074-40ae-a63d-a27c4330cb27] received 2024-05-25T00:21:01.188425667Z [2024-05-25 00:21:01,188: INFO/ForkPoolWorker-15] [4791dc92-252a-4944-a363-26efe55924ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:21:01.197632303Z [2024-05-25 00:21:01,197: INFO/ForkPoolWorker-16] [9ebafd8f-4074-40ae-a63d-a27c4330cb27] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:21:01.202002342Z [2024-05-25 00:21:01,201: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4af808a8-f2ce-4939-b198-05e19a6c3da7] received 2024-05-25T00:21:01.217021707Z [2024-05-25 00:21:01,216: INFO/ForkPoolWorker-1] [4af808a8-f2ce-4939-b198-05e19a6c3da7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:21:01.524327861Z [2024-05-25 00:21:01,521: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:21:01.561169681Z [2024-05-25 00:21:01,556: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:21:01.621628776Z [2024-05-25 00:21:01,618: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:21:01.684801227Z [2024-05-25 00:21:01,684: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T00:21:01.688812885Z [2024-05-25 00:21:01,688: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:21:01.717512530Z [2024-05-25 00:21:01,717: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:21:01.719315424Z [2024-05-25 00:21:01,719: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:21:01.720066293Z [2024-05-25 00:21:01,719: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:21:01.720258712Z [2024-05-25 00:21:01,719: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T00:21:01.720704364Z [2024-05-25 00:21:01,720: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:21:01.806261530Z [2024-05-25 00:21:01,806: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:21:02.447845202Z [2024-05-25 00:21:02,447: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4791dc92-252a-4944-a363-26efe55924ae] succeeded in 1.267258509000385s: None 2024-05-25T00:21:02.878102123Z [2024-05-25 00:21:02,877: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:21:02.883424909Z [2024-05-25 00:21:02,882: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:21:02.900185395Z [2024-05-25 00:21:02,899: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:21:02.901794158Z [2024-05-25 00:21:02,901: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:21:02.901907156Z [2024-05-25 00:21:02,901: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:21:02.902082183Z [2024-05-25 00:21:02,901: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:21:02.902211542Z [2024-05-25 00:21:02,902: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:21:02.902565610Z [2024-05-25 00:21:02,902: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:21:02.902602622Z [2024-05-25 00:21:02,902: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:21:03.005268516Z [2024-05-25 00:21:03,004: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:21:03.050886377Z [2024-05-25 00:21:03,050: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:21:03.054297864Z [2024-05-25 00:21:03,053: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:21:03.083306681Z [2024-05-25 00:21:03,083: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:21:03.085395078Z [2024-05-25 00:21:03,085: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:21:03.085565693Z [2024-05-25 00:21:03,085: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:21:03.085820589Z [2024-05-25 00:21:03,085: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:21:03.086026078Z [2024-05-25 00:21:03,085: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:21:03.086462406Z [2024-05-25 00:21:03,086: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:21:03.087032200Z [2024-05-25 00:21:03,086: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:21:03.165434891Z [2024-05-25 00:21:03,165: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:21:04.688044767Z [2024-05-25 00:21:04,687: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9ebafd8f-4074-40ae-a63d-a27c4330cb27] succeeded in 3.4999810479994267s: None 2024-05-25T00:21:05.042413950Z [2024-05-25 00:21:05,041: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4af808a8-f2ce-4939-b198-05e19a6c3da7] succeeded in 3.8376181929997983s: None 2024-05-25T00:22:00.577447937Z [2024-05-25 00:22:00,576: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d716517c-5619-4dee-bbd3-e1ba17c76a6d] received 2024-05-25T00:22:00.579624605Z [2024-05-25 00:22:00,579: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0305d659-36f0-4966-a388-a60bfbef2709] received 2024-05-25T00:22:00.589883297Z [2024-05-25 00:22:00,589: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c9bdc25-8b2b-462e-9b09-787fda00aae5] received 2024-05-25T00:22:00.592452348Z [2024-05-25 00:22:00,590: INFO/ForkPoolWorker-16] [0305d659-36f0-4966-a388-a60bfbef2709] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:22:00.593819801Z [2024-05-25 00:22:00,593: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ccc565e2-b9bf-437d-80ed-16c25b0d9726] received 2024-05-25T00:22:00.597659543Z [2024-05-25 00:22:00,597: INFO/ForkPoolWorker-15] [d716517c-5619-4dee-bbd3-e1ba17c76a6d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:22:00.602400463Z [2024-05-25 00:22:00,602: INFO/ForkPoolWorker-1] [0c9bdc25-8b2b-462e-9b09-787fda00aae5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:22:00.609082575Z [2024-05-25 00:22:00,608: INFO/ForkPoolWorker-2] [ccc565e2-b9bf-437d-80ed-16c25b0d9726] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:22:00.895939772Z [2024-05-25 00:22:00,892: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:22:00.907899479Z [2024-05-25 00:22:00,904: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:22:00.943152069Z [2024-05-25 00:22:00,939: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:22:01.091288660Z [2024-05-25 00:22:01,086: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:22:01.147836840Z [2024-05-25 00:22:01,147: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:22:01.255712924Z [2024-05-25 00:22:01,255: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T00:22:01.259467474Z [2024-05-25 00:22:01,259: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:22:01.292944643Z [2024-05-25 00:22:01,292: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:22:01.295566162Z [2024-05-25 00:22:01,295: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:22:01.295664460Z [2024-05-25 00:22:01,295: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:22:01.295716996Z [2024-05-25 00:22:01,295: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T00:22:01.295965896Z [2024-05-25 00:22:01,295: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:22:01.425356573Z [2024-05-25 00:22:01,424: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:22:01.849849147Z [2024-05-25 00:22:01,849: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d716517c-5619-4dee-bbd3-e1ba17c76a6d] succeeded in 1.2663474930004668s: None 2024-05-25T00:22:02.134320038Z [2024-05-25 00:22:02,133: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0305d659-36f0-4966-a388-a60bfbef2709] succeeded in 1.5519587620001403s: None 2024-05-25T00:22:02.340551886Z [2024-05-25 00:22:02,339: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:22:02.343859372Z [2024-05-25 00:22:02,343: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:22:02.356249245Z [2024-05-25 00:22:02,355: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T00:22:02.359791856Z [2024-05-25 00:22:02,359: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:22:02.384029700Z [2024-05-25 00:22:02,383: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:22:02.385069623Z [2024-05-25 00:22:02,384: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:22:02.386295076Z [2024-05-25 00:22:02,386: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:22:02.386404712Z [2024-05-25 00:22:02,386: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:22:02.386580991Z [2024-05-25 00:22:02,386: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:22:02.386663960Z [2024-05-25 00:22:02,386: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:22:02.386911727Z [2024-05-25 00:22:02,386: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:22:02.387015533Z [2024-05-25 00:22:02,386: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:22:02.390451691Z [2024-05-25 00:22:02,390: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:22:02.404906016Z [2024-05-25 00:22:02,390: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:22:02.404913775Z [2024-05-25 00:22:02,390: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:22:02.404917694Z [2024-05-25 00:22:02,390: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T00:22:02.404920839Z [2024-05-25 00:22:02,401: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:22:02.404924281Z [2024-05-25 00:22:02,403: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:22:02.506061938Z [2024-05-25 00:22:02,505: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:22:02.508937996Z [2024-05-25 00:22:02,508: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:22:04.842136092Z [2024-05-25 00:22:04,841: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0c9bdc25-8b2b-462e-9b09-787fda00aae5] succeeded in 4.2506607539999095s: None 2024-05-25T00:22:05.195315725Z [2024-05-25 00:22:05,194: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ccc565e2-b9bf-437d-80ed-16c25b0d9726] succeeded in 4.598870668999552s: None 2024-05-25T00:23:00.965851195Z [2024-05-25 00:23:00,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[386ffdc1-a0bd-4d87-946d-bb9041488d4c] received 2024-05-25T00:23:00.970535574Z [2024-05-25 00:23:00,970: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[270c2181-fd15-440e-b335-7b86f5616f61] received 2024-05-25T00:23:00.981833291Z [2024-05-25 00:23:00,981: INFO/ForkPoolWorker-15] [386ffdc1-a0bd-4d87-946d-bb9041488d4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:23:00.983161564Z [2024-05-25 00:23:00,982: INFO/ForkPoolWorker-16] [270c2181-fd15-440e-b335-7b86f5616f61] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:23:00.986255488Z [2024-05-25 00:23:00,985: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b7b1257-a6cc-4c8e-8c17-55109c59099a] received 2024-05-25T00:23:01.012358094Z [2024-05-25 00:23:01,011: INFO/ForkPoolWorker-1] [2b7b1257-a6cc-4c8e-8c17-55109c59099a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:23:01.341410085Z [2024-05-25 00:23:01,337: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:23:01.358260861Z [2024-05-25 00:23:01,346: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:23:01.418224220Z [2024-05-25 00:23:01,414: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:23:01.493724935Z [2024-05-25 00:23:01,493: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T00:23:01.497341979Z [2024-05-25 00:23:01,496: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:23:01.518671125Z [2024-05-25 00:23:01,518: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:23:01.519721846Z [2024-05-25 00:23:01,519: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:23:01.519808822Z [2024-05-25 00:23:01,519: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:23:01.519831263Z [2024-05-25 00:23:01,519: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T00:23:01.520020634Z [2024-05-25 00:23:01,519: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:23:01.643031460Z [2024-05-25 00:23:01,642: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:23:02.318782994Z [2024-05-25 00:23:02,318: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[386ffdc1-a0bd-4d87-946d-bb9041488d4c] succeeded in 1.348858620000101s: None 2024-05-25T00:23:02.665445043Z [2024-05-25 00:23:02,664: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:23:02.668934402Z [2024-05-25 00:23:02,668: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:23:02.680466552Z [2024-05-25 00:23:02,680: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:23:02.683692050Z [2024-05-25 00:23:02,683: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:23:02.693088094Z [2024-05-25 00:23:02,692: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:23:02.694551766Z [2024-05-25 00:23:02,694: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:23:02.694599918Z [2024-05-25 00:23:02,694: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:23:02.694723708Z [2024-05-25 00:23:02,694: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:23:02.694948564Z [2024-05-25 00:23:02,694: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:23:02.695354767Z [2024-05-25 00:23:02,695: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:23:02.695496356Z [2024-05-25 00:23:02,695: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:23:02.706043576Z [2024-05-25 00:23:02,705: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:23:02.707444171Z [2024-05-25 00:23:02,707: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:23:02.707570324Z [2024-05-25 00:23:02,707: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:23:02.707761899Z [2024-05-25 00:23:02,707: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:23:02.707814373Z [2024-05-25 00:23:02,707: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:23:02.708199072Z [2024-05-25 00:23:02,708: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:23:02.708342301Z [2024-05-25 00:23:02,708: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:23:02.789202870Z [2024-05-25 00:23:02,788: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:23:02.789474687Z [2024-05-25 00:23:02,789: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:23:04.820888001Z [2024-05-25 00:23:04,820: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[270c2181-fd15-440e-b335-7b86f5616f61] succeeded in 3.8470826800003124s: None 2024-05-25T00:23:05.398261154Z [2024-05-25 00:23:05,397: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2b7b1257-a6cc-4c8e-8c17-55109c59099a] succeeded in 4.406468891999793s: None 2024-05-25T00:24:00.347618879Z [2024-05-25 00:24:00,347: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68ae60c2-5999-439d-a631-0989a1e7b1cb] received 2024-05-25T00:24:00.352797971Z [2024-05-25 00:24:00,352: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b282496-e207-495b-8499-95fb02cb3cb1] received 2024-05-25T00:24:00.356542720Z [2024-05-25 00:24:00,356: INFO/ForkPoolWorker-15] [68ae60c2-5999-439d-a631-0989a1e7b1cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:24:00.372039286Z [2024-05-25 00:24:00,371: INFO/ForkPoolWorker-16] [6b282496-e207-495b-8499-95fb02cb3cb1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:24:00.374277653Z [2024-05-25 00:24:00,374: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f5dd685-afdf-4d70-a0d8-3c934dddea03] received 2024-05-25T00:24:00.381273799Z [2024-05-25 00:24:00,381: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0c94ab3-7f37-48d7-bc8e-96bf38598d42] received 2024-05-25T00:24:00.394406086Z [2024-05-25 00:24:00,393: INFO/ForkPoolWorker-1] [8f5dd685-afdf-4d70-a0d8-3c934dddea03] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:24:00.407082162Z [2024-05-25 00:24:00,406: INFO/ForkPoolWorker-2] [e0c94ab3-7f37-48d7-bc8e-96bf38598d42] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:24:00.824429976Z [2024-05-25 00:24:00,813: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:24:00.834055269Z [2024-05-25 00:24:00,818: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:24:00.874640845Z [2024-05-25 00:24:00,871: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:24:01.029086742Z [2024-05-25 00:24:01,025: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:24:01.121322265Z [2024-05-25 00:24:01,121: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:24:01.501041571Z [2024-05-25 00:24:01,500: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T00:24:01.508416647Z [2024-05-25 00:24:01,506: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:24:01.554445044Z [2024-05-25 00:24:01,550: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:24:01.557637182Z [2024-05-25 00:24:01,556: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:24:01.557645902Z [2024-05-25 00:24:01,556: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:24:01.557650134Z [2024-05-25 00:24:01,556: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T00:24:01.558119433Z [2024-05-25 00:24:01,557: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:24:01.701255225Z [2024-05-25 00:24:01,701: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:24:01.850424783Z [2024-05-25 00:24:01,850: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[68ae60c2-5999-439d-a631-0989a1e7b1cb] succeeded in 1.5002064440004688s: None 2024-05-25T00:24:02.646232046Z [2024-05-25 00:24:02,645: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6b282496-e207-495b-8499-95fb02cb3cb1] succeeded in 2.2896882049999476s: None 2024-05-25T00:24:02.686662971Z [2024-05-25 00:24:02,686: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T00:24:02.690106622Z [2024-05-25 00:24:02,689: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:24:02.705665176Z [2024-05-25 00:24:02,705: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:24:02.708937663Z [2024-05-25 00:24:02,708: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:24:02.727848972Z [2024-05-25 00:24:02,725: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:24:02.730645510Z [2024-05-25 00:24:02,730: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:24:02.730894133Z [2024-05-25 00:24:02,730: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:24:02.731181577Z [2024-05-25 00:24:02,730: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:24:02.731363551Z [2024-05-25 00:24:02,731: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T00:24:02.731721364Z [2024-05-25 00:24:02,731: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:24:02.731850791Z [2024-05-25 00:24:02,731: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:24:02.742415529Z [2024-05-25 00:24:02,742: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:24:02.743851068Z [2024-05-25 00:24:02,743: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:24:02.743867781Z [2024-05-25 00:24:02,743: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:24:02.744044940Z [2024-05-25 00:24:02,743: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:24:02.744056430Z [2024-05-25 00:24:02,743: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:24:02.744332550Z [2024-05-25 00:24:02,744: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:24:02.744340819Z [2024-05-25 00:24:02,744: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:24:02.807534970Z [2024-05-25 00:24:02,807: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:24:02.850098920Z [2024-05-25 00:24:02,849: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:24:04.779093103Z [2024-05-25 00:24:04,778: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8f5dd685-afdf-4d70-a0d8-3c934dddea03] succeeded in 4.396243363999929s: None 2024-05-25T00:24:05.381009336Z [2024-05-25 00:24:05,380: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e0c94ab3-7f37-48d7-bc8e-96bf38598d42] succeeded in 4.989140433000102s: None 2024-05-25T00:25:01.002599199Z [2024-05-25 00:25:01,002: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70777a7e-2e86-4646-92bf-467b878b2d39] received 2024-05-25T00:25:01.007230552Z [2024-05-25 00:25:01,007: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66e5159c-9ddb-4ca6-ab76-20d4cbaeb7a5] received 2024-05-25T00:25:01.013750491Z [2024-05-25 00:25:01,013: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[910ecab0-68d0-4065-ae71-b1df9c750c39] received 2024-05-25T00:25:01.013832495Z [2024-05-25 00:25:01,013: INFO/ForkPoolWorker-15] [70777a7e-2e86-4646-92bf-467b878b2d39] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:25:01.024224687Z [2024-05-25 00:25:01,023: INFO/ForkPoolWorker-16] [66e5159c-9ddb-4ca6-ab76-20d4cbaeb7a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:25:01.031145681Z [2024-05-25 00:25:01,030: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e657a3d-3d10-43d8-999f-c22b8d44d50a] received 2024-05-25T00:25:01.032754654Z [2024-05-25 00:25:01,031: INFO/ForkPoolWorker-1] [910ecab0-68d0-4065-ae71-b1df9c750c39] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:25:01.050789964Z [2024-05-25 00:25:01,049: INFO/ForkPoolWorker-2] [4e657a3d-3d10-43d8-999f-c22b8d44d50a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:25:01.317197633Z [2024-05-25 00:25:01,313: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:25:01.384521089Z [2024-05-25 00:25:01,379: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:25:01.396881972Z [2024-05-25 00:25:01,393: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:25:01.635883125Z [2024-05-25 00:25:01,631: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:25:01.826494225Z [2024-05-25 00:25:01,826: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T00:25:01.831482702Z [2024-05-25 00:25:01,831: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:25:01.852792356Z [2024-05-25 00:25:01,852: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:25:01.854016140Z [2024-05-25 00:25:01,853: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:25:01.854081845Z [2024-05-25 00:25:01,853: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:25:01.854145887Z [2024-05-25 00:25:01,854: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T00:25:01.854343029Z [2024-05-25 00:25:01,854: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:25:01.989247080Z [2024-05-25 00:25:01,988: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:25:02.879142885Z [2024-05-25 00:25:02,878: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[910ecab0-68d0-4065-ae71-b1df9c750c39] succeeded in 1.860853858000155s: None 2024-05-25T00:25:02.928050540Z [2024-05-25 00:25:02,927: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:25:02.931518131Z [2024-05-25 00:25:02,931: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:25:02.943841858Z [2024-05-25 00:25:02,943: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:25:02.947623110Z [2024-05-25 00:25:02,946: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:25:02.952523435Z [2024-05-25 00:25:02,952: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:25:02.953875855Z [2024-05-25 00:25:02,953: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:25:02.954017544Z [2024-05-25 00:25:02,953: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:25:02.954207871Z [2024-05-25 00:25:02,954: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:25:02.954244057Z [2024-05-25 00:25:02,954: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:25:02.954511834Z [2024-05-25 00:25:02,954: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:25:02.954589185Z [2024-05-25 00:25:02,954: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:25:02.974167579Z [2024-05-25 00:25:02,973: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:25:02.976416042Z [2024-05-25 00:25:02,976: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:25:02.976429312Z [2024-05-25 00:25:02,976: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:25:02.976602869Z [2024-05-25 00:25:02,976: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:25:02.976636446Z [2024-05-25 00:25:02,976: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:25:02.976881816Z [2024-05-25 00:25:02,976: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:25:02.976932409Z [2024-05-25 00:25:02,976: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:25:02.998772885Z [2024-05-25 00:25:02,998: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T00:25:03.002848334Z [2024-05-25 00:25:03,002: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:25:03.024732193Z [2024-05-25 00:25:03,024: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:25:03.027062470Z [2024-05-25 00:25:03,026: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:25:03.027182057Z [2024-05-25 00:25:03,026: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:25:03.027399388Z [2024-05-25 00:25:03,027: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:25:03.027520763Z [2024-05-25 00:25:03,027: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T00:25:03.028670039Z [2024-05-25 00:25:03,028: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:25:03.028768840Z [2024-05-25 00:25:03,028: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:25:03.076155695Z [2024-05-25 00:25:03,075: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:25:03.096960042Z [2024-05-25 00:25:03,096: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:25:03.135411192Z [2024-05-25 00:25:03,135: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:25:03.718490888Z [2024-05-25 00:25:03,717: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17805b1b-0ac5-46d5-98a7-91534d70078b] received 2024-05-25T00:25:03.730348177Z [2024-05-25 00:25:03,729: INFO/ForkPoolWorker-1] [17805b1b-0ac5-46d5-98a7-91534d70078b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:25:03.788535216Z [2024-05-25 00:25:03,788: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[66e5159c-9ddb-4ca6-ab76-20d4cbaeb7a5] succeeded in 2.7785089810004138s: None 2024-05-25T00:25:04.096125022Z [2024-05-25 00:25:04,093: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:25:04.713942775Z [2024-05-25 00:25:04,713: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[70777a7e-2e86-4646-92bf-467b878b2d39] succeeded in 3.707506368000395s: None 2024-05-25T00:25:05.133356990Z [2024-05-25 00:25:05,132: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4e657a3d-3d10-43d8-999f-c22b8d44d50a] succeeded in 4.0988666390003345s: None 2024-05-25T00:25:05.276478122Z [2024-05-25 00:25:05,275: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:25:05.279633417Z [2024-05-25 00:25:05,279: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:25:05.306987051Z [2024-05-25 00:25:05,306: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:25:05.309039538Z [2024-05-25 00:25:05,308: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:25:05.309136206Z [2024-05-25 00:25:05,308: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:25:05.309497967Z [2024-05-25 00:25:05,309: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:25:05.309602754Z [2024-05-25 00:25:05,309: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:25:05.310049643Z [2024-05-25 00:25:05,309: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:25:05.310174401Z [2024-05-25 00:25:05,309: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:25:05.413700484Z [2024-05-25 00:25:05,413: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:25:06.057351089Z [2024-05-25 00:25:06,050: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[17805b1b-0ac5-46d5-98a7-91534d70078b] succeeded in 2.3313370949999808s: None 2024-05-25T00:25:06.294137679Z [2024-05-25 00:25:06,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e87acca7-cacf-4729-a3c4-10334fe965e0] received 2024-05-25T00:25:06.309553167Z [2024-05-25 00:25:06,309: INFO/ForkPoolWorker-15] [e87acca7-cacf-4729-a3c4-10334fe965e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T00:25:06.677481697Z [2024-05-25 00:25:06,674: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:25:07.726706169Z [2024-05-25 00:25:07,726: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:25:07.730048631Z [2024-05-25 00:25:07,729: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:25:07.774585777Z [2024-05-25 00:25:07,774: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:25:07.778608896Z [2024-05-25 00:25:07,778: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:25:07.778697853Z [2024-05-25 00:25:07,778: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:25:07.778887211Z [2024-05-25 00:25:07,778: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:25:07.778975478Z [2024-05-25 00:25:07,778: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:25:07.779312319Z [2024-05-25 00:25:07,779: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:25:07.779403632Z [2024-05-25 00:25:07,779: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:25:07.897557164Z [2024-05-25 00:25:07,897: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:25:08.563180467Z [2024-05-25 00:25:08,562: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e87acca7-cacf-4729-a3c4-10334fe965e0] succeeded in 2.2652013740007533s: None 2024-05-25T00:25:08.662660160Z [2024-05-25 00:25:08,662: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7fdc5988-3f8b-4578-93bd-c1b090d054c1] received 2024-05-25T00:25:08.669369600Z [2024-05-25 00:25:08,669: INFO/ForkPoolWorker-15] [7fdc5988-3f8b-4578-93bd-c1b090d054c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:25:08.934074442Z [2024-05-25 00:25:08,930: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:25:10.011532274Z [2024-05-25 00:25:10,011: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:25:10.014896618Z [2024-05-25 00:25:10,014: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:25:10.031889530Z [2024-05-25 00:25:10,031: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:25:10.032896794Z [2024-05-25 00:25:10,032: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:25:10.032912546Z [2024-05-25 00:25:10,032: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:25:10.033051129Z [2024-05-25 00:25:10,032: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:25:10.033108966Z [2024-05-25 00:25:10,033: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:25:10.033390631Z [2024-05-25 00:25:10,033: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:25:10.033401059Z [2024-05-25 00:25:10,033: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:25:10.125649474Z [2024-05-25 00:25:10,125: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:25:10.695677898Z [2024-05-25 00:25:10,695: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7fdc5988-3f8b-4578-93bd-c1b090d054c1] succeeded in 2.0304667880000125s: None 2024-05-25T00:26:00.983100353Z [2024-05-25 00:26:00,982: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00de29ac-a6b0-4dfe-aebe-0e2cc4680344] received 2024-05-25T00:26:00.985998534Z [2024-05-25 00:26:00,985: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20e048eb-44f8-4c45-b8d2-e2481d4fbe5e] received 2024-05-25T00:26:00.988786128Z [2024-05-25 00:26:00,988: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf8e666c-3441-4da7-81de-6187392def31] received 2024-05-25T00:26:00.993115399Z [2024-05-25 00:26:00,992: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6fd5c07-df9d-4da3-93dc-d3d675bf1843] received 2024-05-25T00:26:01.002466497Z [2024-05-25 00:26:01,002: INFO/ForkPoolWorker-15] [00de29ac-a6b0-4dfe-aebe-0e2cc4680344] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:26:01.010804266Z [2024-05-25 00:26:01,010: INFO/ForkPoolWorker-1] [cf8e666c-3441-4da7-81de-6187392def31] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:26:01.017107674Z [2024-05-25 00:26:01,016: INFO/ForkPoolWorker-16] [20e048eb-44f8-4c45-b8d2-e2481d4fbe5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:26:01.022159621Z [2024-05-25 00:26:01,021: INFO/ForkPoolWorker-2] [c6fd5c07-df9d-4da3-93dc-d3d675bf1843] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:26:01.344054928Z [2024-05-25 00:26:01,338: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:26:01.381429880Z [2024-05-25 00:26:01,377: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:26:01.391536445Z [2024-05-25 00:26:01,384: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:26:01.483546142Z [2024-05-25 00:26:01,476: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:26:01.649744694Z [2024-05-25 00:26:01,649: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:26:01.727715607Z [2024-05-25 00:26:01,727: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T00:26:01.731777904Z [2024-05-25 00:26:01,731: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:26:01.769194598Z [2024-05-25 00:26:01,768: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:26:01.770547755Z [2024-05-25 00:26:01,770: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:26:01.770661110Z [2024-05-25 00:26:01,770: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:26:01.770711283Z [2024-05-25 00:26:01,770: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T00:26:01.770961398Z [2024-05-25 00:26:01,770: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:26:01.891993596Z [2024-05-25 00:26:01,891: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:26:02.358631292Z [2024-05-25 00:26:02,358: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[20e048eb-44f8-4c45-b8d2-e2481d4fbe5e] succeeded in 1.3696321689994875s: None 2024-05-25T00:26:02.579524456Z [2024-05-25 00:26:02,579: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cf8e666c-3441-4da7-81de-6187392def31] succeeded in 1.5807704269991518s: None 2024-05-25T00:26:02.663694083Z [2024-05-25 00:26:02,663: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:26:02.667045113Z [2024-05-25 00:26:02,666: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:26:02.694463951Z [2024-05-25 00:26:02,694: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:26:02.695763669Z [2024-05-25 00:26:02,695: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:26:02.695807012Z [2024-05-25 00:26:02,695: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:26:02.695824988Z [2024-05-25 00:26:02,695: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:26:02.695916550Z [2024-05-25 00:26:02,695: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:26:02.696232498Z [2024-05-25 00:26:02,696: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:26:02.696245798Z [2024-05-25 00:26:02,696: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:26:02.775040646Z [2024-05-25 00:26:02,774: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:26:02.891322099Z [2024-05-25 00:26:02,890: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T00:26:02.894913684Z [2024-05-25 00:26:02,894: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:26:02.914179606Z [2024-05-25 00:26:02,913: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:26:02.915344418Z [2024-05-25 00:26:02,915: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:26:02.915472131Z [2024-05-25 00:26:02,915: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:26:02.915646299Z [2024-05-25 00:26:02,915: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:26:02.915703911Z [2024-05-25 00:26:02,915: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T00:26:02.916388816Z [2024-05-25 00:26:02,916: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:26:02.916438938Z [2024-05-25 00:26:02,916: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:26:02.995195839Z [2024-05-25 00:26:02,994: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:26:04.361588709Z [2024-05-25 00:26:04,360: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[00de29ac-a6b0-4dfe-aebe-0e2cc4680344] succeeded in 3.3714602569998533s: None 2024-05-25T00:26:05.186931716Z [2024-05-25 00:26:05,186: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c6fd5c07-df9d-4da3-93dc-d3d675bf1843] succeeded in 4.190444893999484s: None 2024-05-25T00:27:00.812753955Z [2024-05-25 00:27:00,812: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[09c253f9-a5da-42c1-ac7c-f80f3d29bde6] received 2024-05-25T00:27:00.816874217Z [2024-05-25 00:27:00,816: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d5b53a9-bcdd-4996-b3af-145548b9c73a] received 2024-05-25T00:27:00.818482474Z [2024-05-25 00:27:00,818: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06d70319-dac4-4912-b714-a85f6ce164a9] received 2024-05-25T00:27:00.826799707Z [2024-05-25 00:27:00,826: INFO/ForkPoolWorker-15] [09c253f9-a5da-42c1-ac7c-f80f3d29bde6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:27:00.831596309Z [2024-05-25 00:27:00,831: INFO/ForkPoolWorker-16] [8d5b53a9-bcdd-4996-b3af-145548b9c73a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:27:00.832968975Z [2024-05-25 00:27:00,831: INFO/ForkPoolWorker-1] [06d70319-dac4-4912-b714-a85f6ce164a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:27:01.119337312Z [2024-05-25 00:27:01,115: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:27:01.128164502Z [2024-05-25 00:27:01,124: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:27:01.132115238Z [2024-05-25 00:27:01,128: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:27:01.273277257Z [2024-05-25 00:27:01,272: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T00:27:01.278680237Z [2024-05-25 00:27:01,278: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:27:01.319175203Z [2024-05-25 00:27:01,318: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:27:01.320583878Z [2024-05-25 00:27:01,320: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:27:01.320848967Z [2024-05-25 00:27:01,320: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:27:01.321249249Z [2024-05-25 00:27:01,321: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T00:27:01.322131642Z [2024-05-25 00:27:01,321: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:27:01.462919802Z [2024-05-25 00:27:01,462: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:27:02.056351026Z [2024-05-25 00:27:02,055: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8d5b53a9-bcdd-4996-b3af-145548b9c73a] succeeded in 1.2372022759991523s: None 2024-05-25T00:27:02.370265380Z [2024-05-25 00:27:02,369: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:27:02.374659964Z [2024-05-25 00:27:02,374: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:27:02.394527444Z [2024-05-25 00:27:02,394: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:27:02.396281608Z [2024-05-25 00:27:02,396: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:27:02.396567272Z [2024-05-25 00:27:02,396: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:27:02.396863333Z [2024-05-25 00:27:02,396: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:27:02.397076093Z [2024-05-25 00:27:02,396: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:27:02.397612010Z [2024-05-25 00:27:02,397: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:27:02.397826204Z [2024-05-25 00:27:02,397: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:27:02.411669559Z [2024-05-25 00:27:02,411: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:27:02.414936515Z [2024-05-25 00:27:02,414: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:27:02.436706159Z [2024-05-25 00:27:02,436: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:27:02.438139679Z [2024-05-25 00:27:02,437: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:27:02.438188299Z [2024-05-25 00:27:02,438: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:27:02.438312876Z [2024-05-25 00:27:02,438: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:27:02.438352239Z [2024-05-25 00:27:02,438: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:27:02.438690632Z [2024-05-25 00:27:02,438: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:27:02.438790091Z [2024-05-25 00:27:02,438: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:27:02.497306126Z [2024-05-25 00:27:02,496: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:27:02.529776128Z [2024-05-25 00:27:02,529: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:27:04.130650964Z [2024-05-25 00:27:04,129: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[06d70319-dac4-4912-b714-a85f6ce164a9] succeeded in 3.3098170740004207s: None 2024-05-25T00:27:04.457169664Z [2024-05-25 00:27:04,456: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[09c253f9-a5da-42c1-ac7c-f80f3d29bde6] succeeded in 3.641602416000751s: None 2024-05-25T00:28:00.237044317Z [2024-05-25 00:28:00,236: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10049ea8-b7ad-4ef8-af35-8367836f665b] received 2024-05-25T00:28:00.245774024Z [2024-05-25 00:28:00,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59267aaa-7f3f-47c1-93fa-a9fb3d3792b4] received 2024-05-25T00:28:00.252535661Z [2024-05-25 00:28:00,252: INFO/ForkPoolWorker-15] [10049ea8-b7ad-4ef8-af35-8367836f665b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:28:00.254634946Z [2024-05-25 00:28:00,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05e17378-70d9-4ca5-b1cb-1090763d518b] received 2024-05-25T00:28:00.258744972Z [2024-05-25 00:28:00,258: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80220c2d-9859-497f-b7a7-cd191934209c] received 2024-05-25T00:28:00.275200460Z [2024-05-25 00:28:00,274: INFO/ForkPoolWorker-16] [59267aaa-7f3f-47c1-93fa-a9fb3d3792b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:28:00.276756906Z [2024-05-25 00:28:00,276: INFO/ForkPoolWorker-1] [05e17378-70d9-4ca5-b1cb-1090763d518b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:28:00.282705746Z [2024-05-25 00:28:00,282: INFO/ForkPoolWorker-2] [80220c2d-9859-497f-b7a7-cd191934209c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:28:00.580764690Z [2024-05-25 00:28:00,577: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:28:00.651266775Z [2024-05-25 00:28:00,647: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:28:00.662445824Z [2024-05-25 00:28:00,659: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:28:00.664342450Z [2024-05-25 00:28:00,660: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:28:00.737560829Z [2024-05-25 00:28:00,736: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T00:28:00.742294863Z [2024-05-25 00:28:00,741: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:28:00.764912998Z [2024-05-25 00:28:00,764: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:28:00.765969183Z [2024-05-25 00:28:00,765: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:28:00.766016222Z [2024-05-25 00:28:00,765: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:28:00.766071413Z [2024-05-25 00:28:00,765: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T00:28:00.766236427Z [2024-05-25 00:28:00,766: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:28:00.931608770Z [2024-05-25 00:28:00,931: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:28:00.944249653Z [2024-05-25 00:28:00,943: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:28:01.553882208Z [2024-05-25 00:28:01,553: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[10049ea8-b7ad-4ef8-af35-8367836f665b] succeeded in 1.310462185000688s: None 2024-05-25T00:28:01.696249687Z [2024-05-25 00:28:01,695: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[80220c2d-9859-497f-b7a7-cd191934209c] succeeded in 1.434316496000065s: None 2024-05-25T00:28:02.091689699Z [2024-05-25 00:28:02,091: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:28:02.094783891Z [2024-05-25 00:28:02,094: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:28:02.122602358Z [2024-05-25 00:28:02,122: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:28:02.125047148Z [2024-05-25 00:28:02,124: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:28:02.126272322Z [2024-05-25 00:28:02,126: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:28:02.126288714Z [2024-05-25 00:28:02,126: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:28:02.126451365Z [2024-05-25 00:28:02,126: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:28:02.126461153Z [2024-05-25 00:28:02,126: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:28:02.126587159Z [2024-05-25 00:28:02,126: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:28:02.126737595Z [2024-05-25 00:28:02,126: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:28:02.126835005Z [2024-05-25 00:28:02,126: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:28:02.144695844Z [2024-05-25 00:28:02,144: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:28:02.146447332Z [2024-05-25 00:28:02,146: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:28:02.146699676Z [2024-05-25 00:28:02,146: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:28:02.146919333Z [2024-05-25 00:28:02,146: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:28:02.147060220Z [2024-05-25 00:28:02,146: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:28:02.147524549Z [2024-05-25 00:28:02,147: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:28:02.147652923Z [2024-05-25 00:28:02,147: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:28:02.220501553Z [2024-05-25 00:28:02,218: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:28:02.321424482Z [2024-05-25 00:28:02,321: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:28:03.953305804Z [2024-05-25 00:28:03,952: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[05e17378-70d9-4ca5-b1cb-1090763d518b] succeeded in 3.693292337999992s: None 2024-05-25T00:28:04.133123998Z [2024-05-25 00:28:04,132: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[59267aaa-7f3f-47c1-93fa-a9fb3d3792b4] succeeded in 3.883128573000249s: None 2024-05-25T00:29:01.278202146Z [2024-05-25 00:29:01,277: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5222382a-e5b1-4560-a528-a093f78626c4] received 2024-05-25T00:29:01.288438522Z [2024-05-25 00:29:01,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6929450-9f8a-47e5-b9a1-415ee397f97c] received 2024-05-25T00:29:01.293864399Z [2024-05-25 00:29:01,293: INFO/ForkPoolWorker-15] [5222382a-e5b1-4560-a528-a093f78626c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:29:01.295117605Z [2024-05-25 00:29:01,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05e64890-89c5-4d90-a850-7467fb68317f] received 2024-05-25T00:29:01.311525514Z [2024-05-25 00:29:01,311: INFO/ForkPoolWorker-1] [05e64890-89c5-4d90-a850-7467fb68317f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:29:01.315412973Z [2024-05-25 00:29:01,315: INFO/ForkPoolWorker-16] [b6929450-9f8a-47e5-b9a1-415ee397f97c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:29:01.654219681Z [2024-05-25 00:29:01,650: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:29:01.654452260Z [2024-05-25 00:29:01,650: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:29:01.740155187Z [2024-05-25 00:29:01,737: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:29:01.836938502Z [2024-05-25 00:29:01,836: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T00:29:01.840656049Z [2024-05-25 00:29:01,840: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:29:01.873580369Z [2024-05-25 00:29:01,873: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:29:01.875585189Z [2024-05-25 00:29:01,875: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:29:01.875677073Z [2024-05-25 00:29:01,875: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:29:01.875736996Z [2024-05-25 00:29:01,875: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T00:29:01.876179519Z [2024-05-25 00:29:01,875: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:29:01.980002920Z [2024-05-25 00:29:01,979: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:29:02.574884615Z [2024-05-25 00:29:02,574: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5222382a-e5b1-4560-a528-a093f78626c4] succeeded in 1.2900677819998236s: None 2024-05-25T00:29:03.037541246Z [2024-05-25 00:29:03,037: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:29:03.041202214Z [2024-05-25 00:29:03,040: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:29:03.062612582Z [2024-05-25 00:29:03,062: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:29:03.063940321Z [2024-05-25 00:29:03,063: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:29:03.064450296Z [2024-05-25 00:29:03,064: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:29:03.064646117Z [2024-05-25 00:29:03,064: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:29:03.064765560Z [2024-05-25 00:29:03,064: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:29:03.065049023Z [2024-05-25 00:29:03,064: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:29:03.065443638Z [2024-05-25 00:29:03,065: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:29:03.154859059Z [2024-05-25 00:29:03,154: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:29:03.158877413Z [2024-05-25 00:29:03,158: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:29:03.171554653Z [2024-05-25 00:29:03,171: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:29:03.183720619Z [2024-05-25 00:29:03,183: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:29:03.188751949Z [2024-05-25 00:29:03,185: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:29:03.188765190Z [2024-05-25 00:29:03,185: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:29:03.188769271Z [2024-05-25 00:29:03,185: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:29:03.188773334Z [2024-05-25 00:29:03,186: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:29:03.188776761Z [2024-05-25 00:29:03,186: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:29:03.188779859Z [2024-05-25 00:29:03,186: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:29:03.279687212Z [2024-05-25 00:29:03,279: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:29:05.314507064Z [2024-05-25 00:29:05,313: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[05e64890-89c5-4d90-a850-7467fb68317f] succeeded in 4.0178892670001005s: None 2024-05-25T00:29:05.530668977Z [2024-05-25 00:29:05,529: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b6929450-9f8a-47e5-b9a1-415ee397f97c] succeeded in 4.2382489789997635s: None 2024-05-25T00:30:01.280192798Z [2024-05-25 00:30:01,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b487567-70a9-4afe-8185-3ca234198c34] received 2024-05-25T00:30:01.282482202Z [2024-05-25 00:30:01,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d61805a9-3859-4159-823f-80e34ff444a8] received 2024-05-25T00:30:01.285340118Z [2024-05-25 00:30:01,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d10f8c71-c1bc-4dd2-a5ff-526d2607cc35] received 2024-05-25T00:30:01.288984708Z [2024-05-25 00:30:01,288: INFO/ForkPoolWorker-15] [2b487567-70a9-4afe-8185-3ca234198c34] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:30:01.292433250Z [2024-05-25 00:30:01,292: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d32f8ef-2bfe-41b7-ae94-63d360ff08d5] received 2024-05-25T00:30:01.294720445Z [2024-05-25 00:30:01,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6dd40749-386b-422d-b009-9eba571b7f26] received 2024-05-25T00:30:01.298148548Z [2024-05-25 00:30:01,297: INFO/ForkPoolWorker-16] [d61805a9-3859-4159-823f-80e34ff444a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:30:01.307412070Z [2024-05-25 00:30:01,306: INFO/ForkPoolWorker-2] [0d32f8ef-2bfe-41b7-ae94-63d360ff08d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:30:01.314394146Z [2024-05-25 00:30:01,313: INFO/ForkPoolWorker-3] [6dd40749-386b-422d-b009-9eba571b7f26] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:30:01.322764932Z [2024-05-25 00:30:01,322: INFO/ForkPoolWorker-1] [d10f8c71-c1bc-4dd2-a5ff-526d2607cc35] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:30:01.673920778Z [2024-05-25 00:30:01,670: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:30:01.791740738Z [2024-05-25 00:30:01,776: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:30:01.837768719Z [2024-05-25 00:30:01,833: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:30:01.861481853Z [2024-05-25 00:30:01,853: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:30:01.938084678Z [2024-05-25 00:30:01,934: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:30:02.065519837Z [2024-05-25 00:30:02,065: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T00:30:02.070256050Z [2024-05-25 00:30:02,069: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:30:02.116796307Z [2024-05-25 00:30:02,116: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:30:02.118276481Z [2024-05-25 00:30:02,118: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:30:02.118561495Z [2024-05-25 00:30:02,118: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:30:02.118714507Z [2024-05-25 00:30:02,118: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T00:30:02.119079249Z [2024-05-25 00:30:02,118: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:30:02.285671415Z [2024-05-25 00:30:02,285: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:30:02.300169567Z [2024-05-25 00:30:02,299: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:30:02.874363357Z [2024-05-25 00:30:02,873: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0d32f8ef-2bfe-41b7-ae94-63d360ff08d5] succeeded in 1.5790233980005723s: None 2024-05-25T00:30:03.039672360Z [2024-05-25 00:30:03,039: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2b487567-70a9-4afe-8185-3ca234198c34] succeeded in 1.7572118640000554s: None 2024-05-25T00:30:03.411427910Z [2024-05-25 00:30:03,411: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:30:03.415051378Z [2024-05-25 00:30:03,414: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:30:03.442732430Z [2024-05-25 00:30:03,442: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:30:03.443861324Z [2024-05-25 00:30:03,443: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:30:03.443986509Z [2024-05-25 00:30:03,443: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:30:03.444178222Z [2024-05-25 00:30:03,443: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:30:03.444282596Z [2024-05-25 00:30:03,444: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:30:03.444541030Z [2024-05-25 00:30:03,444: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:30:03.444666392Z [2024-05-25 00:30:03,444: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:30:03.487068837Z [2024-05-25 00:30:03,486: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-25T00:30:03.490529783Z [2024-05-25 00:30:03,490: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:30:03.515674054Z [2024-05-25 00:30:03,515: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T00:30:03.524944270Z [2024-05-25 00:30:03,524: INFO/ForkPoolWorker-3] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:30:03.525251607Z [2024-05-25 00:30:03,524: INFO/ForkPoolWorker-3] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:30:03.525496071Z [2024-05-25 00:30:03,525: INFO/ForkPoolWorker-3] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:30:03.525611249Z [2024-05-25 00:30:03,525: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-25T00:30:03.526506134Z [2024-05-25 00:30:03,526: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:30:03.527059069Z [2024-05-25 00:30:03,526: INFO/ForkPoolWorker-3] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:30:03.533514537Z [2024-05-25 00:30:03,533: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:30:03.632033413Z [2024-05-25 00:30:03,631: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:30:03.635460699Z [2024-05-25 00:30:03,634: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:30:03.642468543Z [2024-05-25 00:30:03,642: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:30:03.661985073Z [2024-05-25 00:30:03,661: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:30:03.663492728Z [2024-05-25 00:30:03,663: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:30:03.663519744Z [2024-05-25 00:30:03,663: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:30:03.663700940Z [2024-05-25 00:30:03,663: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:30:03.663908472Z [2024-05-25 00:30:03,663: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:30:03.664226316Z [2024-05-25 00:30:03,664: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:30:03.664269554Z [2024-05-25 00:30:03,664: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:30:03.755911964Z [2024-05-25 00:30:03,755: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:30:04.438301347Z [2024-05-25 00:30:04,437: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d10f8c71-c1bc-4dd2-a5ff-526d2607cc35] succeeded in 3.1461302849993444s: None 2024-05-25T00:30:05.175913242Z [2024-05-25 00:30:05,175: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2c0570e-e3a7-47cc-a51a-562775a850c5] received 2024-05-25T00:30:05.184658832Z [2024-05-25 00:30:05,184: INFO/ForkPoolWorker-15] [b2c0570e-e3a7-47cc-a51a-562775a850c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:30:05.512981359Z [2024-05-25 00:30:05,510: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:30:05.631598653Z [2024-05-25 00:30:05,631: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d61805a9-3859-4159-823f-80e34ff444a8] succeeded in 4.346138548000454s: None 2024-05-25T00:30:05.642004881Z [2024-05-25 00:30:05,641: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[6dd40749-386b-422d-b009-9eba571b7f26] succeeded in 4.343107343000156s: None 2024-05-25T00:30:06.838934041Z [2024-05-25 00:30:06,838: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:30:06.842991577Z [2024-05-25 00:30:06,842: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:30:06.881779846Z [2024-05-25 00:30:06,881: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:30:06.883983036Z [2024-05-25 00:30:06,883: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:30:06.885414457Z [2024-05-25 00:30:06,883: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:30:06.885652235Z [2024-05-25 00:30:06,885: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:30:06.885792113Z [2024-05-25 00:30:06,885: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:30:06.886137205Z [2024-05-25 00:30:06,885: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:30:06.886271941Z [2024-05-25 00:30:06,886: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:30:06.964598143Z [2024-05-25 00:30:06,964: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:30:07.533639066Z [2024-05-25 00:30:07,532: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b2c0570e-e3a7-47cc-a51a-562775a850c5] succeeded in 2.3552169940003296s: None 2024-05-25T00:30:07.639300616Z [2024-05-25 00:30:07,639: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60092d5b-feca-4f06-a5ad-ba6370144e0a] received 2024-05-25T00:30:07.646580634Z [2024-05-25 00:30:07,646: INFO/ForkPoolWorker-15] [60092d5b-feca-4f06-a5ad-ba6370144e0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T00:30:07.955566589Z [2024-05-25 00:30:07,951: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:30:09.138781936Z [2024-05-25 00:30:09,138: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:30:09.142017267Z [2024-05-25 00:30:09,141: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:30:09.167786966Z [2024-05-25 00:30:09,167: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:30:09.169727366Z [2024-05-25 00:30:09,169: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:30:09.171067245Z [2024-05-25 00:30:09,169: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:30:09.171322363Z [2024-05-25 00:30:09,171: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:30:09.171367695Z [2024-05-25 00:30:09,171: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:30:09.172144532Z [2024-05-25 00:30:09,171: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:30:09.172248727Z [2024-05-25 00:30:09,172: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:30:09.266868311Z [2024-05-25 00:30:09,266: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:30:09.925164773Z [2024-05-25 00:30:09,924: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[60092d5b-feca-4f06-a5ad-ba6370144e0a] succeeded in 2.283752927000023s: None 2024-05-25T00:30:10.258924295Z [2024-05-25 00:30:10,258: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5db64d84-8a7f-4c2a-8f87-2364dc277cca] received 2024-05-25T00:30:10.272890443Z [2024-05-25 00:30:10,272: INFO/ForkPoolWorker-15] [5db64d84-8a7f-4c2a-8f87-2364dc277cca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:30:10.569626006Z [2024-05-25 00:30:10,566: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:30:11.741536196Z [2024-05-25 00:30:11,741: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:30:11.744992245Z [2024-05-25 00:30:11,744: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:30:11.764511401Z [2024-05-25 00:30:11,764: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:30:11.766042787Z [2024-05-25 00:30:11,765: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:30:11.766060826Z [2024-05-25 00:30:11,765: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:30:11.766310832Z [2024-05-25 00:30:11,765: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:30:11.766335222Z [2024-05-25 00:30:11,766: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:30:11.766659032Z [2024-05-25 00:30:11,766: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:30:11.766786844Z [2024-05-25 00:30:11,766: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:30:11.871143148Z [2024-05-25 00:30:11,870: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:30:12.487810059Z [2024-05-25 00:30:12,487: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5db64d84-8a7f-4c2a-8f87-2364dc277cca] succeeded in 2.21956305599997s: None 2024-05-25T00:31:01.193507732Z [2024-05-25 00:31:01,193: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[990cca6a-81fe-4914-956a-8436cbb497ab] received 2024-05-25T00:31:01.197859531Z [2024-05-25 00:31:01,197: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b7124cc-6f4f-451f-83de-f34fd124d6a5] received 2024-05-25T00:31:01.200003968Z [2024-05-25 00:31:01,199: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da88d88c-be81-4b85-8759-821a713baeab] received 2024-05-25T00:31:01.211130682Z [2024-05-25 00:31:01,210: INFO/ForkPoolWorker-16] [7b7124cc-6f4f-451f-83de-f34fd124d6a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:31:01.211673623Z [2024-05-25 00:31:01,211: INFO/ForkPoolWorker-1] [da88d88c-be81-4b85-8759-821a713baeab] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:31:01.214288596Z [2024-05-25 00:31:01,213: INFO/ForkPoolWorker-15] [990cca6a-81fe-4914-956a-8436cbb497ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:31:01.514832282Z [2024-05-25 00:31:01,511: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:31:01.550824543Z [2024-05-25 00:31:01,547: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:31:01.553927356Z [2024-05-25 00:31:01,550: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:31:01.721596251Z [2024-05-25 00:31:01,719: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T00:31:01.726162483Z [2024-05-25 00:31:01,725: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:31:01.753863546Z [2024-05-25 00:31:01,753: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:31:01.754727474Z [2024-05-25 00:31:01,754: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:31:01.754780185Z [2024-05-25 00:31:01,754: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:31:01.754827692Z [2024-05-25 00:31:01,754: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T00:31:01.754986415Z [2024-05-25 00:31:01,754: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:31:01.847044621Z [2024-05-25 00:31:01,846: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:31:02.545577044Z [2024-05-25 00:31:02,545: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[da88d88c-be81-4b85-8759-821a713baeab] succeeded in 1.344086445999892s: None 2024-05-25T00:31:02.744975965Z [2024-05-25 00:31:02,744: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:31:02.748432340Z [2024-05-25 00:31:02,747: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:31:02.798656138Z [2024-05-25 00:31:02,797: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:31:02.799534320Z [2024-05-25 00:31:02,799: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:31:02.799709583Z [2024-05-25 00:31:02,799: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:31:02.799933652Z [2024-05-25 00:31:02,799: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:31:02.800067594Z [2024-05-25 00:31:02,799: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:31:02.800453888Z [2024-05-25 00:31:02,800: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:31:02.800737723Z [2024-05-25 00:31:02,800: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:31:02.874501117Z [2024-05-25 00:31:02,874: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:31:02.976697160Z [2024-05-25 00:31:02,976: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:31:02.980229184Z [2024-05-25 00:31:02,979: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:31:03.010256943Z [2024-05-25 00:31:03,010: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:31:03.016425052Z [2024-05-25 00:31:03,016: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:31:03.016444812Z [2024-05-25 00:31:03,016: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:31:03.016687775Z [2024-05-25 00:31:03,016: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:31:03.016867234Z [2024-05-25 00:31:03,016: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:31:03.017290052Z [2024-05-25 00:31:03,017: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:31:03.017633942Z [2024-05-25 00:31:03,017: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:31:03.109937453Z [2024-05-25 00:31:03,109: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:31:04.399431216Z [2024-05-25 00:31:04,398: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7b7124cc-6f4f-451f-83de-f34fd124d6a5] succeeded in 3.1992361129996425s: None 2024-05-25T00:31:05.120308568Z [2024-05-25 00:31:05,119: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[990cca6a-81fe-4914-956a-8436cbb497ab] succeeded in 3.917707564000011s: None 2024-05-25T00:32:01.161906493Z [2024-05-25 00:32:01,160: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84aa88ab-8d6a-409d-b4ec-e8ac1205d35e] received 2024-05-25T00:32:01.167522111Z [2024-05-25 00:32:01,167: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1e47067-b700-4a35-af79-ccd72dc3ee23] received 2024-05-25T00:32:01.171468186Z [2024-05-25 00:32:01,171: INFO/ForkPoolWorker-15] [84aa88ab-8d6a-409d-b4ec-e8ac1205d35e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:32:01.172406612Z [2024-05-25 00:32:01,172: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a16c410-e62b-450d-af09-c8a30a30f81b] received 2024-05-25T00:32:01.182012597Z [2024-05-25 00:32:01,181: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb7553a4-7525-4fa4-9aa1-b84851077f2d] received 2024-05-25T00:32:01.196103672Z [2024-05-25 00:32:01,195: INFO/ForkPoolWorker-2] [cb7553a4-7525-4fa4-9aa1-b84851077f2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:32:01.197662112Z [2024-05-25 00:32:01,197: INFO/ForkPoolWorker-1] [7a16c410-e62b-450d-af09-c8a30a30f81b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:32:01.199809027Z [2024-05-25 00:32:01,199: INFO/ForkPoolWorker-16] [c1e47067-b700-4a35-af79-ccd72dc3ee23] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:32:01.569646736Z [2024-05-25 00:32:01,566: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:32:01.578062869Z [2024-05-25 00:32:01,574: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:32:01.636378391Z [2024-05-25 00:32:01,633: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:32:01.818260537Z [2024-05-25 00:32:01,818: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:32:01.821465414Z [2024-05-25 00:32:01,817: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:32:01.999215119Z [2024-05-25 00:32:01,998: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T00:32:02.005184532Z [2024-05-25 00:32:02,004: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:32:02.028699892Z [2024-05-25 00:32:02,028: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:32:02.033365919Z [2024-05-25 00:32:02,033: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:32:02.033680704Z [2024-05-25 00:32:02,033: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:32:02.033854002Z [2024-05-25 00:32:02,033: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T00:32:02.034283071Z [2024-05-25 00:32:02,034: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:32:02.168047319Z [2024-05-25 00:32:02,167: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:32:02.510333941Z [2024-05-25 00:32:02,509: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[84aa88ab-8d6a-409d-b4ec-e8ac1205d35e] succeeded in 1.345791325999926s: None 2024-05-25T00:32:02.901339778Z [2024-05-25 00:32:02,900: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T00:32:02.904491588Z [2024-05-25 00:32:02,904: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:32:02.939043522Z [2024-05-25 00:32:02,938: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:32:02.941027413Z [2024-05-25 00:32:02,940: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:32:02.941042825Z [2024-05-25 00:32:02,940: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:32:02.941170315Z [2024-05-25 00:32:02,940: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:32:02.941198084Z [2024-05-25 00:32:02,941: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T00:32:02.941459798Z [2024-05-25 00:32:02,941: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:32:02.941471225Z [2024-05-25 00:32:02,941: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:32:02.973944779Z [2024-05-25 00:32:02,973: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7a16c410-e62b-450d-af09-c8a30a30f81b] succeeded in 1.7978296460005367s: None 2024-05-25T00:32:03.047270974Z [2024-05-25 00:32:03,047: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:32:03.056897130Z [2024-05-25 00:32:03,056: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:32:03.060526056Z [2024-05-25 00:32:03,060: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:32:03.093600799Z [2024-05-25 00:32:03,093: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:32:03.095473414Z [2024-05-25 00:32:03,095: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:32:03.095778817Z [2024-05-25 00:32:03,095: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:32:03.096157843Z [2024-05-25 00:32:03,095: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:32:03.096412114Z [2024-05-25 00:32:03,096: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:32:03.096862708Z [2024-05-25 00:32:03,096: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:32:03.097125926Z [2024-05-25 00:32:03,096: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:32:03.189907700Z [2024-05-25 00:32:03,189: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:32:04.958735894Z [2024-05-25 00:32:04,958: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c1e47067-b700-4a35-af79-ccd72dc3ee23] succeeded in 3.784541617999821s: None 2024-05-25T00:32:05.137770227Z [2024-05-25 00:32:05,136: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cb7553a4-7525-4fa4-9aa1-b84851077f2d] succeeded in 3.9526207910002995s: None 2024-05-25T00:33:00.809388804Z [2024-05-25 00:33:00,808: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41d9a41b-b99a-4284-8177-9d5d4c05c7cb] received 2024-05-25T00:33:00.814347837Z [2024-05-25 00:33:00,814: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b0507e5-9f66-44cb-990a-853f13877192] received 2024-05-25T00:33:00.816205832Z [2024-05-25 00:33:00,815: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a22cbd2-fdb6-4bf8-aafc-8ee8528a2e97] received 2024-05-25T00:33:00.821284057Z [2024-05-25 00:33:00,820: INFO/ForkPoolWorker-15] [41d9a41b-b99a-4284-8177-9d5d4c05c7cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:33:00.827400980Z [2024-05-25 00:33:00,827: INFO/ForkPoolWorker-1] [1a22cbd2-fdb6-4bf8-aafc-8ee8528a2e97] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:33:00.832489816Z [2024-05-25 00:33:00,832: INFO/ForkPoolWorker-16] [6b0507e5-9f66-44cb-990a-853f13877192] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:33:01.183952797Z [2024-05-25 00:33:01,179: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:33:01.233608573Z [2024-05-25 00:33:01,230: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:33:01.300005649Z [2024-05-25 00:33:01,296: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:33:01.530929125Z [2024-05-25 00:33:01,530: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T00:33:01.535052829Z [2024-05-25 00:33:01,534: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:33:01.602711713Z [2024-05-25 00:33:01,602: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:33:01.604387368Z [2024-05-25 00:33:01,604: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:33:01.604695074Z [2024-05-25 00:33:01,604: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:33:01.604976688Z [2024-05-25 00:33:01,604: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T00:33:01.605486288Z [2024-05-25 00:33:01,605: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:33:01.729812558Z [2024-05-25 00:33:01,729: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:33:02.605832790Z [2024-05-25 00:33:02,605: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1a22cbd2-fdb6-4bf8-aafc-8ee8528a2e97] succeeded in 1.7875717739998436s: None 2024-05-25T00:33:02.675798702Z [2024-05-25 00:33:02,675: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:33:02.680182466Z [2024-05-25 00:33:02,679: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:33:02.720654168Z [2024-05-25 00:33:02,720: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:33:02.723619973Z [2024-05-25 00:33:02,723: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:33:02.724228556Z [2024-05-25 00:33:02,723: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:33:02.724712474Z [2024-05-25 00:33:02,724: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:33:02.725125570Z [2024-05-25 00:33:02,724: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:33:02.729884323Z [2024-05-25 00:33:02,725: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:33:02.730275948Z [2024-05-25 00:33:02,730: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:33:02.746077345Z [2024-05-25 00:33:02,745: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:33:02.749773113Z [2024-05-25 00:33:02,748: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:33:02.784563457Z [2024-05-25 00:33:02,784: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:33:02.786418918Z [2024-05-25 00:33:02,786: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:33:02.786438681Z [2024-05-25 00:33:02,786: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:33:02.786666359Z [2024-05-25 00:33:02,786: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:33:02.786697084Z [2024-05-25 00:33:02,786: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:33:02.787014091Z [2024-05-25 00:33:02,786: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:33:02.787046189Z [2024-05-25 00:33:02,786: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:33:02.846667250Z [2024-05-25 00:33:02,846: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:33:02.881685778Z [2024-05-25 00:33:02,881: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:33:04.798992957Z [2024-05-25 00:33:04,798: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[41d9a41b-b99a-4284-8177-9d5d4c05c7cb] succeeded in 3.9867231730004278s: None 2024-05-25T00:33:04.897989987Z [2024-05-25 00:33:04,897: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6b0507e5-9f66-44cb-990a-853f13877192] succeeded in 4.0799934329997996s: None 2024-05-25T00:34:00.803416441Z [2024-05-25 00:34:00,802: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3dcb6c68-3fa9-4893-a497-68430e0f94e6] received 2024-05-25T00:34:00.807558633Z [2024-05-25 00:34:00,807: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2919cfe2-610c-4c44-9e49-cfa217388b9f] received 2024-05-25T00:34:00.819896892Z [2024-05-25 00:34:00,819: INFO/ForkPoolWorker-15] [3dcb6c68-3fa9-4893-a497-68430e0f94e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:34:00.821599304Z [2024-05-25 00:34:00,821: INFO/ForkPoolWorker-16] [2919cfe2-610c-4c44-9e49-cfa217388b9f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:34:00.824424954Z [2024-05-25 00:34:00,824: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a539150-54fd-4b96-8263-054bb5ab6367] received 2024-05-25T00:34:00.835354916Z [2024-05-25 00:34:00,835: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5952253f-f7e3-4598-b00b-cabd9e8e4610] received 2024-05-25T00:34:00.836618106Z [2024-05-25 00:34:00,836: INFO/ForkPoolWorker-1] [1a539150-54fd-4b96-8263-054bb5ab6367] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:34:00.844193694Z [2024-05-25 00:34:00,843: INFO/ForkPoolWorker-2] [5952253f-f7e3-4598-b00b-cabd9e8e4610] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:34:01.156784577Z [2024-05-25 00:34:01,153: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:34:01.179737977Z [2024-05-25 00:34:01,176: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:34:01.205371638Z [2024-05-25 00:34:01,202: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:34:01.215882395Z [2024-05-25 00:34:01,212: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:34:01.424541273Z [2024-05-25 00:34:01,417: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:34:01.516325108Z [2024-05-25 00:34:01,515: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T00:34:01.520369853Z [2024-05-25 00:34:01,519: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:34:01.567811033Z [2024-05-25 00:34:01,567: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:34:01.573876429Z [2024-05-25 00:34:01,573: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:34:01.574073659Z [2024-05-25 00:34:01,573: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:34:01.574154375Z [2024-05-25 00:34:01,573: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T00:34:01.574347125Z [2024-05-25 00:34:01,574: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:34:01.686254210Z [2024-05-25 00:34:01,685: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:34:02.046293650Z [2024-05-25 00:34:02,045: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3dcb6c68-3fa9-4893-a497-68430e0f94e6] succeeded in 1.2360061019999193s: None 2024-05-25T00:34:02.336794534Z [2024-05-25 00:34:02,336: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5952253f-f7e3-4598-b00b-cabd9e8e4610] succeeded in 1.4999091459994816s: None 2024-05-25T00:34:02.698390642Z [2024-05-25 00:34:02,698: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:34:02.702952911Z [2024-05-25 00:34:02,702: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:34:02.723592105Z [2024-05-25 00:34:02,723: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:34:02.725805151Z [2024-05-25 00:34:02,725: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:34:02.725828097Z [2024-05-25 00:34:02,725: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:34:02.726004189Z [2024-05-25 00:34:02,725: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:34:02.726036152Z [2024-05-25 00:34:02,725: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:34:02.726343399Z [2024-05-25 00:34:02,726: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:34:02.726414004Z [2024-05-25 00:34:02,726: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:34:02.780436865Z [2024-05-25 00:34:02,780: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:34:02.783888676Z [2024-05-25 00:34:02,783: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:34:02.808516819Z [2024-05-25 00:34:02,808: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:34:02.810037928Z [2024-05-25 00:34:02,809: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:34:02.810131281Z [2024-05-25 00:34:02,810: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:34:02.810326585Z [2024-05-25 00:34:02,810: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:34:02.810445391Z [2024-05-25 00:34:02,810: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:34:02.810746016Z [2024-05-25 00:34:02,810: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:34:02.810845401Z [2024-05-25 00:34:02,810: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:34:02.821070796Z [2024-05-25 00:34:02,820: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:34:02.904892250Z [2024-05-25 00:34:02,904: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:34:04.476496973Z [2024-05-25 00:34:04,475: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1a539150-54fd-4b96-8263-054bb5ab6367] succeeded in 3.6499211729997114s: None 2024-05-25T00:34:04.950618343Z [2024-05-25 00:34:04,949: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2919cfe2-610c-4c44-9e49-cfa217388b9f] succeeded in 4.139247828000407s: None 2024-05-25T00:35:00.769446705Z [2024-05-25 00:35:00,768: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec3cb5f4-cf6b-4838-b589-27469ef8e9e3] received 2024-05-25T00:35:00.774483991Z [2024-05-25 00:35:00,774: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74eb5193-5680-456d-843e-0f205bd58517] received 2024-05-25T00:35:00.782666442Z [2024-05-25 00:35:00,782: INFO/ForkPoolWorker-15] [ec3cb5f4-cf6b-4838-b589-27469ef8e9e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:35:00.787319835Z [2024-05-25 00:35:00,786: INFO/ForkPoolWorker-16] [74eb5193-5680-456d-843e-0f205bd58517] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:35:00.793920271Z [2024-05-25 00:35:00,793: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bac17c9f-1757-4ec5-8b68-2038a981832e] received 2024-05-25T00:35:00.796832141Z [2024-05-25 00:35:00,796: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c4ce57a-659a-4490-91f1-aa056cbc884c] received 2024-05-25T00:35:00.807100562Z [2024-05-25 00:35:00,806: INFO/ForkPoolWorker-1] [bac17c9f-1757-4ec5-8b68-2038a981832e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:35:00.814303075Z [2024-05-25 00:35:00,813: INFO/ForkPoolWorker-2] [7c4ce57a-659a-4490-91f1-aa056cbc884c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:35:01.122632892Z [2024-05-25 00:35:01,119: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:35:01.134325862Z [2024-05-25 00:35:01,130: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:35:01.220623917Z [2024-05-25 00:35:01,216: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:35:01.243268936Z [2024-05-25 00:35:01,238: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:35:01.310275663Z [2024-05-25 00:35:01,309: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T00:35:01.314484862Z [2024-05-25 00:35:01,314: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:35:01.377287433Z [2024-05-25 00:35:01,375: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:35:01.381290826Z [2024-05-25 00:35:01,378: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:35:01.381311907Z [2024-05-25 00:35:01,378: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:35:01.381317271Z [2024-05-25 00:35:01,378: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T00:35:01.381320786Z [2024-05-25 00:35:01,379: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:35:01.480682456Z [2024-05-25 00:35:01,480: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:35:02.022976162Z [2024-05-25 00:35:02,022: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[74eb5193-5680-456d-843e-0f205bd58517] succeeded in 1.2437382440002693s: None 2024-05-25T00:35:02.368507443Z [2024-05-25 00:35:02,368: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:35:02.372688828Z [2024-05-25 00:35:02,372: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:35:02.409674725Z [2024-05-25 00:35:02,409: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:35:02.415049115Z [2024-05-25 00:35:02,414: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:35:02.415066964Z [2024-05-25 00:35:02,414: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:35:02.415223839Z [2024-05-25 00:35:02,415: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:35:02.415281984Z [2024-05-25 00:35:02,415: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:35:02.415538921Z [2024-05-25 00:35:02,415: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:35:02.415901771Z [2024-05-25 00:35:02,415: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:35:02.504893076Z [2024-05-25 00:35:02,504: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:35:02.567844346Z [2024-05-25 00:35:02,567: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:35:02.571373874Z [2024-05-25 00:35:02,570: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:35:02.594051085Z [2024-05-25 00:35:02,593: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:35:02.595563589Z [2024-05-25 00:35:02,595: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:35:02.595673568Z [2024-05-25 00:35:02,595: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:35:02.595856437Z [2024-05-25 00:35:02,595: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:35:02.595959898Z [2024-05-25 00:35:02,595: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:35:02.596289168Z [2024-05-25 00:35:02,596: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:35:02.596411425Z [2024-05-25 00:35:02,596: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:35:02.629199877Z [2024-05-25 00:35:02,628: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T00:35:02.632617549Z [2024-05-25 00:35:02,632: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:35:02.661758410Z [2024-05-25 00:35:02,661: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:35:02.664232663Z [2024-05-25 00:35:02,664: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:35:02.664429008Z [2024-05-25 00:35:02,664: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:35:02.664657282Z [2024-05-25 00:35:02,664: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:35:02.664815024Z [2024-05-25 00:35:02,664: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T00:35:02.665113332Z [2024-05-25 00:35:02,664: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:35:02.665289782Z [2024-05-25 00:35:02,665: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:35:02.689676391Z [2024-05-25 00:35:02,689: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:35:02.748759228Z [2024-05-25 00:35:02,748: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:35:03.364818990Z [2024-05-25 00:35:03,364: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bac17c9f-1757-4ec5-8b68-2038a981832e] succeeded in 2.568518205000146s: None 2024-05-25T00:35:03.532322972Z [2024-05-25 00:35:03,531: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f610830-7e71-4adb-879d-238f2bb7054a] received 2024-05-25T00:35:03.549813510Z [2024-05-25 00:35:03,549: INFO/ForkPoolWorker-16] [7f610830-7e71-4adb-879d-238f2bb7054a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:35:03.824550943Z [2024-05-25 00:35:03,821: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:35:04.132211113Z [2024-05-25 00:35:04,130: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ec3cb5f4-cf6b-4838-b589-27469ef8e9e3] succeeded in 3.355601584999931s: None 2024-05-25T00:35:04.677640729Z [2024-05-25 00:35:04,677: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7c4ce57a-659a-4490-91f1-aa056cbc884c] succeeded in 3.8742484599997624s: None 2024-05-25T00:35:04.943183232Z [2024-05-25 00:35:04,942: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:35:04.946589942Z [2024-05-25 00:35:04,946: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:35:04.968828966Z [2024-05-25 00:35:04,968: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:35:04.970401438Z [2024-05-25 00:35:04,970: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:35:04.970611326Z [2024-05-25 00:35:04,970: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:35:04.970934485Z [2024-05-25 00:35:04,970: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:35:04.971138572Z [2024-05-25 00:35:04,970: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:35:04.971515278Z [2024-05-25 00:35:04,971: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:35:04.972206405Z [2024-05-25 00:35:04,971: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:35:05.075591844Z [2024-05-25 00:35:05,075: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:35:05.756509758Z [2024-05-25 00:35:05,756: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67b9783b-4b1f-4b82-bad6-9732dea7c14d] received 2024-05-25T00:35:05.759963398Z [2024-05-25 00:35:05,759: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7f610830-7e71-4adb-879d-238f2bb7054a] succeeded in 2.2253164630001265s: None 2024-05-25T00:35:05.763433998Z [2024-05-25 00:35:05,763: INFO/ForkPoolWorker-15] [67b9783b-4b1f-4b82-bad6-9732dea7c14d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T00:35:06.029317220Z [2024-05-25 00:35:06,026: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:35:07.163750607Z [2024-05-25 00:35:07,163: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:35:07.167248278Z [2024-05-25 00:35:07,166: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:35:07.221377522Z [2024-05-25 00:35:07,218: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:35:07.221400048Z [2024-05-25 00:35:07,219: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:35:07.221403937Z [2024-05-25 00:35:07,219: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:35:07.221407896Z [2024-05-25 00:35:07,219: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:35:07.221422973Z [2024-05-25 00:35:07,219: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:35:07.221426090Z [2024-05-25 00:35:07,220: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:35:07.221429213Z [2024-05-25 00:35:07,220: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:35:07.313406652Z [2024-05-25 00:35:07,312: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:35:07.905302569Z [2024-05-25 00:35:07,904: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[67b9783b-4b1f-4b82-bad6-9732dea7c14d] succeeded in 2.147025620000022s: None 2024-05-25T00:35:08.131794141Z [2024-05-25 00:35:08,131: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86c9c55b-4164-49a1-8209-a24368f1fef9] received 2024-05-25T00:35:08.139567728Z [2024-05-25 00:35:08,139: INFO/ForkPoolWorker-15] [86c9c55b-4164-49a1-8209-a24368f1fef9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:35:08.541529993Z [2024-05-25 00:35:08,537: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:35:09.684128401Z [2024-05-25 00:35:09,683: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:35:09.687660821Z [2024-05-25 00:35:09,687: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:35:09.712379445Z [2024-05-25 00:35:09,712: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:35:09.713983334Z [2024-05-25 00:35:09,713: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:35:09.714025742Z [2024-05-25 00:35:09,713: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:35:09.714321741Z [2024-05-25 00:35:09,713: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:35:09.714787785Z [2024-05-25 00:35:09,714: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:35:09.715857494Z [2024-05-25 00:35:09,715: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:35:09.715867248Z [2024-05-25 00:35:09,715: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:35:09.811940886Z [2024-05-25 00:35:09,811: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:35:10.497742764Z [2024-05-25 00:35:10,497: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[86c9c55b-4164-49a1-8209-a24368f1fef9] succeeded in 2.3632813640006134s: None 2024-05-25T00:36:00.763455639Z [2024-05-25 00:36:00,761: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[900f2b8b-25e7-4faa-8508-197517bbedfe] received 2024-05-25T00:36:00.766671941Z [2024-05-25 00:36:00,766: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a664b51-ad40-4229-9538-63bbc5c15a96] received 2024-05-25T00:36:00.774631671Z [2024-05-25 00:36:00,774: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a726389f-0bd6-42da-a298-1915d7c020e8] received 2024-05-25T00:36:00.776932252Z [2024-05-25 00:36:00,776: INFO/ForkPoolWorker-15] [900f2b8b-25e7-4faa-8508-197517bbedfe] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:36:00.781706851Z [2024-05-25 00:36:00,781: INFO/ForkPoolWorker-16] [1a664b51-ad40-4229-9538-63bbc5c15a96] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:36:00.786456167Z [2024-05-25 00:36:00,786: INFO/ForkPoolWorker-1] [a726389f-0bd6-42da-a298-1915d7c020e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:36:00.789687090Z [2024-05-25 00:36:00,789: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5efeeded-c815-45bf-83ad-a2e82d1d14d4] received 2024-05-25T00:36:00.800120880Z [2024-05-25 00:36:00,799: INFO/ForkPoolWorker-2] [5efeeded-c815-45bf-83ad-a2e82d1d14d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:36:01.109365773Z [2024-05-25 00:36:01,106: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:36:01.123204564Z [2024-05-25 00:36:01,119: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:36:01.153048612Z [2024-05-25 00:36:01,149: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:36:01.166650254Z [2024-05-25 00:36:01,162: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:36:01.314015563Z [2024-05-25 00:36:01,313: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T00:36:01.318129021Z [2024-05-25 00:36:01,317: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:36:01.351334079Z [2024-05-25 00:36:01,351: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:36:01.353620457Z [2024-05-25 00:36:01,352: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:36:01.353635324Z [2024-05-25 00:36:01,352: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:36:01.353639232Z [2024-05-25 00:36:01,352: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T00:36:01.353642238Z [2024-05-25 00:36:01,352: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:36:01.419344033Z [2024-05-25 00:36:01,419: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:36:01.500831999Z [2024-05-25 00:36:01,500: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:36:02.023827005Z [2024-05-25 00:36:02,023: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[900f2b8b-25e7-4faa-8508-197517bbedfe] succeeded in 1.2549584680000407s: None 2024-05-25T00:36:02.123619335Z [2024-05-25 00:36:02,123: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5efeeded-c815-45bf-83ad-a2e82d1d14d4] succeeded in 1.3321535799996127s: None 2024-05-25T00:36:02.510864511Z [2024-05-25 00:36:02,510: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:36:02.514295441Z [2024-05-25 00:36:02,513: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:36:02.553399918Z [2024-05-25 00:36:02,552: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:36:02.554966722Z [2024-05-25 00:36:02,554: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:36:02.554983399Z [2024-05-25 00:36:02,554: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:36:02.555160129Z [2024-05-25 00:36:02,554: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:36:02.555178095Z [2024-05-25 00:36:02,555: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:36:02.555513539Z [2024-05-25 00:36:02,555: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:36:02.555560742Z [2024-05-25 00:36:02,555: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:36:02.592981906Z [2024-05-25 00:36:02,592: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:36:02.596880735Z [2024-05-25 00:36:02,596: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:36:02.624497883Z [2024-05-25 00:36:02,624: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:36:02.625962912Z [2024-05-25 00:36:02,625: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:36:02.626016528Z [2024-05-25 00:36:02,625: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:36:02.626221001Z [2024-05-25 00:36:02,626: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:36:02.626342819Z [2024-05-25 00:36:02,626: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:36:02.626724351Z [2024-05-25 00:36:02,626: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:36:02.626806635Z [2024-05-25 00:36:02,626: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:36:02.652990576Z [2024-05-25 00:36:02,652: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:36:02.742435546Z [2024-05-25 00:36:02,742: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:36:04.433760252Z [2024-05-25 00:36:04,433: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a726389f-0bd6-42da-a298-1915d7c020e8] succeeded in 3.6560256660004598s: None 2024-05-25T00:36:05.735414923Z [2024-05-25 00:36:05,734: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1a664b51-ad40-4229-9538-63bbc5c15a96] succeeded in 4.966616877999513s: None 2024-05-25T00:37:00.372529317Z [2024-05-25 00:37:00,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ee0dd84-acc5-415b-8062-e3158403a97d] received 2024-05-25T00:37:00.381854534Z [2024-05-25 00:37:00,380: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06e6adda-1c02-4fb7-b274-e24d2305d0f2] received 2024-05-25T00:37:00.386513130Z [2024-05-25 00:37:00,386: INFO/ForkPoolWorker-15] [5ee0dd84-acc5-415b-8062-e3158403a97d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:37:00.394471302Z [2024-05-25 00:37:00,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0af3498-343d-487e-a911-69d8d54fdef5] received 2024-05-25T00:37:00.394855418Z [2024-05-25 00:37:00,394: INFO/ForkPoolWorker-16] [06e6adda-1c02-4fb7-b274-e24d2305d0f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:37:00.407828007Z [2024-05-25 00:37:00,407: INFO/ForkPoolWorker-1] [a0af3498-343d-487e-a911-69d8d54fdef5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:37:00.712809055Z [2024-05-25 00:37:00,708: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:37:00.715044496Z [2024-05-25 00:37:00,711: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:37:00.737230690Z [2024-05-25 00:37:00,733: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:37:00.870516176Z [2024-05-25 00:37:00,870: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T00:37:00.874397473Z [2024-05-25 00:37:00,873: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:37:00.901015374Z [2024-05-25 00:37:00,900: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:37:00.902007453Z [2024-05-25 00:37:00,901: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:37:00.902144150Z [2024-05-25 00:37:00,901: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:37:00.902300943Z [2024-05-25 00:37:00,902: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T00:37:00.902529013Z [2024-05-25 00:37:00,902: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:37:00.982852145Z [2024-05-25 00:37:00,982: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:37:01.682901661Z [2024-05-25 00:37:01,682: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a0af3498-343d-487e-a911-69d8d54fdef5] succeeded in 1.2865507930000604s: None 2024-05-25T00:37:01.996370627Z [2024-05-25 00:37:01,995: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:37:01.999595722Z [2024-05-25 00:37:01,999: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:37:02.025661012Z [2024-05-25 00:37:02,025: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:37:02.027823826Z [2024-05-25 00:37:02,027: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:37:02.027991390Z [2024-05-25 00:37:02,027: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:37:02.028295995Z [2024-05-25 00:37:02,027: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:37:02.028449703Z [2024-05-25 00:37:02,028: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:37:02.030839553Z [2024-05-25 00:37:02,030: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:37:02.030944069Z [2024-05-25 00:37:02,030: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:37:02.031352324Z [2024-05-25 00:37:02,030: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:37:02.035587975Z [2024-05-25 00:37:02,035: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:37:02.063511428Z [2024-05-25 00:37:02,063: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:37:02.065269127Z [2024-05-25 00:37:02,064: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:37:02.065514664Z [2024-05-25 00:37:02,065: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:37:02.065804869Z [2024-05-25 00:37:02,065: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:37:02.065970776Z [2024-05-25 00:37:02,065: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:37:02.066787963Z [2024-05-25 00:37:02,066: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:37:02.067072339Z [2024-05-25 00:37:02,066: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:37:02.114591693Z [2024-05-25 00:37:02,114: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:37:02.159403517Z [2024-05-25 00:37:02,159: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:37:03.712388353Z [2024-05-25 00:37:03,711: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5ee0dd84-acc5-415b-8062-e3158403a97d] succeeded in 3.3370379299994966s: None 2024-05-25T00:37:04.784003030Z [2024-05-25 00:37:04,783: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[06e6adda-1c02-4fb7-b274-e24d2305d0f2] succeeded in 4.399576423000326s: None 2024-05-25T00:38:00.656002223Z [2024-05-25 00:38:00,655: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae824628-737a-46ac-aabe-6f84d1d03e32] received 2024-05-25T00:38:00.657668037Z [2024-05-25 00:38:00,657: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b54cce1-111d-4ede-8604-674fb7ca4169] received 2024-05-25T00:38:00.666160106Z [2024-05-25 00:38:00,665: INFO/ForkPoolWorker-15] [ae824628-737a-46ac-aabe-6f84d1d03e32] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:38:00.673017039Z [2024-05-25 00:38:00,672: INFO/ForkPoolWorker-16] [7b54cce1-111d-4ede-8604-674fb7ca4169] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:38:00.677281917Z [2024-05-25 00:38:00,676: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12129301-5b0b-4d64-8df4-d5792d4d216c] received 2024-05-25T00:38:00.682467300Z [2024-05-25 00:38:00,682: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af33ed0b-93f2-4da5-9014-d9535d963bff] received 2024-05-25T00:38:00.693333045Z [2024-05-25 00:38:00,692: INFO/ForkPoolWorker-1] [12129301-5b0b-4d64-8df4-d5792d4d216c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:38:00.699543081Z [2024-05-25 00:38:00,699: INFO/ForkPoolWorker-2] [af33ed0b-93f2-4da5-9014-d9535d963bff] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:38:01.037343810Z [2024-05-25 00:38:01,034: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:38:01.121456611Z [2024-05-25 00:38:01,118: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:38:01.150682076Z [2024-05-25 00:38:01,141: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:38:01.179741779Z [2024-05-25 00:38:01,176: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:38:01.337351697Z [2024-05-25 00:38:01,336: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T00:38:01.348169564Z [2024-05-25 00:38:01,344: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:38:01.360013553Z [2024-05-25 00:38:01,359: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:38:01.407553881Z [2024-05-25 00:38:01,407: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:38:01.408977865Z [2024-05-25 00:38:01,408: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:38:01.409136627Z [2024-05-25 00:38:01,408: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:38:01.409231758Z [2024-05-25 00:38:01,409: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T00:38:01.409597054Z [2024-05-25 00:38:01,409: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:38:01.532522176Z [2024-05-25 00:38:01,532: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:38:01.900411836Z [2024-05-25 00:38:01,899: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ae824628-737a-46ac-aabe-6f84d1d03e32] succeeded in 1.2420178189995568s: None 2024-05-25T00:38:02.204592723Z [2024-05-25 00:38:02,203: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[af33ed0b-93f2-4da5-9014-d9535d963bff] succeeded in 1.5147665570002573s: None 2024-05-25T00:38:02.659612952Z [2024-05-25 00:38:02,659: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:38:02.663474696Z [2024-05-25 00:38:02,662: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:38:02.680897037Z [2024-05-25 00:38:02,680: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:38:02.682481789Z [2024-05-25 00:38:02,682: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:38:02.682602794Z [2024-05-25 00:38:02,682: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:38:02.682808622Z [2024-05-25 00:38:02,682: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:38:02.682881494Z [2024-05-25 00:38:02,682: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:38:02.683220307Z [2024-05-25 00:38:02,683: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:38:02.683354707Z [2024-05-25 00:38:02,683: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:38:02.773100332Z [2024-05-25 00:38:02,772: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:38:02.781991372Z [2024-05-25 00:38:02,781: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:38:02.785750922Z [2024-05-25 00:38:02,785: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:38:02.818157884Z [2024-05-25 00:38:02,817: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:38:02.822188139Z [2024-05-25 00:38:02,821: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:38:02.822477544Z [2024-05-25 00:38:02,822: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:38:02.822801213Z [2024-05-25 00:38:02,822: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:38:02.823032441Z [2024-05-25 00:38:02,822: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:38:02.823580098Z [2024-05-25 00:38:02,823: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:38:02.823879490Z [2024-05-25 00:38:02,823: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:38:02.926757432Z [2024-05-25 00:38:02,926: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:38:04.505738548Z [2024-05-25 00:38:04,505: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[12129301-5b0b-4d64-8df4-d5792d4d216c] succeeded in 3.8223034530001314s: None 2024-05-25T00:38:04.608372740Z [2024-05-25 00:38:04,607: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7b54cce1-111d-4ede-8604-674fb7ca4169] succeeded in 3.9482781360002264s: None 2024-05-25T00:39:00.486250394Z [2024-05-25 00:39:00,485: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[323168b9-0789-4298-8bcd-25eeea6fad6e] received 2024-05-25T00:39:00.496560025Z [2024-05-25 00:39:00,496: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a01a89fe-7823-4517-bb59-152898c8da67] received 2024-05-25T00:39:00.499314259Z [2024-05-25 00:39:00,498: INFO/ForkPoolWorker-15] [323168b9-0789-4298-8bcd-25eeea6fad6e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:39:00.509302026Z [2024-05-25 00:39:00,507: INFO/ForkPoolWorker-16] [a01a89fe-7823-4517-bb59-152898c8da67] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:39:00.513285570Z [2024-05-25 00:39:00,512: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a011a6d-9990-4e82-bba2-a7f60b230650] received 2024-05-25T00:39:00.537976524Z [2024-05-25 00:39:00,537: INFO/ForkPoolWorker-1] [5a011a6d-9990-4e82-bba2-a7f60b230650] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:39:00.793186965Z [2024-05-25 00:39:00,790: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:39:00.794014269Z [2024-05-25 00:39:00,790: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:39:00.829426421Z [2024-05-25 00:39:00,826: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:39:00.985370351Z [2024-05-25 00:39:00,984: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T00:39:00.989155353Z [2024-05-25 00:39:00,988: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:39:01.017978466Z [2024-05-25 00:39:01,017: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:39:01.018913462Z [2024-05-25 00:39:01,018: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:39:01.019008709Z [2024-05-25 00:39:01,018: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:39:01.019086918Z [2024-05-25 00:39:01,019: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T00:39:01.019304319Z [2024-05-25 00:39:01,019: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:39:01.099608784Z [2024-05-25 00:39:01,099: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:39:01.693806614Z [2024-05-25 00:39:01,693: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5a011a6d-9990-4e82-bba2-a7f60b230650] succeeded in 1.1715582440001526s: None 2024-05-25T00:39:02.042436523Z [2024-05-25 00:39:02,042: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:39:02.045874859Z [2024-05-25 00:39:02,045: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:39:02.073264264Z [2024-05-25 00:39:02,072: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:39:02.075028669Z [2024-05-25 00:39:02,074: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:39:02.075123573Z [2024-05-25 00:39:02,074: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:39:02.075360860Z [2024-05-25 00:39:02,075: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:39:02.075459734Z [2024-05-25 00:39:02,075: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:39:02.075786818Z [2024-05-25 00:39:02,075: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:39:02.075876103Z [2024-05-25 00:39:02,075: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:39:02.085880086Z [2024-05-25 00:39:02,085: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:39:02.090453086Z [2024-05-25 00:39:02,089: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:39:02.107496798Z [2024-05-25 00:39:02,107: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:39:02.108744771Z [2024-05-25 00:39:02,108: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:39:02.108889659Z [2024-05-25 00:39:02,108: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:39:02.109167183Z [2024-05-25 00:39:02,108: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:39:02.109307704Z [2024-05-25 00:39:02,109: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:39:02.109610615Z [2024-05-25 00:39:02,109: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:39:02.109687994Z [2024-05-25 00:39:02,109: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:39:02.152775837Z [2024-05-25 00:39:02,152: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:39:02.271251612Z [2024-05-25 00:39:02,270: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:39:04.082525755Z [2024-05-25 00:39:04,082: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a01a89fe-7823-4517-bb59-152898c8da67] succeeded in 3.5837822359999336s: None 2024-05-25T00:39:04.183705849Z [2024-05-25 00:39:04,183: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[323168b9-0789-4298-8bcd-25eeea6fad6e] succeeded in 3.694138199999543s: None 2024-05-25T00:40:00.480755662Z [2024-05-25 00:40:00,479: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f8f409c-ec58-4b86-a8fb-558a991444e3] received 2024-05-25T00:40:00.488459521Z [2024-05-25 00:40:00,488: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91028370-4d55-44f7-99d6-53a1afe32a70] received 2024-05-25T00:40:00.497044299Z [2024-05-25 00:40:00,496: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c201eeb7-5a2b-47a4-9161-56c789025484] received 2024-05-25T00:40:00.498220444Z [2024-05-25 00:40:00,497: INFO/ForkPoolWorker-15] [0f8f409c-ec58-4b86-a8fb-558a991444e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:40:00.506456747Z [2024-05-25 00:40:00,506: INFO/ForkPoolWorker-16] [91028370-4d55-44f7-99d6-53a1afe32a70] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:40:00.509772721Z [2024-05-25 00:40:00,509: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[973bb11b-b599-4f14-ac38-283e8495a4d0] received 2024-05-25T00:40:00.511853447Z [2024-05-25 00:40:00,511: INFO/ForkPoolWorker-1] [c201eeb7-5a2b-47a4-9161-56c789025484] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:40:00.518662495Z [2024-05-25 00:40:00,518: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5091cdf3-4b91-445f-bcff-b36b2b22d4d0] received 2024-05-25T00:40:00.532342037Z [2024-05-25 00:40:00,531: INFO/ForkPoolWorker-2] [973bb11b-b599-4f14-ac38-283e8495a4d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:40:00.538348288Z [2024-05-25 00:40:00,537: INFO/ForkPoolWorker-3] [5091cdf3-4b91-445f-bcff-b36b2b22d4d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:40:00.837052952Z [2024-05-25 00:40:00,833: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:40:00.841726466Z [2024-05-25 00:40:00,838: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:40:00.916579452Z [2024-05-25 00:40:00,912: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:40:01.102603005Z [2024-05-25 00:40:01,101: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T00:40:01.107638128Z [2024-05-25 00:40:01,107: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:40:01.135183704Z [2024-05-25 00:40:01,134: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:40:01.136381896Z [2024-05-25 00:40:01,136: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:40:01.136770575Z [2024-05-25 00:40:01,136: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:40:01.136872029Z [2024-05-25 00:40:01,136: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T00:40:01.137663890Z [2024-05-25 00:40:01,137: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:40:01.272941740Z [2024-05-25 00:40:01,272: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:40:01.287273379Z [2024-05-25 00:40:01,283: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:40:01.344730822Z [2024-05-25 00:40:01,339: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:40:01.393353707Z [2024-05-25 00:40:01,384: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:40:02.542667111Z [2024-05-25 00:40:02,542: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c201eeb7-5a2b-47a4-9161-56c789025484] succeeded in 2.0427711800002726s: None 2024-05-25T00:40:02.664949028Z [2024-05-25 00:40:02,664: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:40:02.668649393Z [2024-05-25 00:40:02,668: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:40:02.695845750Z [2024-05-25 00:40:02,695: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:40:02.696933124Z [2024-05-25 00:40:02,696: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:40:02.696968891Z [2024-05-25 00:40:02,696: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:40:02.697047793Z [2024-05-25 00:40:02,696: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:40:02.697090422Z [2024-05-25 00:40:02,697: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:40:02.697325778Z [2024-05-25 00:40:02,697: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:40:02.697368120Z [2024-05-25 00:40:02,697: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:40:02.718709567Z [2024-05-25 00:40:02,718: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[91028370-4d55-44f7-99d6-53a1afe32a70] succeeded in 2.225477979999596s: None 2024-05-25T00:40:02.795636711Z [2024-05-25 00:40:02,795: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:40:03.203833255Z [2024-05-25 00:40:03,203: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-25T00:40:03.207294250Z [2024-05-25 00:40:03,206: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:40:03.254324117Z [2024-05-25 00:40:03,254: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T00:40:03.259136167Z [2024-05-25 00:40:03,258: INFO/ForkPoolWorker-3] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:40:03.259154376Z [2024-05-25 00:40:03,259: INFO/ForkPoolWorker-3] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:40:03.259296866Z [2024-05-25 00:40:03,259: INFO/ForkPoolWorker-3] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:40:03.259311619Z [2024-05-25 00:40:03,259: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-25T00:40:03.259666440Z [2024-05-25 00:40:03,259: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:40:03.259732876Z [2024-05-25 00:40:03,259: INFO/ForkPoolWorker-3] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:40:03.341288587Z [2024-05-25 00:40:03,340: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T00:40:03.349047284Z [2024-05-25 00:40:03,348: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:40:03.352503443Z [2024-05-25 00:40:03,352: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:40:03.384478140Z [2024-05-25 00:40:03,384: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:40:03.386124337Z [2024-05-25 00:40:03,385: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:40:03.386374315Z [2024-05-25 00:40:03,386: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:40:03.386629568Z [2024-05-25 00:40:03,386: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:40:03.386793040Z [2024-05-25 00:40:03,386: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T00:40:03.388419955Z [2024-05-25 00:40:03,388: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:40:03.388619994Z [2024-05-25 00:40:03,388: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:40:03.402180642Z [2024-05-25 00:40:03,401: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0f8f409c-ec58-4b86-a8fb-558a991444e3] succeeded in 2.918832070999997s: None 2024-05-25T00:40:03.468995337Z [2024-05-25 00:40:03,468: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:40:03.526312474Z [2024-05-25 00:40:03,526: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6fe047df-0427-42b9-aa42-ff08bcedc870] received 2024-05-25T00:40:03.532886598Z [2024-05-25 00:40:03,532: INFO/ForkPoolWorker-15] [6fe047df-0427-42b9-aa42-ff08bcedc870] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:40:03.867326431Z [2024-05-25 00:40:03,863: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:40:04.974765093Z [2024-05-25 00:40:04,974: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[5091cdf3-4b91-445f-bcff-b36b2b22d4d0] succeeded in 4.447220811000079s: None 2024-05-25T00:40:05.119538714Z [2024-05-25 00:40:05,119: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:40:05.122827590Z [2024-05-25 00:40:05,122: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:40:05.152257459Z [2024-05-25 00:40:05,152: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:40:05.153850327Z [2024-05-25 00:40:05,153: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:40:05.153918135Z [2024-05-25 00:40:05,153: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:40:05.154093583Z [2024-05-25 00:40:05,153: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:40:05.154166535Z [2024-05-25 00:40:05,154: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:40:05.154455318Z [2024-05-25 00:40:05,154: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:40:05.154524296Z [2024-05-25 00:40:05,154: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:40:05.208288093Z [2024-05-25 00:40:05,207: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[973bb11b-b599-4f14-ac38-283e8495a4d0] succeeded in 4.6947940630007s: None 2024-05-25T00:40:05.244040751Z [2024-05-25 00:40:05,243: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:40:05.904156506Z [2024-05-25 00:40:05,903: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6fe047df-0427-42b9-aa42-ff08bcedc870] succeeded in 2.376155347999884s: None 2024-05-25T00:40:06.018046553Z [2024-05-25 00:40:06,017: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a85f1229-059e-4b6c-a372-bdefc7cfd68b] received 2024-05-25T00:40:06.031332244Z [2024-05-25 00:40:06,031: INFO/ForkPoolWorker-15] [a85f1229-059e-4b6c-a372-bdefc7cfd68b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T00:40:06.385894713Z [2024-05-25 00:40:06,382: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:40:07.661761459Z [2024-05-25 00:40:07,661: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:40:07.665317252Z [2024-05-25 00:40:07,664: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:40:07.685411887Z [2024-05-25 00:40:07,685: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:40:07.686701763Z [2024-05-25 00:40:07,686: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:40:07.686780390Z [2024-05-25 00:40:07,686: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:40:07.686917756Z [2024-05-25 00:40:07,686: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:40:07.686989774Z [2024-05-25 00:40:07,686: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:40:07.687280493Z [2024-05-25 00:40:07,687: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:40:07.687378969Z [2024-05-25 00:40:07,687: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:40:07.777031881Z [2024-05-25 00:40:07,776: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:40:08.321856627Z [2024-05-25 00:40:08,321: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a85f1229-059e-4b6c-a372-bdefc7cfd68b] succeeded in 2.3000129419997393s: None 2024-05-25T00:40:09.275935130Z [2024-05-25 00:40:09,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05a9df9f-dfb3-4390-a94b-ce478612cf05] received 2024-05-25T00:40:09.287797500Z [2024-05-25 00:40:09,287: INFO/ForkPoolWorker-15] [05a9df9f-dfb3-4390-a94b-ce478612cf05] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:40:09.581522149Z [2024-05-25 00:40:09,578: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:40:10.729225438Z [2024-05-25 00:40:10,728: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:40:10.732501263Z [2024-05-25 00:40:10,732: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:40:10.748696191Z [2024-05-25 00:40:10,748: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:40:10.749897149Z [2024-05-25 00:40:10,749: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:40:10.749913072Z [2024-05-25 00:40:10,749: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:40:10.750033592Z [2024-05-25 00:40:10,749: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:40:10.750057459Z [2024-05-25 00:40:10,749: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:40:10.750350890Z [2024-05-25 00:40:10,750: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:40:10.750564192Z [2024-05-25 00:40:10,750: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:40:10.829110825Z [2024-05-25 00:40:10,828: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:40:11.404280087Z [2024-05-25 00:40:11,403: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[05a9df9f-dfb3-4390-a94b-ce478612cf05] succeeded in 2.123396001999936s: None 2024-05-25T00:41:00.413672762Z [2024-05-25 00:41:00,413: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d44d4d46-466e-4084-8284-663b82a78ccc] received 2024-05-25T00:41:00.419234212Z [2024-05-25 00:41:00,418: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0912fefa-d642-435b-af61-3d838fb86c46] received 2024-05-25T00:41:00.427326697Z [2024-05-25 00:41:00,426: INFO/ForkPoolWorker-15] [d44d4d46-466e-4084-8284-663b82a78ccc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:41:00.429046206Z [2024-05-25 00:41:00,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db64ced8-957e-469d-b8e8-3981dd565805] received 2024-05-25T00:41:00.429462510Z [2024-05-25 00:41:00,429: INFO/ForkPoolWorker-16] [0912fefa-d642-435b-af61-3d838fb86c46] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:41:00.440931357Z [2024-05-25 00:41:00,440: INFO/ForkPoolWorker-1] [db64ced8-957e-469d-b8e8-3981dd565805] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:41:00.719198787Z [2024-05-25 00:41:00,716: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:41:00.758214360Z [2024-05-25 00:41:00,754: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:41:00.778927655Z [2024-05-25 00:41:00,775: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:41:00.877713452Z [2024-05-25 00:41:00,877: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T00:41:00.881960753Z [2024-05-25 00:41:00,881: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:41:00.906947401Z [2024-05-25 00:41:00,906: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:41:00.908201725Z [2024-05-25 00:41:00,907: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:41:00.908443819Z [2024-05-25 00:41:00,908: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:41:00.908639306Z [2024-05-25 00:41:00,908: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T00:41:00.908992448Z [2024-05-25 00:41:00,908: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:41:01.030786321Z [2024-05-25 00:41:01,030: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:41:01.628019909Z [2024-05-25 00:41:01,627: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[db64ced8-957e-469d-b8e8-3981dd565805] succeeded in 1.1957557269997778s: None 2024-05-25T00:41:01.949189020Z [2024-05-25 00:41:01,948: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:41:01.953640629Z [2024-05-25 00:41:01,953: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:41:01.976320512Z [2024-05-25 00:41:01,976: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:41:01.978132698Z [2024-05-25 00:41:01,977: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:41:01.978346325Z [2024-05-25 00:41:01,978: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:41:01.978743383Z [2024-05-25 00:41:01,978: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:41:01.979008394Z [2024-05-25 00:41:01,978: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:41:01.979417759Z [2024-05-25 00:41:01,979: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:41:01.979478357Z [2024-05-25 00:41:01,979: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:41:02.055762556Z [2024-05-25 00:41:02,055: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:41:02.059560172Z [2024-05-25 00:41:02,059: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:41:02.068246676Z [2024-05-25 00:41:02,067: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:41:02.079238187Z [2024-05-25 00:41:02,079: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:41:02.080429158Z [2024-05-25 00:41:02,080: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:41:02.080444941Z [2024-05-25 00:41:02,080: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:41:02.080629380Z [2024-05-25 00:41:02,080: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:41:02.080691516Z [2024-05-25 00:41:02,080: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:41:02.080937552Z [2024-05-25 00:41:02,080: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:41:02.081087098Z [2024-05-25 00:41:02,080: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:41:02.172084157Z [2024-05-25 00:41:02,171: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:41:03.722693845Z [2024-05-25 00:41:03,722: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0912fefa-d642-435b-af61-3d838fb86c46] succeeded in 3.3009188700007144s: None 2024-05-25T00:41:04.129741656Z [2024-05-25 00:41:04,128: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d44d4d46-466e-4084-8284-663b82a78ccc] succeeded in 3.7117858829997203s: None 2024-05-25T00:42:00.709292335Z [2024-05-25 00:42:00,708: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7418f1c5-0124-44be-9260-c0dfe6075f8f] received 2024-05-25T00:42:00.712024041Z [2024-05-25 00:42:00,711: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff5679da-c1e3-4d5e-b10a-9a196b730233] received 2024-05-25T00:42:00.725094764Z [2024-05-25 00:42:00,724: INFO/ForkPoolWorker-15] [7418f1c5-0124-44be-9260-c0dfe6075f8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:42:00.729826415Z [2024-05-25 00:42:00,729: INFO/ForkPoolWorker-16] [ff5679da-c1e3-4d5e-b10a-9a196b730233] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:42:00.733430101Z [2024-05-25 00:42:00,733: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c4db04a-ed76-408d-85b5-4e19cfa38722] received 2024-05-25T00:42:00.747234649Z [2024-05-25 00:42:00,746: INFO/ForkPoolWorker-1] [5c4db04a-ed76-408d-85b5-4e19cfa38722] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:42:00.752000964Z [2024-05-25 00:42:00,751: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46eebbb1-7d83-42e4-92af-1e5dbe53a17f] received 2024-05-25T00:42:00.761555609Z [2024-05-25 00:42:00,761: INFO/ForkPoolWorker-2] [46eebbb1-7d83-42e4-92af-1e5dbe53a17f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:42:01.083117361Z [2024-05-25 00:42:01,080: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:42:01.194587376Z [2024-05-25 00:42:01,190: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:42:01.284758147Z [2024-05-25 00:42:01,277: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:42:01.340623898Z [2024-05-25 00:42:01,340: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:42:01.351458030Z [2024-05-25 00:42:01,347: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:42:01.511901414Z [2024-05-25 00:42:01,511: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T00:42:01.516728492Z [2024-05-25 00:42:01,516: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:42:01.542193841Z [2024-05-25 00:42:01,541: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:42:01.550207389Z [2024-05-25 00:42:01,549: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:42:01.550233828Z [2024-05-25 00:42:01,550: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:42:01.550272933Z [2024-05-25 00:42:01,550: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T00:42:01.550495307Z [2024-05-25 00:42:01,550: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:42:01.682193160Z [2024-05-25 00:42:01,681: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:42:01.834087265Z [2024-05-25 00:42:01,833: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ff5679da-c1e3-4d5e-b10a-9a196b730233] succeeded in 1.1194431670000995s: None 2024-05-25T00:42:02.391415158Z [2024-05-25 00:42:02,390: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5c4db04a-ed76-408d-85b5-4e19cfa38722] succeeded in 1.6559228520000033s: None 2024-05-25T00:42:02.804199021Z [2024-05-25 00:42:02,803: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:42:02.807614082Z [2024-05-25 00:42:02,807: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:42:02.816432534Z [2024-05-25 00:42:02,815: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T00:42:02.819702776Z [2024-05-25 00:42:02,819: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:42:02.836285968Z [2024-05-25 00:42:02,835: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:42:02.838339996Z [2024-05-25 00:42:02,838: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:42:02.838386907Z [2024-05-25 00:42:02,838: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:42:02.839526044Z [2024-05-25 00:42:02,838: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:42:02.839567379Z [2024-05-25 00:42:02,839: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:42:02.839896319Z [2024-05-25 00:42:02,839: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:42:02.839915462Z [2024-05-25 00:42:02,839: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:42:02.850253566Z [2024-05-25 00:42:02,850: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:42:02.851389580Z [2024-05-25 00:42:02,851: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:42:02.851400894Z [2024-05-25 00:42:02,851: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:42:02.851562027Z [2024-05-25 00:42:02,851: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:42:02.851601310Z [2024-05-25 00:42:02,851: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T00:42:02.851898386Z [2024-05-25 00:42:02,851: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:42:02.851961973Z [2024-05-25 00:42:02,851: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:42:02.947272296Z [2024-05-25 00:42:02,946: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:42:02.960965350Z [2024-05-25 00:42:02,960: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:42:05.412341930Z [2024-05-25 00:42:05,411: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7418f1c5-0124-44be-9260-c0dfe6075f8f] succeeded in 4.698401028000262s: None 2024-05-25T00:42:05.557293630Z [2024-05-25 00:42:05,556: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[46eebbb1-7d83-42e4-92af-1e5dbe53a17f] succeeded in 4.801913364999564s: None 2024-05-25T00:43:00.955240981Z [2024-05-25 00:43:00,954: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd8e49a3-2b12-4197-8c24-8c2e209b423a] received 2024-05-25T00:43:00.963408235Z [2024-05-25 00:43:00,963: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5b71528-d4e5-4f2a-bec4-ad7445a77fba] received 2024-05-25T00:43:00.967575157Z [2024-05-25 00:43:00,966: INFO/ForkPoolWorker-15] [dd8e49a3-2b12-4197-8c24-8c2e209b423a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:43:00.975171149Z [2024-05-25 00:43:00,974: INFO/ForkPoolWorker-16] [d5b71528-d4e5-4f2a-bec4-ad7445a77fba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:43:00.980035121Z [2024-05-25 00:43:00,979: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41e71e3d-e2b0-4aa1-b289-22652638ce89] received 2024-05-25T00:43:00.993524594Z [2024-05-25 00:43:00,993: INFO/ForkPoolWorker-1] [41e71e3d-e2b0-4aa1-b289-22652638ce89] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:43:01.293411140Z [2024-05-25 00:43:01,290: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:43:01.313427768Z [2024-05-25 00:43:01,309: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:43:01.337575502Z [2024-05-25 00:43:01,331: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:43:01.525085104Z [2024-05-25 00:43:01,523: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T00:43:01.531498453Z [2024-05-25 00:43:01,530: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:43:01.592548949Z [2024-05-25 00:43:01,592: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:43:01.593649284Z [2024-05-25 00:43:01,593: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:43:01.593714615Z [2024-05-25 00:43:01,593: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:43:01.593758082Z [2024-05-25 00:43:01,593: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T00:43:01.594373251Z [2024-05-25 00:43:01,593: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:43:01.704119353Z [2024-05-25 00:43:01,703: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:43:02.316848018Z [2024-05-25 00:43:02,316: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[41e71e3d-e2b0-4aa1-b289-22652638ce89] succeeded in 1.33503743700021s: None 2024-05-25T00:43:02.598637051Z [2024-05-25 00:43:02,598: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:43:02.602235383Z [2024-05-25 00:43:02,601: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:43:02.623712072Z [2024-05-25 00:43:02,623: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:43:02.625110739Z [2024-05-25 00:43:02,624: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:43:02.625148084Z [2024-05-25 00:43:02,625: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:43:02.625423049Z [2024-05-25 00:43:02,625: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:43:02.625510760Z [2024-05-25 00:43:02,625: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:43:02.626565733Z [2024-05-25 00:43:02,625: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:43:02.626578904Z [2024-05-25 00:43:02,625: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:43:02.662229077Z [2024-05-25 00:43:02,661: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:43:02.665566937Z [2024-05-25 00:43:02,665: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:43:02.687463171Z [2024-05-25 00:43:02,687: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:43:02.689036970Z [2024-05-25 00:43:02,688: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:43:02.689316603Z [2024-05-25 00:43:02,689: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:43:02.689681560Z [2024-05-25 00:43:02,689: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:43:02.689948122Z [2024-05-25 00:43:02,689: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:43:02.690322919Z [2024-05-25 00:43:02,690: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:43:02.690793747Z [2024-05-25 00:43:02,690: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:43:02.718367119Z [2024-05-25 00:43:02,718: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:43:02.776779869Z [2024-05-25 00:43:02,776: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:43:04.769123306Z [2024-05-25 00:43:04,768: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d5b71528-d4e5-4f2a-bec4-ad7445a77fba] succeeded in 3.80367842799933s: None 2024-05-25T00:43:05.194839626Z [2024-05-25 00:43:05,194: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dd8e49a3-2b12-4197-8c24-8c2e209b423a] succeeded in 4.234865100000206s: None 2024-05-25T00:43:25.636680663Z [2024-05-25 00:43:25,636: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50214810-2989-43cb-96ba-5c8e153c3249] received 2024-05-25T00:43:25.649334232Z [2024-05-25 00:43:25,648: INFO/ForkPoolWorker-15] [50214810-2989-43cb-96ba-5c8e153c3249] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:43:25.910871013Z [2024-05-25 00:43:25,907: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:43:26.062996861Z [2024-05-25 00:43:26,062: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T00:43:26.066886675Z [2024-05-25 00:43:26,066: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:43:26.090771285Z [2024-05-25 00:43:26,090: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:43:26.092878814Z [2024-05-25 00:43:26,092: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:43:26.092891405Z [2024-05-25 00:43:26,092: INFO/ForkPoolWorker-15] Read SDNC c99fb593-fc6d-45e3-b066-8690ef651ebf (epa_03) 2024-05-25T00:43:26.093047972Z [2024-05-25 00:43:26,092: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': 'c99fb593-fc6d-45e3-b066-8690ef651ebf', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-05-25T00:43:26.093061045Z [2024-05-25 00:43:26,092: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T00:43:26.093353649Z [2024-05-25 00:43:26,093: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:43:26.101009356Z [2024-05-25 00:43:26,100: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf 2024-05-25T00:43:26.207046320Z [2024-05-25 00:43:26,206: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:43:26.893988544Z [2024-05-25 00:43:26,893: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[50214810-2989-43cb-96ba-5c8e153c3249] succeeded in 1.2508266770000773s: None 2024-05-25T00:44:01.273377823Z [2024-05-25 00:44:01,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8a04b68-331b-4a8f-9783-5d9eb78a7281] received 2024-05-25T00:44:01.276903589Z [2024-05-25 00:44:01,276: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bcf2095c-b741-4161-bfea-c2c83569e940] received 2024-05-25T00:44:01.280700817Z [2024-05-25 00:44:01,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86550394-b956-4b95-9b76-3dbad6720f9a] received 2024-05-25T00:44:01.285148201Z [2024-05-25 00:44:01,284: INFO/ForkPoolWorker-15] [d8a04b68-331b-4a8f-9783-5d9eb78a7281] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:44:01.285925307Z [2024-05-25 00:44:01,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[263838db-cd37-4926-bbfe-97ed2ac4f911] received 2024-05-25T00:44:01.291238600Z [2024-05-25 00:44:01,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21d4f429-777c-408c-8bb2-55ba67ba6516] received 2024-05-25T00:44:01.300169720Z [2024-05-25 00:44:01,299: INFO/ForkPoolWorker-1] [86550394-b956-4b95-9b76-3dbad6720f9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:44:01.304806628Z [2024-05-25 00:44:01,304: INFO/ForkPoolWorker-2] [263838db-cd37-4926-bbfe-97ed2ac4f911] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:44:01.305858637Z [2024-05-25 00:44:01,305: INFO/ForkPoolWorker-3] [21d4f429-777c-408c-8bb2-55ba67ba6516] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:44:01.306590876Z [2024-05-25 00:44:01,306: INFO/ForkPoolWorker-16] [bcf2095c-b741-4161-bfea-c2c83569e940] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:44:01.639606677Z [2024-05-25 00:44:01,635: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:44:01.658135007Z [2024-05-25 00:44:01,655: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:44:01.689943792Z [2024-05-25 00:44:01,686: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:44:01.870013843Z [2024-05-25 00:44:01,869: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T00:44:01.883156617Z [2024-05-25 00:44:01,877: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:44:01.930861440Z [2024-05-25 00:44:01,928: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:44:01.948921843Z [2024-05-25 00:44:01,948: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:44:01.950070166Z [2024-05-25 00:44:01,949: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:44:01.950082044Z [2024-05-25 00:44:01,949: INFO/ForkPoolWorker-16] Read SDNC c99fb593-fc6d-45e3-b066-8690ef651ebf (epa_03) 2024-05-25T00:44:01.950187714Z [2024-05-25 00:44:01,950: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': 'c99fb593-fc6d-45e3-b066-8690ef651ebf', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-05-25T00:44:01.950213314Z [2024-05-25 00:44:01,950: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T00:44:01.950415403Z [2024-05-25 00:44:01,950: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:44:01.956690064Z [2024-05-25 00:44:01,956: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf 2024-05-25T00:44:01.959565017Z [2024-05-25 00:44:01,959: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:44:01.970274316Z [2024-05-25 00:44:01,964: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:44:02.115040211Z [2024-05-25 00:44:02,114: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:44:02.414329270Z [2024-05-25 00:44:02,413: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-25T00:44:02.428569986Z [2024-05-25 00:44:02,428: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:44:02.463832698Z [2024-05-25 00:44:02,463: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T00:44:02.465375843Z [2024-05-25 00:44:02,465: INFO/ForkPoolWorker-3] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:44:02.465434147Z [2024-05-25 00:44:02,465: INFO/ForkPoolWorker-3] Read SDNC c99fb593-fc6d-45e3-b066-8690ef651ebf (epa_03) 2024-05-25T00:44:02.465589190Z [2024-05-25 00:44:02,465: INFO/ForkPoolWorker-3] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': 'c99fb593-fc6d-45e3-b066-8690ef651ebf', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-05-25T00:44:02.465719963Z [2024-05-25 00:44:02,465: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-25T00:44:02.466267393Z [2024-05-25 00:44:02,466: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:44:02.484303244Z [2024-05-25 00:44:02,484: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf 2024-05-25T00:44:02.621126085Z [2024-05-25 00:44:02,620: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:44:02.770315876Z [2024-05-25 00:44:02,769: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[86550394-b956-4b95-9b76-3dbad6720f9a] succeeded in 1.4861560210001699s: None 2024-05-25T00:44:03.016499878Z [2024-05-25 00:44:03,016: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bcf2095c-b741-4161-bfea-c2c83569e940] succeeded in 1.736540935999983s: None 2024-05-25T00:44:03.212548630Z [2024-05-25 00:44:03,212: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[21d4f429-777c-408c-8bb2-55ba67ba6516] succeeded in 1.9187182370005758s: None 2024-05-25T00:44:03.214184455Z [2024-05-25 00:44:03,213: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T00:44:03.217730347Z [2024-05-25 00:44:03,217: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:44:03.238309875Z [2024-05-25 00:44:03,238: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:44:03.239685493Z [2024-05-25 00:44:03,239: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:44:03.239700733Z [2024-05-25 00:44:03,239: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:44:03.240222073Z [2024-05-25 00:44:03,239: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:44:03.240248175Z [2024-05-25 00:44:03,240: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T00:44:03.240517272Z [2024-05-25 00:44:03,240: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:44:03.240547935Z [2024-05-25 00:44:03,240: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:44:03.325917063Z [2024-05-25 00:44:03,325: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:44:03.399920218Z [2024-05-25 00:44:03,399: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:44:03.406109172Z [2024-05-25 00:44:03,405: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:44:03.427232387Z [2024-05-25 00:44:03,427: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:44:03.428878129Z [2024-05-25 00:44:03,428: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:44:03.429062565Z [2024-05-25 00:44:03,428: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:44:03.429281099Z [2024-05-25 00:44:03,429: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:44:03.429373054Z [2024-05-25 00:44:03,429: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:44:03.429811263Z [2024-05-25 00:44:03,429: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:44:03.429976205Z [2024-05-25 00:44:03,429: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:44:03.501529210Z [2024-05-25 00:44:03,501: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:44:05.211985924Z [2024-05-25 00:44:05,211: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d8a04b68-331b-4a8f-9783-5d9eb78a7281] succeeded in 3.935362776999682s: None 2024-05-25T00:44:05.336478026Z [2024-05-25 00:44:05,335: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[263838db-cd37-4926-bbfe-97ed2ac4f911] succeeded in 4.045872597000198s: None 2024-05-25T00:45:00.506677036Z [2024-05-25 00:45:00,506: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[deae3391-9664-4b5c-acc7-b4c1638b1e79] received 2024-05-25T00:45:00.509752856Z [2024-05-25 00:45:00,509: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7801d862-3c91-4616-81f5-89caf285f659] received 2024-05-25T00:45:00.515505837Z [2024-05-25 00:45:00,515: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbf6b023-4a93-41ff-ae2f-069fd09f21b6] received 2024-05-25T00:45:00.521543786Z [2024-05-25 00:45:00,521: INFO/ForkPoolWorker-15] [deae3391-9664-4b5c-acc7-b4c1638b1e79] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:45:00.524563278Z [2024-05-25 00:45:00,524: INFO/ForkPoolWorker-1] [dbf6b023-4a93-41ff-ae2f-069fd09f21b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:45:00.527907693Z [2024-05-25 00:45:00,527: INFO/ForkPoolWorker-16] [7801d862-3c91-4616-81f5-89caf285f659] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:45:00.532304754Z [2024-05-25 00:45:00,532: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8bfa65e3-f77b-48e6-afb3-89a5252ea2ff] received 2024-05-25T00:45:00.538557277Z [2024-05-25 00:45:00,535: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[138e226e-227c-422a-a7ce-7d815c654dcb] received 2024-05-25T00:45:00.547878981Z [2024-05-25 00:45:00,547: INFO/ForkPoolWorker-2] [8bfa65e3-f77b-48e6-afb3-89a5252ea2ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:45:00.552782327Z [2024-05-25 00:45:00,552: INFO/ForkPoolWorker-3] [138e226e-227c-422a-a7ce-7d815c654dcb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:45:00.850136558Z [2024-05-25 00:45:00,846: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:45:00.854824707Z [2024-05-25 00:45:00,851: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:45:00.942768492Z [2024-05-25 00:45:00,939: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:45:01.125100656Z [2024-05-25 00:45:01,124: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T00:45:01.129184593Z [2024-05-25 00:45:01,128: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:45:01.158009397Z [2024-05-25 00:45:01,157: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:45:01.161961661Z [2024-05-25 00:45:01,161: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:45:01.162004490Z [2024-05-25 00:45:01,161: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:45:01.162041463Z [2024-05-25 00:45:01,161: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T00:45:01.162223701Z [2024-05-25 00:45:01,162: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:45:01.170587567Z [2024-05-25 00:45:01,170: WARNING/ForkPoolWorker-2] Dag 'sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:45:01.170757048Z [2024-05-25 00:45:01,170: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:45:01.171448021Z [2024-05-25 00:45:01,171: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T00:45:01.175367139Z [2024-05-25 00:45:01,175: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:45:01.178600455Z [2024-05-25 00:45:01,161: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:45:01.248434209Z [2024-05-25 00:45:01,248: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:45:01.251016383Z [2024-05-25 00:45:01,250: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:45:01.251057135Z [2024-05-25 00:45:01,250: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:45:01.252567732Z [2024-05-25 00:45:01,251: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T00:45:01.252749985Z [2024-05-25 00:45:01,252: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:45:01.256196650Z [2024-05-25 00:45:01,255: ERROR/ForkPoolWorker-2] [8bfa65e3-f77b-48e6-afb3-89a5252ea2ff] Failed to execute task Dag 'sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf' could not be found; either it does not exist or it failed to parse.. 2024-05-25T00:45:01.256232731Z Traceback (most recent call last): 2024-05-25T00:45:01.256237252Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-25T00:45:01.256241496Z args.func(args) 2024-05-25T00:45:01.256245480Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-25T00:45:01.256249112Z return func(*args, **kwargs) 2024-05-25T00:45:01.256252210Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-25T00:45:01.256255210Z return f(*args, **kwargs) 2024-05-25T00:45:01.256258259Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-25T00:45:01.256261564Z dag = get_dag(args.subdir, args.dag_id) 2024-05-25T00:45:01.256264987Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-25T00:45:01.256268072Z raise AirflowException( 2024-05-25T00:45:01.256277299Z airflow.exceptions.AirflowException: Dag 'sdnc_status_c99fb593-fc6d-45e3-b066-8690ef651ebf' could not be found; either it does not exist or it failed to parse. 2024-05-25T00:45:01.257742099Z [2024-05-25 00:45:01,253: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:45:01.295756336Z [2024-05-25 00:45:01,295: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8bfa65e3-f77b-48e6-afb3-89a5252ea2ff] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 8bfa65e3-f77b-48e6-afb3-89a5252ea2ff') 2024-05-25T00:45:01.295776475Z Traceback (most recent call last): 2024-05-25T00:45:01.295780892Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-25T00:45:01.295826114Z R = retval = fun(*args, **kwargs) 2024-05-25T00:45:01.295829445Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-25T00:45:01.295832352Z return self.run(*args, **kwargs) 2024-05-25T00:45:01.295863950Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-25T00:45:01.295880582Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-25T00:45:01.295883996Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-25T00:45:01.295893866Z raise AirflowException(msg) 2024-05-25T00:45:01.295898346Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 8bfa65e3-f77b-48e6-afb3-89a5252ea2ff 2024-05-25T00:45:01.459040054Z [2024-05-25 00:45:01,458: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-25T00:45:01.462747186Z [2024-05-25 00:45:01,462: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:45:01.504060117Z [2024-05-25 00:45:01,503: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T00:45:01.505436615Z [2024-05-25 00:45:01,505: INFO/ForkPoolWorker-3] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:45:01.505522782Z [2024-05-25 00:45:01,505: INFO/ForkPoolWorker-3] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:45:01.505588441Z [2024-05-25 00:45:01,505: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-25T00:45:01.505803909Z [2024-05-25 00:45:01,505: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:45:01.596041758Z [2024-05-25 00:45:01,595: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:45:02.154666907Z [2024-05-25 00:45:02,154: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:45:02.158560553Z [2024-05-25 00:45:02,158: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:45:02.193488523Z [2024-05-25 00:45:02,190: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:45:02.193501910Z [2024-05-25 00:45:02,192: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:45:02.193507619Z [2024-05-25 00:45:02,192: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:45:02.193515756Z [2024-05-25 00:45:02,192: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:45:02.193522167Z [2024-05-25 00:45:02,192: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:45:02.193527097Z [2024-05-25 00:45:02,192: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:45:02.193531884Z [2024-05-25 00:45:02,192: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:45:02.333968507Z [2024-05-25 00:45:02,333: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:45:02.417691211Z [2024-05-25 00:45:02,417: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[138e226e-227c-422a-a7ce-7d815c654dcb] succeeded in 1.876393155000187s: None 2024-05-25T00:45:02.462800023Z [2024-05-25 00:45:02,462: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:45:02.466927741Z [2024-05-25 00:45:02,466: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:45:02.496857781Z [2024-05-25 00:45:02,496: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:45:02.498212915Z [2024-05-25 00:45:02,498: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:45:02.498316264Z [2024-05-25 00:45:02,498: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:45:02.498492742Z [2024-05-25 00:45:02,498: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:45:02.498568623Z [2024-05-25 00:45:02,498: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:45:02.498867670Z [2024-05-25 00:45:02,498: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:45:02.498962338Z [2024-05-25 00:45:02,498: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:45:02.585838986Z [2024-05-25 00:45:02,585: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:45:02.907535121Z [2024-05-25 00:45:02,907: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:45:02.910997376Z [2024-05-25 00:45:02,910: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:45:02.934527685Z [2024-05-25 00:45:02,934: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:45:02.935861026Z [2024-05-25 00:45:02,935: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:45:02.935906960Z [2024-05-25 00:45:02,935: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:45:02.936048665Z [2024-05-25 00:45:02,935: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:45:02.936119352Z [2024-05-25 00:45:02,936: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:45:02.936384923Z [2024-05-25 00:45:02,936: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:45:02.936425391Z [2024-05-25 00:45:02,936: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:45:03.033422795Z [2024-05-25 00:45:03,033: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:45:03.668115996Z [2024-05-25 00:45:03,667: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37ba4d96-ce96-41e2-bbd5-c1e2bcad4a52] received 2024-05-25T00:45:03.668211688Z [2024-05-25 00:45:03,667: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[deae3391-9664-4b5c-acc7-b4c1638b1e79] succeeded in 3.155993725999906s: None 2024-05-25T00:45:03.684264224Z [2024-05-25 00:45:03,683: INFO/ForkPoolWorker-15] [37ba4d96-ce96-41e2-bbd5-c1e2bcad4a52] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:45:03.967103250Z [2024-05-25 00:45:03,964: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:45:04.167467406Z [2024-05-25 00:45:04,166: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7801d862-3c91-4616-81f5-89caf285f659] succeeded in 3.6519253389997175s: None 2024-05-25T00:45:04.277179730Z [2024-05-25 00:45:04,276: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dbf6b023-4a93-41ff-ae2f-069fd09f21b6] succeeded in 3.7592797260003863s: None 2024-05-25T00:45:05.150419189Z [2024-05-25 00:45:05,149: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:45:05.153925079Z [2024-05-25 00:45:05,153: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:45:05.173728889Z [2024-05-25 00:45:05,173: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:45:05.175765055Z [2024-05-25 00:45:05,175: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:45:05.176241792Z [2024-05-25 00:45:05,175: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:45:05.176419980Z [2024-05-25 00:45:05,176: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:45:05.176549025Z [2024-05-25 00:45:05,176: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:45:05.177061775Z [2024-05-25 00:45:05,176: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:45:05.177282754Z [2024-05-25 00:45:05,176: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:45:05.266784552Z [2024-05-25 00:45:05,266: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:45:06.008320494Z [2024-05-25 00:45:06,007: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[37ba4d96-ce96-41e2-bbd5-c1e2bcad4a52] succeeded in 2.334442344999843s: None 2024-05-25T00:45:06.141403935Z [2024-05-25 00:45:06,141: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f383d42-837f-4775-84dd-6a774a787199] received 2024-05-25T00:45:06.148665496Z [2024-05-25 00:45:06,148: INFO/ForkPoolWorker-15] [3f383d42-837f-4775-84dd-6a774a787199] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T00:45:06.437514847Z [2024-05-25 00:45:06,433: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:45:07.634888069Z [2024-05-25 00:45:07,634: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:45:07.638341281Z [2024-05-25 00:45:07,637: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:45:07.658836647Z [2024-05-25 00:45:07,658: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:45:07.660464469Z [2024-05-25 00:45:07,660: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:45:07.660556374Z [2024-05-25 00:45:07,660: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:45:07.660749464Z [2024-05-25 00:45:07,660: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:45:07.660867832Z [2024-05-25 00:45:07,660: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:45:07.661145509Z [2024-05-25 00:45:07,660: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:45:07.661297811Z [2024-05-25 00:45:07,661: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:45:07.753466380Z [2024-05-25 00:45:07,753: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:45:08.330507986Z [2024-05-25 00:45:08,328: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3f383d42-837f-4775-84dd-6a774a787199] succeeded in 2.1858216939999693s: None 2024-05-25T00:45:08.447938169Z [2024-05-25 00:45:08,447: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6e6faa7-71af-4734-8d04-8852efdeea9e] received 2024-05-25T00:45:08.456851045Z [2024-05-25 00:45:08,456: INFO/ForkPoolWorker-15] [a6e6faa7-71af-4734-8d04-8852efdeea9e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:45:08.782598806Z [2024-05-25 00:45:08,779: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:45:09.931798504Z [2024-05-25 00:45:09,931: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:45:09.935381658Z [2024-05-25 00:45:09,934: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:45:09.965435209Z [2024-05-25 00:45:09,961: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:45:09.967932354Z [2024-05-25 00:45:09,967: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:45:09.968447513Z [2024-05-25 00:45:09,968: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:45:09.968757402Z [2024-05-25 00:45:09,968: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:45:09.969820807Z [2024-05-25 00:45:09,969: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:45:09.970167575Z [2024-05-25 00:45:09,969: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:45:09.970769602Z [2024-05-25 00:45:09,970: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:45:10.056025425Z [2024-05-25 00:45:10,055: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:45:10.603592208Z [2024-05-25 00:45:10,602: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a6e6faa7-71af-4734-8d04-8852efdeea9e] succeeded in 2.153138607999608s: None 2024-05-25T00:46:00.265870604Z [2024-05-25 00:46:00,265: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd04ec40-bf9d-4da4-8ce0-8d095d879bfb] received 2024-05-25T00:46:00.275377443Z [2024-05-25 00:46:00,275: INFO/ForkPoolWorker-15] [dd04ec40-bf9d-4da4-8ce0-8d095d879bfb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:46:00.280767854Z [2024-05-25 00:46:00,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a5c8d40-4a49-4f7b-b903-238eea4edb04] received 2024-05-25T00:46:00.285897249Z [2024-05-25 00:46:00,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26d72a63-5bf7-4e84-8e2e-88fc7e6eeb0d] received 2024-05-25T00:46:00.287299312Z [2024-05-25 00:46:00,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc3b4844-b36e-4d6e-b943-3e8728e6de90] received 2024-05-25T00:46:00.309028541Z [2024-05-25 00:46:00,308: INFO/ForkPoolWorker-1] [26d72a63-5bf7-4e84-8e2e-88fc7e6eeb0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:46:00.313568718Z [2024-05-25 00:46:00,313: INFO/ForkPoolWorker-2] [dc3b4844-b36e-4d6e-b943-3e8728e6de90] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:46:00.313732095Z [2024-05-25 00:46:00,313: INFO/ForkPoolWorker-16] [5a5c8d40-4a49-4f7b-b903-238eea4edb04] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:46:00.623583444Z [2024-05-25 00:46:00,620: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:46:00.668211120Z [2024-05-25 00:46:00,664: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:46:00.749653008Z [2024-05-25 00:46:00,746: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:46:00.759721902Z [2024-05-25 00:46:00,756: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:46:00.923750518Z [2024-05-25 00:46:00,923: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T00:46:00.927638998Z [2024-05-25 00:46:00,927: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:46:00.947040659Z [2024-05-25 00:46:00,946: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:46:00.947864961Z [2024-05-25 00:46:00,947: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:46:00.947936666Z [2024-05-25 00:46:00,947: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:46:00.947963812Z [2024-05-25 00:46:00,947: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T00:46:00.948159761Z [2024-05-25 00:46:00,948: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:46:01.052718882Z [2024-05-25 00:46:01,047: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:46:01.052744850Z [2024-05-25 00:46:01,050: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:46:01.701835294Z [2024-05-25 00:46:01,701: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dd04ec40-bf9d-4da4-8ce0-8d095d879bfb] succeeded in 1.4338461280003685s: None 2024-05-25T00:46:01.706091227Z [2024-05-25 00:46:01,705: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5a5c8d40-4a49-4f7b-b903-238eea4edb04] succeeded in 1.420989309000106s: None 2024-05-25T00:46:01.957004595Z [2024-05-25 00:46:01,956: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:46:01.960352524Z [2024-05-25 00:46:01,959: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:46:01.984320172Z [2024-05-25 00:46:01,984: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:46:01.985577503Z [2024-05-25 00:46:01,985: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:46:01.985653867Z [2024-05-25 00:46:01,985: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:46:01.985810890Z [2024-05-25 00:46:01,985: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:46:01.985894651Z [2024-05-25 00:46:01,985: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:46:01.986237322Z [2024-05-25 00:46:01,986: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:46:01.986253494Z [2024-05-25 00:46:01,986: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:46:02.023106457Z [2024-05-25 00:46:02,022: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T00:46:02.026268161Z [2024-05-25 00:46:02,025: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:46:02.041171093Z [2024-05-25 00:46:02,040: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:46:02.042344916Z [2024-05-25 00:46:02,042: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:46:02.042402132Z [2024-05-25 00:46:02,042: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:46:02.042566896Z [2024-05-25 00:46:02,042: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:46:02.042650197Z [2024-05-25 00:46:02,042: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T00:46:02.042794291Z [2024-05-25 00:46:02,042: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:46:02.042863212Z [2024-05-25 00:46:02,042: INFO/ForkPoolWorker-2] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:46:02.090376212Z [2024-05-25 00:46:02,090: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:46:02.115537434Z [2024-05-25 00:46:02,115: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:46:03.725097769Z [2024-05-25 00:46:03,724: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[dc3b4844-b36e-4d6e-b943-3e8728e6de90] succeeded in 3.431334021999646s: None 2024-05-25T00:46:04.059358399Z [2024-05-25 00:46:04,058: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[26d72a63-5bf7-4e84-8e2e-88fc7e6eeb0d] succeeded in 3.770230583000739s: None 2024-05-25T00:47:00.209883732Z [2024-05-25 00:47:00,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af8b1d37-a03a-40c8-b1e2-88a10e2937c4] received 2024-05-25T00:47:00.221514293Z [2024-05-25 00:47:00,221: INFO/ForkPoolWorker-15] [af8b1d37-a03a-40c8-b1e2-88a10e2937c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:47:00.222742232Z [2024-05-25 00:47:00,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93814e2e-04da-4cf7-bff2-a4670082326b] received 2024-05-25T00:47:00.227349536Z [2024-05-25 00:47:00,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e024f5ab-9f7c-4fab-9a3e-5f1ce108c31c] received 2024-05-25T00:47:00.233859750Z [2024-05-25 00:47:00,233: INFO/ForkPoolWorker-16] [93814e2e-04da-4cf7-bff2-a4670082326b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:47:00.242047964Z [2024-05-25 00:47:00,241: INFO/ForkPoolWorker-1] [e024f5ab-9f7c-4fab-9a3e-5f1ce108c31c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:47:00.525398445Z [2024-05-25 00:47:00,521: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:47:00.529688926Z [2024-05-25 00:47:00,526: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:47:00.565628840Z [2024-05-25 00:47:00,561: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:47:00.757194696Z [2024-05-25 00:47:00,756: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T00:47:00.761975563Z [2024-05-25 00:47:00,761: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:47:00.792799145Z [2024-05-25 00:47:00,792: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:47:00.798597404Z [2024-05-25 00:47:00,798: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:47:00.798947159Z [2024-05-25 00:47:00,798: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:47:00.799138503Z [2024-05-25 00:47:00,798: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T00:47:00.800121592Z [2024-05-25 00:47:00,799: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:47:00.924387350Z [2024-05-25 00:47:00,924: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:47:01.694939945Z [2024-05-25 00:47:01,694: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[93814e2e-04da-4cf7-bff2-a4670082326b] succeeded in 1.4702416209993316s: None 2024-05-25T00:47:01.921289174Z [2024-05-25 00:47:01,920: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:47:01.926344233Z [2024-05-25 00:47:01,925: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:47:01.929384697Z [2024-05-25 00:47:01,929: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:47:01.932783417Z [2024-05-25 00:47:01,932: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:47:01.950255299Z [2024-05-25 00:47:01,950: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:47:01.952172494Z [2024-05-25 00:47:01,951: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:47:01.952500552Z [2024-05-25 00:47:01,952: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:47:01.952719396Z [2024-05-25 00:47:01,952: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:47:01.952880742Z [2024-05-25 00:47:01,952: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:47:01.953227410Z [2024-05-25 00:47:01,953: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:47:01.953404739Z [2024-05-25 00:47:01,953: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:47:01.958090201Z [2024-05-25 00:47:01,957: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:47:01.959381892Z [2024-05-25 00:47:01,959: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:47:01.959413243Z [2024-05-25 00:47:01,959: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:47:01.959565736Z [2024-05-25 00:47:01,959: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:47:01.959618648Z [2024-05-25 00:47:01,959: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:47:01.959895116Z [2024-05-25 00:47:01,959: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:47:01.959947454Z [2024-05-25 00:47:01,959: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:47:02.045179413Z [2024-05-25 00:47:02,044: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:47:02.050513368Z [2024-05-25 00:47:02,050: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:47:03.786488833Z [2024-05-25 00:47:03,785: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e024f5ab-9f7c-4fab-9a3e-5f1ce108c31c] succeeded in 3.5570477620003658s: None 2024-05-25T00:47:04.097794680Z [2024-05-25 00:47:04,096: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[af8b1d37-a03a-40c8-b1e2-88a10e2937c4] succeeded in 3.8837611560002188s: None 2024-05-25T00:48:00.229327783Z [2024-05-25 00:48:00,228: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[410a8645-55ae-45d5-b17a-d62a757acb01] received 2024-05-25T00:48:00.230842974Z [2024-05-25 00:48:00,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dcad045b-52f4-44a0-8d5d-0700dc60e12a] received 2024-05-25T00:48:00.242799357Z [2024-05-25 00:48:00,242: INFO/ForkPoolWorker-15] [410a8645-55ae-45d5-b17a-d62a757acb01] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:48:00.244685468Z [2024-05-25 00:48:00,244: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4bbd7c87-b528-4784-b729-3d4ab47cd01d] received 2024-05-25T00:48:00.247601233Z [2024-05-25 00:48:00,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac079619-7f78-4320-bb77-c65939ed79eb] received 2024-05-25T00:48:00.251442430Z [2024-05-25 00:48:00,250: INFO/ForkPoolWorker-16] [dcad045b-52f4-44a0-8d5d-0700dc60e12a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:48:00.265679007Z [2024-05-25 00:48:00,265: INFO/ForkPoolWorker-1] [4bbd7c87-b528-4784-b729-3d4ab47cd01d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:48:00.266121491Z [2024-05-25 00:48:00,265: INFO/ForkPoolWorker-2] [ac079619-7f78-4320-bb77-c65939ed79eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:48:00.537950438Z [2024-05-25 00:48:00,534: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:48:00.538535290Z [2024-05-25 00:48:00,535: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:48:00.571900425Z [2024-05-25 00:48:00,567: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:48:00.593226636Z [2024-05-25 00:48:00,590: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:48:00.685911458Z [2024-05-25 00:48:00,685: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T00:48:00.689710786Z [2024-05-25 00:48:00,689: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:48:00.716623701Z [2024-05-25 00:48:00,716: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:48:00.720247896Z [2024-05-25 00:48:00,720: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:48:00.720754939Z [2024-05-25 00:48:00,720: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:48:00.720877942Z [2024-05-25 00:48:00,720: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T00:48:00.721106222Z [2024-05-25 00:48:00,720: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:48:00.815783955Z [2024-05-25 00:48:00,815: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:48:00.820417997Z [2024-05-25 00:48:00,820: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:48:01.356904751Z [2024-05-25 00:48:01,353: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[410a8645-55ae-45d5-b17a-d62a757acb01] succeeded in 1.1208607589996973s: None 2024-05-25T00:48:01.466502500Z [2024-05-25 00:48:01,466: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ac079619-7f78-4320-bb77-c65939ed79eb] succeeded in 1.2150654460001533s: None 2024-05-25T00:48:01.866607842Z [2024-05-25 00:48:01,866: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:48:01.870215601Z [2024-05-25 00:48:01,869: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:48:01.916137186Z [2024-05-25 00:48:01,915: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:48:01.917637976Z [2024-05-25 00:48:01,917: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:48:01.917654910Z [2024-05-25 00:48:01,917: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:48:01.917901333Z [2024-05-25 00:48:01,917: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:48:01.917922867Z [2024-05-25 00:48:01,917: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:48:01.918186891Z [2024-05-25 00:48:01,918: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:48:01.918218453Z [2024-05-25 00:48:01,918: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:48:01.921346729Z [2024-05-25 00:48:01,920: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:48:01.926774959Z [2024-05-25 00:48:01,926: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:48:01.952227264Z [2024-05-25 00:48:01,951: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:48:01.954604244Z [2024-05-25 00:48:01,954: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:48:01.955015198Z [2024-05-25 00:48:01,954: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:48:01.955644316Z [2024-05-25 00:48:01,955: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:48:01.955942498Z [2024-05-25 00:48:01,955: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:48:01.956463233Z [2024-05-25 00:48:01,956: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:48:01.956589258Z [2024-05-25 00:48:01,956: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:48:02.019610421Z [2024-05-25 00:48:02,019: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:48:02.051329214Z [2024-05-25 00:48:02,051: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:48:03.623381896Z [2024-05-25 00:48:03,622: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4bbd7c87-b528-4784-b729-3d4ab47cd01d] succeeded in 3.3765910360007183s: None 2024-05-25T00:48:03.992299267Z [2024-05-25 00:48:03,991: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dcad045b-52f4-44a0-8d5d-0700dc60e12a] succeeded in 3.7547295079994s: None 2024-05-25T00:49:01.261086433Z [2024-05-25 00:49:01,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a90476ea-6545-4224-8395-70fb9f093f9c] received 2024-05-25T00:49:01.266592291Z [2024-05-25 00:49:01,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac18633d-39a6-4287-b244-57ae3fda6b6a] received 2024-05-25T00:49:01.270219180Z [2024-05-25 00:49:01,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10773648-1f00-4fd7-9a56-474c24b2cba9] received 2024-05-25T00:49:01.277330711Z [2024-05-25 00:49:01,276: INFO/ForkPoolWorker-15] [a90476ea-6545-4224-8395-70fb9f093f9c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:49:01.283208524Z [2024-05-25 00:49:01,282: INFO/ForkPoolWorker-1] [10773648-1f00-4fd7-9a56-474c24b2cba9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:49:01.290038726Z [2024-05-25 00:49:01,289: INFO/ForkPoolWorker-16] [ac18633d-39a6-4287-b244-57ae3fda6b6a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:49:01.607484266Z [2024-05-25 00:49:01,603: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:49:01.660517604Z [2024-05-25 00:49:01,656: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:49:01.703284435Z [2024-05-25 00:49:01,699: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:49:01.849344989Z [2024-05-25 00:49:01,848: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T00:49:01.855273602Z [2024-05-25 00:49:01,854: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:49:01.877652635Z [2024-05-25 00:49:01,877: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:49:01.879025567Z [2024-05-25 00:49:01,878: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:49:01.879231746Z [2024-05-25 00:49:01,878: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:49:01.879363356Z [2024-05-25 00:49:01,879: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T00:49:01.879628548Z [2024-05-25 00:49:01,879: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:49:02.030816522Z [2024-05-25 00:49:02,030: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:49:02.853450960Z [2024-05-25 00:49:02,853: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ac18633d-39a6-4287-b244-57ae3fda6b6a] succeeded in 1.576705464999577s: None 2024-05-25T00:49:03.018794125Z [2024-05-25 00:49:03,018: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:49:03.022425127Z [2024-05-25 00:49:03,021: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:49:03.039329843Z [2024-05-25 00:49:03,039: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:49:03.040443397Z [2024-05-25 00:49:03,040: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:49:03.040510233Z [2024-05-25 00:49:03,040: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:49:03.040672623Z [2024-05-25 00:49:03,040: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:49:03.040726723Z [2024-05-25 00:49:03,040: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:49:03.041014258Z [2024-05-25 00:49:03,040: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:49:03.041452453Z [2024-05-25 00:49:03,041: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:49:03.093198040Z [2024-05-25 00:49:03,092: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:49:03.096539244Z [2024-05-25 00:49:03,095: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:49:03.129375316Z [2024-05-25 00:49:03,129: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:49:03.130601480Z [2024-05-25 00:49:03,130: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:49:03.130613779Z [2024-05-25 00:49:03,130: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:49:03.130708294Z [2024-05-25 00:49:03,130: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:49:03.130782784Z [2024-05-25 00:49:03,130: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:49:03.131046672Z [2024-05-25 00:49:03,130: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:49:03.131053526Z [2024-05-25 00:49:03,130: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:49:03.144372748Z [2024-05-25 00:49:03,144: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:49:03.204844982Z [2024-05-25 00:49:03,204: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:49:05.521673271Z [2024-05-25 00:49:05,520: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[10773648-1f00-4fd7-9a56-474c24b2cba9] succeeded in 4.248335719999886s: None 2024-05-25T00:49:05.909079915Z [2024-05-25 00:49:05,908: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a90476ea-6545-4224-8395-70fb9f093f9c] succeeded in 4.6436045880000165s: None 2024-05-25T00:50:00.453758206Z [2024-05-25 00:50:00,453: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0efa30fc-c64b-489d-bd8d-0138650106a2] received 2024-05-25T00:50:00.458827311Z [2024-05-25 00:50:00,458: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc6452ef-ff2c-4707-975a-b873cb378c97] received 2024-05-25T00:50:00.462422981Z [2024-05-25 00:50:00,462: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[287b5577-df39-466b-bf08-7ac5acd1952d] received 2024-05-25T00:50:00.464336616Z [2024-05-25 00:50:00,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[303591f9-2b86-4ad4-8161-d9a11d4c2071] received 2024-05-25T00:50:00.474158257Z [2024-05-25 00:50:00,473: INFO/ForkPoolWorker-15] [0efa30fc-c64b-489d-bd8d-0138650106a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:50:00.474580793Z [2024-05-25 00:50:00,474: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c5db3f0-ff79-472b-9c6b-c60656995fbe] received 2024-05-25T00:50:00.497986607Z [2024-05-25 00:50:00,497: INFO/ForkPoolWorker-1] [287b5577-df39-466b-bf08-7ac5acd1952d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:50:00.498875436Z [2024-05-25 00:50:00,498: INFO/ForkPoolWorker-16] [dc6452ef-ff2c-4707-975a-b873cb378c97] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:50:00.510107714Z [2024-05-25 00:50:00,509: INFO/ForkPoolWorker-2] [303591f9-2b86-4ad4-8161-d9a11d4c2071] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:50:00.519102406Z [2024-05-25 00:50:00,518: INFO/ForkPoolWorker-3] [0c5db3f0-ff79-472b-9c6b-c60656995fbe] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:50:00.840583452Z [2024-05-25 00:50:00,836: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:50:00.885967890Z [2024-05-25 00:50:00,873: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:50:00.935749720Z [2024-05-25 00:50:00,932: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:50:01.222554781Z [2024-05-25 00:50:01,187: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:50:01.248719004Z [2024-05-25 00:50:01,230: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:50:01.354792584Z [2024-05-25 00:50:01,354: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:50:01.553849025Z [2024-05-25 00:50:01,553: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T00:50:01.558051029Z [2024-05-25 00:50:01,557: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:50:01.592411594Z [2024-05-25 00:50:01,592: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:50:01.595315743Z [2024-05-25 00:50:01,595: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:50:01.595612483Z [2024-05-25 00:50:01,595: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:50:01.595831739Z [2024-05-25 00:50:01,595: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T00:50:01.596202519Z [2024-05-25 00:50:01,596: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:50:01.744744157Z [2024-05-25 00:50:01,744: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:50:01.986516168Z [2024-05-25 00:50:01,986: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[0c5db3f0-ff79-472b-9c6b-c60656995fbe] succeeded in 1.508571241000027s: None 2024-05-25T00:50:02.508338078Z [2024-05-25 00:50:02,508: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:50:02.512079956Z [2024-05-25 00:50:02,511: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:50:02.542121745Z [2024-05-25 00:50:02,541: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dc6452ef-ff2c-4707-975a-b873cb378c97] succeeded in 2.0813560100004906s: None 2024-05-25T00:50:02.555396593Z [2024-05-25 00:50:02,555: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:50:02.558049891Z [2024-05-25 00:50:02,557: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:50:02.558062441Z [2024-05-25 00:50:02,557: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:50:02.558155206Z [2024-05-25 00:50:02,558: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:50:02.558196399Z [2024-05-25 00:50:02,558: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:50:02.558448923Z [2024-05-25 00:50:02,558: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:50:02.558484619Z [2024-05-25 00:50:02,558: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:50:02.580959806Z [2024-05-25 00:50:02,580: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T00:50:02.584804930Z [2024-05-25 00:50:02,584: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:50:02.630596829Z [2024-05-25 00:50:02,630: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:50:02.631871266Z [2024-05-25 00:50:02,631: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:50:02.631908423Z [2024-05-25 00:50:02,631: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:50:02.632053921Z [2024-05-25 00:50:02,631: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:50:02.632096617Z [2024-05-25 00:50:02,632: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T00:50:02.632299523Z [2024-05-25 00:50:02,632: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:50:02.632336319Z [2024-05-25 00:50:02,632: INFO/ForkPoolWorker-2] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:50:02.670928400Z [2024-05-25 00:50:02,670: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:50:02.711627082Z [2024-05-25 00:50:02,711: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:50:03.066044576Z [2024-05-25 00:50:03,065: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:50:03.069614665Z [2024-05-25 00:50:03,069: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:50:03.099106837Z [2024-05-25 00:50:03,098: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:50:03.100240348Z [2024-05-25 00:50:03,100: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:50:03.100255075Z [2024-05-25 00:50:03,100: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:50:03.100338170Z [2024-05-25 00:50:03,100: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:50:03.100378522Z [2024-05-25 00:50:03,100: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:50:03.100583809Z [2024-05-25 00:50:03,100: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:50:03.100616514Z [2024-05-25 00:50:03,100: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:50:03.196463765Z [2024-05-25 00:50:03,196: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:50:03.313863696Z [2024-05-25 00:50:03,313: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[287b5577-df39-466b-bf08-7ac5acd1952d] succeeded in 2.8331958250000753s: None 2024-05-25T00:50:03.422154722Z [2024-05-25 00:50:03,421: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70216b3f-440c-4814-b4eb-253f41fbafa1] received 2024-05-25T00:50:03.432538727Z [2024-05-25 00:50:03,432: INFO/ForkPoolWorker-16] [70216b3f-440c-4814-b4eb-253f41fbafa1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:50:03.705909726Z [2024-05-25 00:50:03,702: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:50:04.317975464Z [2024-05-25 00:50:04,317: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[303591f9-2b86-4ad4-8161-d9a11d4c2071] succeeded in 3.850473508000505s: None 2024-05-25T00:50:04.912228431Z [2024-05-25 00:50:04,911: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:50:04.916192276Z [2024-05-25 00:50:04,915: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:50:04.944330193Z [2024-05-25 00:50:04,944: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:50:04.946639316Z [2024-05-25 00:50:04,946: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:50:04.946819799Z [2024-05-25 00:50:04,946: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:50:04.947095104Z [2024-05-25 00:50:04,946: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:50:04.947250961Z [2024-05-25 00:50:04,947: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:50:04.948187935Z [2024-05-25 00:50:04,947: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:50:04.948388836Z [2024-05-25 00:50:04,948: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:50:05.042503795Z [2024-05-25 00:50:05,040: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:50:05.213702987Z [2024-05-25 00:50:05,213: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0efa30fc-c64b-489d-bd8d-0138650106a2] succeeded in 4.758193165000193s: None 2024-05-25T00:50:05.733591202Z [2024-05-25 00:50:05,733: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[70216b3f-440c-4814-b4eb-253f41fbafa1] succeeded in 2.30935436999971s: None 2024-05-25T00:50:05.903328073Z [2024-05-25 00:50:05,902: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1344e3fe-3a00-47aa-af04-1f4a01a1bf82] received 2024-05-25T00:50:05.913976890Z [2024-05-25 00:50:05,913: INFO/ForkPoolWorker-15] [1344e3fe-3a00-47aa-af04-1f4a01a1bf82] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T00:50:06.182577659Z [2024-05-25 00:50:06,179: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:50:07.412187250Z [2024-05-25 00:50:07,411: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:50:07.415484789Z [2024-05-25 00:50:07,415: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:50:07.439606608Z [2024-05-25 00:50:07,439: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:50:07.440980164Z [2024-05-25 00:50:07,440: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:50:07.441147818Z [2024-05-25 00:50:07,440: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:50:07.441397931Z [2024-05-25 00:50:07,441: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:50:07.441538268Z [2024-05-25 00:50:07,441: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:50:07.441911779Z [2024-05-25 00:50:07,441: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:50:07.442056221Z [2024-05-25 00:50:07,441: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:50:07.538190544Z [2024-05-25 00:50:07,537: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:50:08.090962529Z [2024-05-25 00:50:08,090: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1344e3fe-3a00-47aa-af04-1f4a01a1bf82] succeeded in 2.1857772789999217s: None 2024-05-25T00:50:08.271448166Z [2024-05-25 00:50:08,271: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a59a9fa-2130-435a-a605-81ba7b92f8cb] received 2024-05-25T00:50:08.278133459Z [2024-05-25 00:50:08,277: INFO/ForkPoolWorker-15] [4a59a9fa-2130-435a-a605-81ba7b92f8cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:50:08.640325843Z [2024-05-25 00:50:08,637: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:50:09.740206653Z [2024-05-25 00:50:09,739: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:50:09.743421968Z [2024-05-25 00:50:09,742: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:50:09.764982554Z [2024-05-25 00:50:09,764: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:50:09.766836546Z [2024-05-25 00:50:09,766: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:50:09.767020697Z [2024-05-25 00:50:09,766: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:50:09.767180392Z [2024-05-25 00:50:09,766: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:50:09.767205077Z [2024-05-25 00:50:09,767: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:50:09.767778467Z [2024-05-25 00:50:09,767: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:50:09.767788527Z [2024-05-25 00:50:09,767: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:50:09.878420689Z [2024-05-25 00:50:09,877: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:50:10.513923972Z [2024-05-25 00:50:10,512: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4a59a9fa-2130-435a-a605-81ba7b92f8cb] succeeded in 2.2400959060005334s: None 2024-05-25T00:51:00.320777034Z [2024-05-25 00:51:00,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7d82d5b-ebd1-41c5-b696-fb5cf974dce7] received 2024-05-25T00:51:00.332082960Z [2024-05-25 00:51:00,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69434984-24fb-4522-9280-059e3fc3d0b4] received 2024-05-25T00:51:00.341684446Z [2024-05-25 00:51:00,341: INFO/ForkPoolWorker-15] [c7d82d5b-ebd1-41c5-b696-fb5cf974dce7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:51:00.349866736Z [2024-05-25 00:51:00,349: INFO/ForkPoolWorker-16] [69434984-24fb-4522-9280-059e3fc3d0b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:51:00.364617595Z [2024-05-25 00:51:00,364: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ddb5cd15-63fc-4c4e-8c75-858752e18a6b] received 2024-05-25T00:51:00.398796621Z [2024-05-25 00:51:00,398: INFO/ForkPoolWorker-1] [ddb5cd15-63fc-4c4e-8c75-858752e18a6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:51:00.666197978Z [2024-05-25 00:51:00,663: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:51:00.747074811Z [2024-05-25 00:51:00,744: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:51:00.836984509Z [2024-05-25 00:51:00,833: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:51:00.988845475Z [2024-05-25 00:51:00,988: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T00:51:00.993338950Z [2024-05-25 00:51:00,992: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:51:01.036317484Z [2024-05-25 00:51:01,036: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:51:01.037478978Z [2024-05-25 00:51:01,037: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:51:01.037777714Z [2024-05-25 00:51:01,037: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:51:01.037946627Z [2024-05-25 00:51:01,037: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T00:51:01.038246383Z [2024-05-25 00:51:01,038: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:51:01.156458872Z [2024-05-25 00:51:01,156: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:51:01.795639964Z [2024-05-25 00:51:01,795: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ddb5cd15-63fc-4c4e-8c75-858752e18a6b] succeeded in 1.4248792669995964s: None 2024-05-25T00:51:01.881931766Z [2024-05-25 00:51:01,881: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:51:01.885123113Z [2024-05-25 00:51:01,884: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:51:01.902822426Z [2024-05-25 00:51:01,902: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:51:01.904326620Z [2024-05-25 00:51:01,904: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:51:01.904360143Z [2024-05-25 00:51:01,904: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:51:01.904501587Z [2024-05-25 00:51:01,904: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:51:01.904552934Z [2024-05-25 00:51:01,904: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:51:01.904804734Z [2024-05-25 00:51:01,904: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:51:01.904851147Z [2024-05-25 00:51:01,904: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:51:01.981748058Z [2024-05-25 00:51:01,981: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:51:02.063062054Z [2024-05-25 00:51:02,062: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:51:02.066875513Z [2024-05-25 00:51:02,066: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:51:02.102140805Z [2024-05-25 00:51:02,101: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:51:02.103830206Z [2024-05-25 00:51:02,103: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:51:02.103864924Z [2024-05-25 00:51:02,103: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:51:02.103951206Z [2024-05-25 00:51:02,103: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:51:02.104016073Z [2024-05-25 00:51:02,103: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:51:02.104265528Z [2024-05-25 00:51:02,104: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:51:02.104289136Z [2024-05-25 00:51:02,104: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:51:02.244980877Z [2024-05-25 00:51:02,235: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:51:03.543719723Z [2024-05-25 00:51:03,543: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[69434984-24fb-4522-9280-059e3fc3d0b4] succeeded in 3.2076796150004157s: None 2024-05-25T00:51:04.934391629Z [2024-05-25 00:51:04,933: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c7d82d5b-ebd1-41c5-b696-fb5cf974dce7] succeeded in 4.607394757999828s: None 2024-05-25T00:52:00.286653853Z [2024-05-25 00:52:00,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6b3eb1a-5439-4788-aa8c-6675763332c0] received 2024-05-25T00:52:00.291283898Z [2024-05-25 00:52:00,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4b022f3-20f5-40c0-b031-bdd050bf9a30] received 2024-05-25T00:52:00.293294834Z [2024-05-25 00:52:00,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1f29d53-382b-4052-8668-0b2ddb29fe62] received 2024-05-25T00:52:00.294651857Z [2024-05-25 00:52:00,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[775f759a-8c90-416f-8dc0-d6848b763cc6] received 2024-05-25T00:52:00.306785638Z [2024-05-25 00:52:00,306: INFO/ForkPoolWorker-15] [f6b3eb1a-5439-4788-aa8c-6675763332c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:52:00.308057684Z [2024-05-25 00:52:00,306: INFO/ForkPoolWorker-2] [775f759a-8c90-416f-8dc0-d6848b763cc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:52:00.308805531Z [2024-05-25 00:52:00,308: INFO/ForkPoolWorker-1] [a1f29d53-382b-4052-8668-0b2ddb29fe62] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:52:00.319176816Z [2024-05-25 00:52:00,318: INFO/ForkPoolWorker-16] [b4b022f3-20f5-40c0-b031-bdd050bf9a30] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:52:00.648838163Z [2024-05-25 00:52:00,645: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:52:00.666334214Z [2024-05-25 00:52:00,663: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:52:00.679005932Z [2024-05-25 00:52:00,676: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:52:00.782668746Z [2024-05-25 00:52:00,775: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:52:00.907926904Z [2024-05-25 00:52:00,907: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T00:52:00.912394295Z [2024-05-25 00:52:00,912: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:52:00.950721984Z [2024-05-25 00:52:00,950: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:52:00.951923590Z [2024-05-25 00:52:00,951: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:52:00.952425005Z [2024-05-25 00:52:00,952: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:52:00.952612816Z [2024-05-25 00:52:00,952: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T00:52:00.953338949Z [2024-05-25 00:52:00,953: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:52:01.060454722Z [2024-05-25 00:52:01,060: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:52:01.105012464Z [2024-05-25 00:52:01,104: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:52:01.640457819Z [2024-05-25 00:52:01,640: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b4b022f3-20f5-40c0-b031-bdd050bf9a30] succeeded in 1.3455726679994768s: None 2024-05-25T00:52:01.687757646Z [2024-05-25 00:52:01,687: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a1f29d53-382b-4052-8668-0b2ddb29fe62] succeeded in 1.392010224999467s: None 2024-05-25T00:52:01.947855151Z [2024-05-25 00:52:01,947: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T00:52:01.951750533Z [2024-05-25 00:52:01,951: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:52:01.977444864Z [2024-05-25 00:52:01,977: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:52:01.979251385Z [2024-05-25 00:52:01,978: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:52:01.979500621Z [2024-05-25 00:52:01,979: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:52:01.979838116Z [2024-05-25 00:52:01,979: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:52:01.980149881Z [2024-05-25 00:52:01,979: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T00:52:01.980719877Z [2024-05-25 00:52:01,980: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:52:01.981014522Z [2024-05-25 00:52:01,980: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:52:02.078880498Z [2024-05-25 00:52:02,078: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:52:02.090022885Z [2024-05-25 00:52:02,089: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:52:02.093202322Z [2024-05-25 00:52:02,092: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:52:02.135855763Z [2024-05-25 00:52:02,135: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:52:02.137346520Z [2024-05-25 00:52:02,137: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:52:02.137392823Z [2024-05-25 00:52:02,137: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:52:02.137495159Z [2024-05-25 00:52:02,137: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:52:02.137567407Z [2024-05-25 00:52:02,137: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:52:02.138067276Z [2024-05-25 00:52:02,137: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:52:02.138216561Z [2024-05-25 00:52:02,138: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:52:02.234793416Z [2024-05-25 00:52:02,234: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:52:03.793804177Z [2024-05-25 00:52:03,793: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f6b3eb1a-5439-4788-aa8c-6675763332c0] succeeded in 3.5024722269999984s: None 2024-05-25T00:52:04.022281865Z [2024-05-25 00:52:04,021: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[775f759a-8c90-416f-8dc0-d6848b763cc6] succeeded in 3.723135043000184s: None 2024-05-25T00:53:00.271773410Z [2024-05-25 00:53:00,271: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d48c64a9-0729-4c88-8ffd-1747a11e727d] received 2024-05-25T00:53:00.288666340Z [2024-05-25 00:53:00,288: INFO/ForkPoolWorker-15] [d48c64a9-0729-4c88-8ffd-1747a11e727d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:53:00.289766437Z [2024-05-25 00:53:00,289: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[254768c5-0759-4d35-b606-4a418d0aa8bd] received 2024-05-25T00:53:00.291720289Z [2024-05-25 00:53:00,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[400d0fe5-ee58-4f9b-af9b-fc6a12f3778b] received 2024-05-25T00:53:00.303059187Z [2024-05-25 00:53:00,302: INFO/ForkPoolWorker-16] [254768c5-0759-4d35-b606-4a418d0aa8bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:53:00.306799192Z [2024-05-25 00:53:00,306: INFO/ForkPoolWorker-1] [400d0fe5-ee58-4f9b-af9b-fc6a12f3778b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:53:00.608150217Z [2024-05-25 00:53:00,604: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:53:00.630429631Z [2024-05-25 00:53:00,627: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:53:00.682162089Z [2024-05-25 00:53:00,678: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:53:00.769860164Z [2024-05-25 00:53:00,769: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T00:53:00.773835364Z [2024-05-25 00:53:00,773: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:53:00.798888014Z [2024-05-25 00:53:00,798: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:53:00.799995324Z [2024-05-25 00:53:00,799: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:53:00.800081711Z [2024-05-25 00:53:00,799: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:53:00.800130772Z [2024-05-25 00:53:00,800: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T00:53:00.800362343Z [2024-05-25 00:53:00,800: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:53:00.911790572Z [2024-05-25 00:53:00,911: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:53:01.454664701Z [2024-05-25 00:53:01,454: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[400d0fe5-ee58-4f9b-af9b-fc6a12f3778b] succeeded in 1.160863303000042s: None 2024-05-25T00:53:01.843518718Z [2024-05-25 00:53:01,843: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:53:01.846972725Z [2024-05-25 00:53:01,846: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:53:01.865063265Z [2024-05-25 00:53:01,864: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:53:01.867076538Z [2024-05-25 00:53:01,866: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:53:01.867176935Z [2024-05-25 00:53:01,866: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:53:01.867188277Z [2024-05-25 00:53:01,866: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:53:01.867272037Z [2024-05-25 00:53:01,866: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:53:01.867283580Z [2024-05-25 00:53:01,866: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:53:01.867363489Z [2024-05-25 00:53:01,866: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:53:01.869631441Z [2024-05-25 00:53:01,869: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:53:01.873006737Z [2024-05-25 00:53:01,872: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:53:01.897619789Z [2024-05-25 00:53:01,894: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:53:01.897634787Z [2024-05-25 00:53:01,895: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:53:01.897639054Z [2024-05-25 00:53:01,895: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:53:01.897643567Z [2024-05-25 00:53:01,895: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:53:01.897647717Z [2024-05-25 00:53:01,895: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:53:01.897666300Z [2024-05-25 00:53:01,895: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:53:01.897669874Z [2024-05-25 00:53:01,895: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:53:01.977331065Z [2024-05-25 00:53:01,976: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:53:01.998086287Z [2024-05-25 00:53:01,997: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:53:03.552516978Z [2024-05-25 00:53:03,551: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[254768c5-0759-4d35-b606-4a418d0aa8bd] succeeded in 3.260072840000248s: None 2024-05-25T00:53:03.904650160Z [2024-05-25 00:53:03,903: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d48c64a9-0729-4c88-8ffd-1747a11e727d] succeeded in 3.630114618999869s: None 2024-05-25T00:54:00.319060762Z [2024-05-25 00:54:00,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d8598c8-680b-49e3-882c-708cf1fb7164] received 2024-05-25T00:54:00.321696520Z [2024-05-25 00:54:00,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a27169f-8055-4be8-b5d2-1954fac0e5cb] received 2024-05-25T00:54:00.326800447Z [2024-05-25 00:54:00,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a5cd13f-3845-4f8e-a8da-13ceab216523] received 2024-05-25T00:54:00.333986029Z [2024-05-25 00:54:00,333: INFO/ForkPoolWorker-16] [8a27169f-8055-4be8-b5d2-1954fac0e5cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:54:00.338228977Z [2024-05-25 00:54:00,338: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e1a596b2-5d3c-460e-8215-16892ca90d10] received 2024-05-25T00:54:00.339617616Z [2024-05-25 00:54:00,339: INFO/ForkPoolWorker-1] [6a5cd13f-3845-4f8e-a8da-13ceab216523] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:54:00.342116101Z [2024-05-25 00:54:00,341: INFO/ForkPoolWorker-15] [0d8598c8-680b-49e3-882c-708cf1fb7164] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:54:00.350336984Z [2024-05-25 00:54:00,349: INFO/ForkPoolWorker-2] [e1a596b2-5d3c-460e-8215-16892ca90d10] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:54:00.697360424Z [2024-05-25 00:54:00,694: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:54:00.723654782Z [2024-05-25 00:54:00,719: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:54:00.729313525Z [2024-05-25 00:54:00,726: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:54:00.741569388Z [2024-05-25 00:54:00,704: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:54:00.866207523Z [2024-05-25 00:54:00,865: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T00:54:00.870127925Z [2024-05-25 00:54:00,869: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:54:00.910832195Z [2024-05-25 00:54:00,910: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:54:00.913620394Z [2024-05-25 00:54:00,913: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:54:00.913761530Z [2024-05-25 00:54:00,913: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:54:00.913806913Z [2024-05-25 00:54:00,913: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T00:54:00.914083308Z [2024-05-25 00:54:00,913: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:54:01.059022342Z [2024-05-25 00:54:01,058: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:54:01.118723879Z [2024-05-25 00:54:01,118: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:54:01.761143658Z [2024-05-25 00:54:01,760: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e1a596b2-5d3c-460e-8215-16892ca90d10] succeeded in 1.420053168000777s: None 2024-05-25T00:54:01.763331439Z [2024-05-25 00:54:01,762: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0d8598c8-680b-49e3-882c-708cf1fb7164] succeeded in 1.442078957999911s: None 2024-05-25T00:54:01.958121608Z [2024-05-25 00:54:01,957: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:54:01.961360788Z [2024-05-25 00:54:01,960: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:54:01.995399045Z [2024-05-25 00:54:01,995: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:54:01.997435522Z [2024-05-25 00:54:01,997: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:54:01.997471452Z [2024-05-25 00:54:01,997: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:54:01.997510391Z [2024-05-25 00:54:01,997: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:54:01.997606150Z [2024-05-25 00:54:01,997: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:54:01.997900658Z [2024-05-25 00:54:01,997: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:54:01.997918325Z [2024-05-25 00:54:01,997: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:54:02.090534636Z [2024-05-25 00:54:02,090: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:54:02.151867458Z [2024-05-25 00:54:02,151: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:54:02.155277705Z [2024-05-25 00:54:02,154: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:54:02.185007079Z [2024-05-25 00:54:02,184: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:54:02.186514746Z [2024-05-25 00:54:02,186: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:54:02.186540082Z [2024-05-25 00:54:02,186: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:54:02.186548908Z [2024-05-25 00:54:02,186: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:54:02.186558567Z [2024-05-25 00:54:02,186: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:54:02.186748222Z [2024-05-25 00:54:02,186: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:54:02.186762506Z [2024-05-25 00:54:02,186: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:54:02.294353621Z [2024-05-25 00:54:02,294: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:54:03.670609399Z [2024-05-25 00:54:03,670: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6a5cd13f-3845-4f8e-a8da-13ceab216523] succeeded in 3.3393848020004953s: None 2024-05-25T00:54:04.208723754Z [2024-05-25 00:54:04,208: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8a27169f-8055-4be8-b5d2-1954fac0e5cb] succeeded in 3.8854056039999705s: None 2024-05-25T00:55:01.069439849Z [2024-05-25 00:55:01,068: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7986ebf-629c-4492-909d-034ea0eee7c1] received 2024-05-25T00:55:01.071162467Z [2024-05-25 00:55:01,070: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf87f638-51b2-4fa2-8867-6d1eff2bca9c] received 2024-05-25T00:55:01.081324589Z [2024-05-25 00:55:01,080: INFO/ForkPoolWorker-15] [e7986ebf-629c-4492-909d-034ea0eee7c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:55:01.081826332Z [2024-05-25 00:55:01,081: INFO/ForkPoolWorker-16] [cf87f638-51b2-4fa2-8867-6d1eff2bca9c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:55:01.086914796Z [2024-05-25 00:55:01,086: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4336638-db47-45fd-bca7-3465380252c9] received 2024-05-25T00:55:01.089827831Z [2024-05-25 00:55:01,089: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b456487-0800-4c3d-a365-632feb8ddb63] received 2024-05-25T00:55:01.098618023Z [2024-05-25 00:55:01,098: INFO/ForkPoolWorker-2] [0b456487-0800-4c3d-a365-632feb8ddb63] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:55:01.109668237Z [2024-05-25 00:55:01,109: INFO/ForkPoolWorker-1] [e4336638-db47-45fd-bca7-3465380252c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:55:01.402572371Z [2024-05-25 00:55:01,394: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:55:01.412042136Z [2024-05-25 00:55:01,408: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:55:01.419189885Z [2024-05-25 00:55:01,414: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:55:01.508685700Z [2024-05-25 00:55:01,505: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:55:01.717522451Z [2024-05-25 00:55:01,716: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T00:55:01.722628055Z [2024-05-25 00:55:01,722: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:55:01.756291134Z [2024-05-25 00:55:01,756: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:55:01.758024384Z [2024-05-25 00:55:01,757: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:55:01.758345018Z [2024-05-25 00:55:01,758: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:55:01.758576161Z [2024-05-25 00:55:01,758: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T00:55:01.758941669Z [2024-05-25 00:55:01,758: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:55:01.842766403Z [2024-05-25 00:55:01,842: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:55:02.516266532Z [2024-05-25 00:55:02,515: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0b456487-0800-4c3d-a365-632feb8ddb63] succeeded in 1.4242737000004126s: None 2024-05-25T00:55:02.800382009Z [2024-05-25 00:55:02,800: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:55:02.803751319Z [2024-05-25 00:55:02,803: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:55:02.837160569Z [2024-05-25 00:55:02,836: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:55:02.838679454Z [2024-05-25 00:55:02,838: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:55:02.838729081Z [2024-05-25 00:55:02,838: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:55:02.838913222Z [2024-05-25 00:55:02,838: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:55:02.838973937Z [2024-05-25 00:55:02,838: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:55:02.839950967Z [2024-05-25 00:55:02,839: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:55:02.840019327Z [2024-05-25 00:55:02,839: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:55:02.852514950Z [2024-05-25 00:55:02,852: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:55:02.856455832Z [2024-05-25 00:55:02,856: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:55:02.865361290Z [2024-05-25 00:55:02,864: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:55:02.869633342Z [2024-05-25 00:55:02,868: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:55:02.888163443Z [2024-05-25 00:55:02,887: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:55:02.889502178Z [2024-05-25 00:55:02,889: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:55:02.889514144Z [2024-05-25 00:55:02,889: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:55:02.889522840Z [2024-05-25 00:55:02,889: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:55:02.889658799Z [2024-05-25 00:55:02,889: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:55:02.889676566Z [2024-05-25 00:55:02,889: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:55:02.889904968Z [2024-05-25 00:55:02,889: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:55:02.889918579Z [2024-05-25 00:55:02,889: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:55:02.890820617Z [2024-05-25 00:55:02,890: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:55:02.891035033Z [2024-05-25 00:55:02,890: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:55:02.891218666Z [2024-05-25 00:55:02,890: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:55:02.891332860Z [2024-05-25 00:55:02,891: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:55:02.891609535Z [2024-05-25 00:55:02,891: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:55:02.892085750Z [2024-05-25 00:55:02,891: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:55:02.956995211Z [2024-05-25 00:55:02,956: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:55:02.988904962Z [2024-05-25 00:55:02,988: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:55:02.995942786Z [2024-05-25 00:55:02,995: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:55:03.636858639Z [2024-05-25 00:55:03,636: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e7986ebf-629c-4492-909d-034ea0eee7c1] succeeded in 2.56409653099945s: None 2024-05-25T00:55:03.999823551Z [2024-05-25 00:55:03,998: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85d9b7cf-f128-466c-b9f7-2cd02731c8d1] received 2024-05-25T00:55:04.024704051Z [2024-05-25 00:55:04,024: INFO/ForkPoolWorker-15] [85d9b7cf-f128-466c-b9f7-2cd02731c8d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:55:04.330609058Z [2024-05-25 00:55:04,327: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:55:04.678992383Z [2024-05-25 00:55:04,678: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e4336638-db47-45fd-bca7-3465380252c9] succeeded in 3.587294921000648s: None 2024-05-25T00:55:05.005616910Z [2024-05-25 00:55:05,005: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cf87f638-51b2-4fa2-8867-6d1eff2bca9c] succeeded in 3.9312252979998448s: None 2024-05-25T00:55:05.505732094Z [2024-05-25 00:55:05,505: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:55:05.509127285Z [2024-05-25 00:55:05,508: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:55:05.527699436Z [2024-05-25 00:55:05,527: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:55:05.528998117Z [2024-05-25 00:55:05,528: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:55:05.529013147Z [2024-05-25 00:55:05,528: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:55:05.529192354Z [2024-05-25 00:55:05,528: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:55:05.529254091Z [2024-05-25 00:55:05,529: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:55:05.529636497Z [2024-05-25 00:55:05,529: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:55:05.529743651Z [2024-05-25 00:55:05,529: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:55:05.623698312Z [2024-05-25 00:55:05,623: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:55:06.356602843Z [2024-05-25 00:55:06,356: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[85d9b7cf-f128-466c-b9f7-2cd02731c8d1] succeeded in 2.344513972000641s: None 2024-05-25T00:55:06.803699284Z [2024-05-25 00:55:06,803: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74ea95dd-9199-4a0b-9ec2-8fd6442727e7] received 2024-05-25T00:55:06.813144796Z [2024-05-25 00:55:06,812: INFO/ForkPoolWorker-15] [74ea95dd-9199-4a0b-9ec2-8fd6442727e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T00:55:07.096888933Z [2024-05-25 00:55:07,093: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:55:08.389197349Z [2024-05-25 00:55:08,387: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:55:08.392983502Z [2024-05-25 00:55:08,392: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:55:08.427964441Z [2024-05-25 00:55:08,427: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:55:08.430274740Z [2024-05-25 00:55:08,430: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:55:08.430292359Z [2024-05-25 00:55:08,430: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:55:08.430431380Z [2024-05-25 00:55:08,430: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:55:08.430445291Z [2024-05-25 00:55:08,430: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:55:08.430688637Z [2024-05-25 00:55:08,430: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:55:08.430700927Z [2024-05-25 00:55:08,430: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:55:08.540962458Z [2024-05-25 00:55:08,540: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:55:09.141179060Z [2024-05-25 00:55:09,140: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[74ea95dd-9199-4a0b-9ec2-8fd6442727e7] succeeded in 2.3339832620004017s: None 2024-05-25T00:55:09.165082353Z [2024-05-25 00:55:09,164: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d79db44-113a-41df-ae77-6d2d75198747] received 2024-05-25T00:55:09.175789935Z [2024-05-25 00:55:09,175: INFO/ForkPoolWorker-15] [3d79db44-113a-41df-ae77-6d2d75198747] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T00:55:09.447956765Z [2024-05-25 00:55:09,444: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T00:55:10.514495650Z [2024-05-25 00:55:10,513: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:55:10.517761445Z [2024-05-25 00:55:10,517: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:55:10.538327541Z [2024-05-25 00:55:10,538: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:55:10.539933506Z [2024-05-25 00:55:10,539: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:55:10.540140701Z [2024-05-25 00:55:10,539: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:55:10.540404702Z [2024-05-25 00:55:10,540: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:55:10.540571291Z [2024-05-25 00:55:10,540: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:55:10.542341725Z [2024-05-25 00:55:10,542: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T00:55:10.542555860Z [2024-05-25 00:55:10,542: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:55:10.631235014Z [2024-05-25 00:55:10,630: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:55:11.261692420Z [2024-05-25 00:55:11,260: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3d79db44-113a-41df-ae77-6d2d75198747] succeeded in 2.0946680320002997s: None 2024-05-25T00:56:01.070137933Z [2024-05-25 00:56:01,069: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19b9dd1e-78aa-4d30-9e38-af2c4ee459c6] received 2024-05-25T00:56:01.074736287Z [2024-05-25 00:56:01,074: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3287270b-0119-4abc-b5b2-22f22b9ddd05] received 2024-05-25T00:56:01.081626301Z [2024-05-25 00:56:01,081: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c90618d0-5644-490e-a173-19306d6c200f] received 2024-05-25T00:56:01.089156082Z [2024-05-25 00:56:01,088: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e19c07e-0551-4ae0-aac6-1827760a6664] received 2024-05-25T00:56:01.090507992Z [2024-05-25 00:56:01,089: INFO/ForkPoolWorker-15] [19b9dd1e-78aa-4d30-9e38-af2c4ee459c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:56:01.090967297Z [2024-05-25 00:56:01,090: INFO/ForkPoolWorker-16] [3287270b-0119-4abc-b5b2-22f22b9ddd05] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:56:01.092707069Z [2024-05-25 00:56:01,092: INFO/ForkPoolWorker-1] [c90618d0-5644-490e-a173-19306d6c200f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:56:01.100460997Z [2024-05-25 00:56:01,100: INFO/ForkPoolWorker-2] [3e19c07e-0551-4ae0-aac6-1827760a6664] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:56:01.406558919Z [2024-05-25 00:56:01,402: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:56:01.459289335Z [2024-05-25 00:56:01,455: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:56:01.472546945Z [2024-05-25 00:56:01,464: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:56:01.494913772Z [2024-05-25 00:56:01,487: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:56:01.678717012Z [2024-05-25 00:56:01,678: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T00:56:01.692851569Z [2024-05-25 00:56:01,691: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:56:01.732744070Z [2024-05-25 00:56:01,732: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:56:01.733899059Z [2024-05-25 00:56:01,733: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:56:01.734123234Z [2024-05-25 00:56:01,733: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:56:01.734283585Z [2024-05-25 00:56:01,734: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T00:56:01.734589397Z [2024-05-25 00:56:01,734: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:56:01.835682745Z [2024-05-25 00:56:01,835: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:56:01.938122365Z [2024-05-25 00:56:01,937: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:56:02.823936873Z [2024-05-25 00:56:02,823: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c90618d0-5644-490e-a173-19306d6c200f] succeeded in 1.7377397720001682s: None 2024-05-25T00:56:02.910186241Z [2024-05-25 00:56:02,909: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3287270b-0119-4abc-b5b2-22f22b9ddd05] succeeded in 1.833330161000049s: None 2024-05-25T00:56:03.083158026Z [2024-05-25 00:56:03,082: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T00:56:03.086654018Z [2024-05-25 00:56:03,086: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:56:03.109618845Z [2024-05-25 00:56:03,109: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:56:03.110717326Z [2024-05-25 00:56:03,110: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:56:03.110734182Z [2024-05-25 00:56:03,110: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:56:03.110889052Z [2024-05-25 00:56:03,110: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:56:03.110938609Z [2024-05-25 00:56:03,110: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T00:56:03.111160539Z [2024-05-25 00:56:03,111: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:56:03.111196471Z [2024-05-25 00:56:03,111: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:56:03.215841882Z [2024-05-25 00:56:03,215: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:56:03.238284642Z [2024-05-25 00:56:03,237: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:56:03.242310218Z [2024-05-25 00:56:03,241: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:56:03.262118984Z [2024-05-25 00:56:03,261: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:56:03.263157948Z [2024-05-25 00:56:03,262: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:56:03.263203834Z [2024-05-25 00:56:03,263: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:56:03.263385873Z [2024-05-25 00:56:03,263: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:56:03.263434050Z [2024-05-25 00:56:03,263: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:56:03.263695126Z [2024-05-25 00:56:03,263: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:56:03.263727287Z [2024-05-25 00:56:03,263: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:56:03.350651518Z [2024-05-25 00:56:03,350: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:56:04.916211384Z [2024-05-25 00:56:04,915: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[19b9dd1e-78aa-4d30-9e38-af2c4ee459c6] succeeded in 3.843462384000304s: None 2024-05-25T00:56:05.512465877Z [2024-05-25 00:56:05,511: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3e19c07e-0551-4ae0-aac6-1827760a6664] succeeded in 4.4171278429994345s: None 2024-05-25T00:57:01.027134199Z [2024-05-25 00:57:01,026: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2455e521-53fa-4104-9c1d-268169be5f1b] received 2024-05-25T00:57:01.034886974Z [2024-05-25 00:57:01,034: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a56b820-c220-468a-aef4-bf3e7e543aea] received 2024-05-25T00:57:01.039752738Z [2024-05-25 00:57:01,039: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[390eac32-ff91-4aab-8581-66ee2c52b886] received 2024-05-25T00:57:01.044966443Z [2024-05-25 00:57:01,044: INFO/ForkPoolWorker-15] [2455e521-53fa-4104-9c1d-268169be5f1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:57:01.062697619Z [2024-05-25 00:57:01,062: INFO/ForkPoolWorker-16] [1a56b820-c220-468a-aef4-bf3e7e543aea] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:57:01.066959297Z [2024-05-25 00:57:01,066: INFO/ForkPoolWorker-1] [390eac32-ff91-4aab-8581-66ee2c52b886] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:57:01.345034710Z [2024-05-25 00:57:01,341: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:57:01.351716847Z [2024-05-25 00:57:01,348: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:57:01.385401552Z [2024-05-25 00:57:01,379: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:57:01.513419464Z [2024-05-25 00:57:01,512: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T00:57:01.517664995Z [2024-05-25 00:57:01,517: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:57:01.548709362Z [2024-05-25 00:57:01,548: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:57:01.553835224Z [2024-05-25 00:57:01,553: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:57:01.554028210Z [2024-05-25 00:57:01,553: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:57:01.554148390Z [2024-05-25 00:57:01,554: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T00:57:01.554403959Z [2024-05-25 00:57:01,554: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:57:01.657945878Z [2024-05-25 00:57:01,657: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:57:02.277898026Z [2024-05-25 00:57:02,277: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1a56b820-c220-468a-aef4-bf3e7e543aea] succeeded in 1.2373433279999517s: None 2024-05-25T00:57:02.608432941Z [2024-05-25 00:57:02,608: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:57:02.611827104Z [2024-05-25 00:57:02,611: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:57:02.627212375Z [2024-05-25 00:57:02,626: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T00:57:02.630613718Z [2024-05-25 00:57:02,630: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:57:02.643724276Z [2024-05-25 00:57:02,643: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:57:02.645544029Z [2024-05-25 00:57:02,645: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:57:02.645692917Z [2024-05-25 00:57:02,645: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:57:02.646008568Z [2024-05-25 00:57:02,645: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:57:02.646158211Z [2024-05-25 00:57:02,645: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:57:02.646564453Z [2024-05-25 00:57:02,646: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:57:02.646753475Z [2024-05-25 00:57:02,646: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:57:02.653724245Z [2024-05-25 00:57:02,653: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:57:02.654903185Z [2024-05-25 00:57:02,654: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:57:02.654977698Z [2024-05-25 00:57:02,654: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:57:02.655134562Z [2024-05-25 00:57:02,654: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:57:02.655163818Z [2024-05-25 00:57:02,655: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T00:57:02.655489669Z [2024-05-25 00:57:02,655: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:57:02.655545532Z [2024-05-25 00:57:02,655: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:57:02.733015832Z [2024-05-25 00:57:02,732: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:57:02.746330345Z [2024-05-25 00:57:02,745: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:57:04.673969792Z [2024-05-25 00:57:04,673: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2455e521-53fa-4104-9c1d-268169be5f1b] succeeded in 3.6448450999996567s: None 2024-05-25T00:57:05.054904712Z [2024-05-25 00:57:05,054: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[390eac32-ff91-4aab-8581-66ee2c52b886] succeeded in 4.011340580999786s: None 2024-05-25T00:58:01.053103676Z [2024-05-25 00:58:01,052: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[154470c0-8323-4577-85da-37f95039c197] received 2024-05-25T00:58:01.054881807Z [2024-05-25 00:58:01,054: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2297d5de-d539-4e95-a7ea-0ad37f27e450] received 2024-05-25T00:58:01.063616573Z [2024-05-25 00:58:01,063: INFO/ForkPoolWorker-16] [2297d5de-d539-4e95-a7ea-0ad37f27e450] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:58:01.067799853Z [2024-05-25 00:58:01,067: INFO/ForkPoolWorker-15] [154470c0-8323-4577-85da-37f95039c197] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:58:01.068682088Z [2024-05-25 00:58:01,068: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f35b42c-9b1d-442d-b27b-b8328624b3fd] received 2024-05-25T00:58:01.070191091Z [2024-05-25 00:58:01,070: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25ece9df-df9a-4f22-a2cc-2e4d3a883dd9] received 2024-05-25T00:58:01.079738246Z [2024-05-25 00:58:01,079: INFO/ForkPoolWorker-2] [25ece9df-df9a-4f22-a2cc-2e4d3a883dd9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:58:01.108957903Z [2024-05-25 00:58:01,106: INFO/ForkPoolWorker-1] [6f35b42c-9b1d-442d-b27b-b8328624b3fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T00:58:01.544467251Z [2024-05-25 00:58:01,534: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:58:01.548909048Z [2024-05-25 00:58:01,545: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:58:01.681318034Z [2024-05-25 00:58:01,677: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:58:01.745696632Z [2024-05-25 00:58:01,742: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T00:58:01.848057977Z [2024-05-25 00:58:01,847: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T00:58:01.852612415Z [2024-05-25 00:58:01,852: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:58:01.899869041Z [2024-05-25 00:58:01,897: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:58:01.900883853Z [2024-05-25 00:58:01,900: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:58:01.901156877Z [2024-05-25 00:58:01,900: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:58:01.901274472Z [2024-05-25 00:58:01,901: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T00:58:01.901692316Z [2024-05-25 00:58:01,901: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:58:02.042159962Z [2024-05-25 00:58:02,041: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:58:02.141644303Z [2024-05-25 00:58:02,141: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:58:02.814499375Z [2024-05-25 00:58:02,814: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6f35b42c-9b1d-442d-b27b-b8328624b3fd] succeeded in 1.743898282000373s: None 2024-05-25T00:58:02.902347928Z [2024-05-25 00:58:02,901: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2297d5de-d539-4e95-a7ea-0ad37f27e450] succeeded in 1.8455681969999205s: None 2024-05-25T00:58:03.117564374Z [2024-05-25 00:58:03,117: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:58:03.121227088Z [2024-05-25 00:58:03,120: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:58:03.150570617Z [2024-05-25 00:58:03,150: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:58:03.152157333Z [2024-05-25 00:58:03,151: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:58:03.152319465Z [2024-05-25 00:58:03,152: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:58:03.152544693Z [2024-05-25 00:58:03,152: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:58:03.152685921Z [2024-05-25 00:58:03,152: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:58:03.153032584Z [2024-05-25 00:58:03,152: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:58:03.153166879Z [2024-05-25 00:58:03,153: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:58:03.242697932Z [2024-05-25 00:58:03,242: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:58:03.288558043Z [2024-05-25 00:58:03,288: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T00:58:03.291694666Z [2024-05-25 00:58:03,291: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:58:03.312152774Z [2024-05-25 00:58:03,311: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T00:58:03.313598667Z [2024-05-25 00:58:03,313: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:58:03.313752684Z [2024-05-25 00:58:03,313: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:58:03.313973938Z [2024-05-25 00:58:03,313: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:58:03.314096930Z [2024-05-25 00:58:03,313: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T00:58:03.314458076Z [2024-05-25 00:58:03,314: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:58:03.314492994Z [2024-05-25 00:58:03,314: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:58:03.400407904Z [2024-05-25 00:58:03,400: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:58:04.714277889Z [2024-05-25 00:58:04,713: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[154470c0-8323-4577-85da-37f95039c197] succeeded in 3.6587447689998953s: None 2024-05-25T00:58:05.266181221Z [2024-05-25 00:58:05,265: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[25ece9df-df9a-4f22-a2cc-2e4d3a883dd9] succeeded in 4.193308914999761s: None 2024-05-25T00:59:00.937425016Z [2024-05-25 00:59:00,937: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9968e0e5-108a-431e-a7c1-ef14a9a761ea] received 2024-05-25T00:59:00.939111405Z [2024-05-25 00:59:00,938: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53ee711a-18d5-4ed2-babf-cb92bdee9c36] received 2024-05-25T00:59:00.947446069Z [2024-05-25 00:59:00,947: INFO/ForkPoolWorker-15] [9968e0e5-108a-431e-a7c1-ef14a9a761ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T00:59:00.947851583Z [2024-05-25 00:59:00,947: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff631735-321e-41f5-acd1-1d63f95f505e] received 2024-05-25T00:59:00.952357698Z [2024-05-25 00:59:00,951: INFO/ForkPoolWorker-16] [53ee711a-18d5-4ed2-babf-cb92bdee9c36] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T00:59:00.959431699Z [2024-05-25 00:59:00,959: INFO/ForkPoolWorker-1] [ff631735-321e-41f5-acd1-1d63f95f505e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T00:59:01.237836423Z [2024-05-25 00:59:01,234: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T00:59:01.284471675Z [2024-05-25 00:59:01,280: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T00:59:01.291895772Z [2024-05-25 00:59:01,288: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T00:59:01.488730580Z [2024-05-25 00:59:01,488: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T00:59:01.494477428Z [2024-05-25 00:59:01,493: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:59:01.525118000Z [2024-05-25 00:59:01,524: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T00:59:01.530244296Z [2024-05-25 00:59:01,529: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T00:59:01.530610989Z [2024-05-25 00:59:01,530: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T00:59:01.530808922Z [2024-05-25 00:59:01,530: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T00:59:01.531216745Z [2024-05-25 00:59:01,531: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T00:59:01.631115776Z [2024-05-25 00:59:01,630: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:59:02.375247331Z [2024-05-25 00:59:02,374: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ff631735-321e-41f5-acd1-1d63f95f505e] succeeded in 1.4252024800007348s: None 2024-05-25T00:59:02.471836751Z [2024-05-25 00:59:02,471: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T00:59:02.475315179Z [2024-05-25 00:59:02,474: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:59:02.518269712Z [2024-05-25 00:59:02,517: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T00:59:02.520160425Z [2024-05-25 00:59:02,519: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T00:59:02.521634742Z [2024-05-25 00:59:02,521: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:59:02.521687015Z [2024-05-25 00:59:02,521: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:59:02.521827491Z [2024-05-25 00:59:02,521: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:59:02.521869551Z [2024-05-25 00:59:02,521: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T00:59:02.521875453Z [2024-05-25 00:59:02,521: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T00:59:02.522134530Z [2024-05-25 00:59:02,522: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T00:59:02.522182746Z [2024-05-25 00:59:02,522: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:59:02.544800812Z [2024-05-25 00:59:02,544: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T00:59:02.547082003Z [2024-05-25 00:59:02,546: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T00:59:02.547112657Z [2024-05-25 00:59:02,547: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T00:59:02.547230754Z [2024-05-25 00:59:02,547: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T00:59:02.547241470Z [2024-05-25 00:59:02,547: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T00:59:02.547519841Z [2024-05-25 00:59:02,547: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T00:59:02.547579474Z [2024-05-25 00:59:02,547: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T00:59:02.606226025Z [2024-05-25 00:59:02,605: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:59:02.633988076Z [2024-05-25 00:59:02,633: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T00:59:04.072422497Z [2024-05-25 00:59:04,071: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[53ee711a-18d5-4ed2-babf-cb92bdee9c36] succeeded in 3.1297907549997035s: None 2024-05-25T00:59:04.535377366Z [2024-05-25 00:59:04,534: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9968e0e5-108a-431e-a7c1-ef14a9a761ea] succeeded in 3.594421826999678s: None 2024-05-25T01:00:00.435987304Z [2024-05-25 01:00:00,435: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93ffc538-757f-4484-a94f-166a51388402] received 2024-05-25T01:00:00.438776270Z [2024-05-25 01:00:00,438: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1830fd1d-3eb2-4049-92ca-1c2ef7a35ddb] received 2024-05-25T01:00:00.440223098Z [2024-05-25 01:00:00,440: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[359132c3-b3fe-4419-ab1b-5efb6cc30d06] received 2024-05-25T01:00:00.446709260Z [2024-05-25 01:00:00,446: INFO/ForkPoolWorker-15] [93ffc538-757f-4484-a94f-166a51388402] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:00:00.449451917Z [2024-05-25 01:00:00,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a804d232-81f4-4cff-995e-f0499cada1ae] received 2024-05-25T01:00:00.450780851Z [2024-05-25 01:00:00,450: INFO/ForkPoolWorker-1] [359132c3-b3fe-4419-ab1b-5efb6cc30d06] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:00:00.451431054Z [2024-05-25 01:00:00,451: INFO/ForkPoolWorker-16] [1830fd1d-3eb2-4049-92ca-1c2ef7a35ddb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:00:00.463492097Z [2024-05-25 01:00:00,463: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1da219de-2128-4855-91dd-61c7cd2e2599] received 2024-05-25T01:00:00.475792882Z [2024-05-25 01:00:00,475: INFO/ForkPoolWorker-2] [a804d232-81f4-4cff-995e-f0499cada1ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:00:00.484112284Z [2024-05-25 01:00:00,483: INFO/ForkPoolWorker-3] [1da219de-2128-4855-91dd-61c7cd2e2599] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:00:00.826287864Z [2024-05-25 01:00:00,822: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:00:00.836963336Z [2024-05-25 01:00:00,833: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:00:00.955061990Z [2024-05-25 01:00:00,951: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:00:01.113810540Z [2024-05-25 01:00:01,113: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T01:00:01.118329351Z [2024-05-25 01:00:01,117: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:00:01.159627266Z [2024-05-25 01:00:01,159: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:00:01.163804356Z [2024-05-25 01:00:01,159: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:00:01.165940258Z [2024-05-25 01:00:01,165: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:00:01.166231709Z [2024-05-25 01:00:01,166: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:00:01.166405588Z [2024-05-25 01:00:01,166: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T01:00:01.166730524Z [2024-05-25 01:00:01,166: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:00:01.212613493Z [2024-05-25 01:00:01,201: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:00:01.218255757Z [2024-05-25 01:00:01,217: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:00:01.316450889Z [2024-05-25 01:00:01,316: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:00:01.882484361Z [2024-05-25 01:00:01,882: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[359132c3-b3fe-4419-ab1b-5efb6cc30d06] succeeded in 1.4398684470006629s: None 2024-05-25T01:00:02.074636894Z [2024-05-25 01:00:02,074: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[93ffc538-757f-4484-a94f-166a51388402] succeeded in 1.6344926179999675s: None 2024-05-25T01:00:02.575892414Z [2024-05-25 01:00:02,575: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:00:02.579190910Z [2024-05-25 01:00:02,578: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:00:02.627408185Z [2024-05-25 01:00:02,626: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:00:02.629310788Z [2024-05-25 01:00:02,628: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:00:02.629458205Z [2024-05-25 01:00:02,629: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:00:02.629657516Z [2024-05-25 01:00:02,629: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:00:02.629756415Z [2024-05-25 01:00:02,629: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:00:02.630045904Z [2024-05-25 01:00:02,629: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:00:02.630255115Z [2024-05-25 01:00:02,630: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:00:02.752364815Z [2024-05-25 01:00:02,751: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:00:02.778554075Z [2024-05-25 01:00:02,778: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T01:00:02.782923563Z [2024-05-25 01:00:02,782: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:00:02.805905194Z [2024-05-25 01:00:02,805: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:00:02.807263304Z [2024-05-25 01:00:02,807: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:00:02.807276215Z [2024-05-25 01:00:02,807: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:00:02.807489111Z [2024-05-25 01:00:02,807: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:00:02.807518207Z [2024-05-25 01:00:02,807: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T01:00:02.807829061Z [2024-05-25 01:00:02,807: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:00:02.807881337Z [2024-05-25 01:00:02,807: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:00:02.848480772Z [2024-05-25 01:00:02,848: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-25T01:00:02.851776334Z [2024-05-25 01:00:02,851: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:00:02.887286091Z [2024-05-25 01:00:02,886: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T01:00:02.890653582Z [2024-05-25 01:00:02,890: INFO/ForkPoolWorker-3] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:00:02.891270131Z [2024-05-25 01:00:02,890: INFO/ForkPoolWorker-3] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:00:02.892191970Z [2024-05-25 01:00:02,891: INFO/ForkPoolWorker-3] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:00:02.892470238Z [2024-05-25 01:00:02,892: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-25T01:00:02.893084015Z [2024-05-25 01:00:02,892: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:00:02.894027644Z [2024-05-25 01:00:02,893: INFO/ForkPoolWorker-3] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:00:02.910286460Z [2024-05-25 01:00:02,909: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:00:03.024582350Z [2024-05-25 01:00:03,024: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:00:03.484606742Z [2024-05-25 01:00:03,484: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1830fd1d-3eb2-4049-92ca-1c2ef7a35ddb] succeeded in 3.043964511000013s: None 2024-05-25T01:00:04.506540390Z [2024-05-25 01:00:04,506: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7b13c43-04b5-4f48-83c1-b5329d38220b] received 2024-05-25T01:00:04.517273140Z [2024-05-25 01:00:04,516: INFO/ForkPoolWorker-15] [c7b13c43-04b5-4f48-83c1-b5329d38220b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:00:04.553570440Z [2024-05-25 01:00:04,553: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[1da219de-2128-4855-91dd-61c7cd2e2599] succeeded in 4.087372212000446s: None 2024-05-25T01:00:04.811900958Z [2024-05-25 01:00:04,811: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a804d232-81f4-4cff-995e-f0499cada1ae] succeeded in 4.358585525000308s: None 2024-05-25T01:00:04.841660838Z [2024-05-25 01:00:04,838: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:00:06.028291961Z [2024-05-25 01:00:06,027: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:00:06.032000890Z [2024-05-25 01:00:06,031: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:00:06.079135193Z [2024-05-25 01:00:06,078: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:00:06.080710382Z [2024-05-25 01:00:06,080: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:00:06.080781228Z [2024-05-25 01:00:06,080: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:00:06.081045667Z [2024-05-25 01:00:06,080: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:00:06.081173245Z [2024-05-25 01:00:06,081: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:00:06.082534162Z [2024-05-25 01:00:06,082: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:00:06.082742099Z [2024-05-25 01:00:06,082: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:00:06.180425833Z [2024-05-25 01:00:06,180: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:00:06.958584621Z [2024-05-25 01:00:06,957: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c7b13c43-04b5-4f48-83c1-b5329d38220b] succeeded in 2.448753908999606s: None 2024-05-25T01:00:06.998210784Z [2024-05-25 01:00:06,997: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d356133-7d56-4698-a387-a551bfab7ebc] received 2024-05-25T01:00:07.019268788Z [2024-05-25 01:00:07,018: INFO/ForkPoolWorker-15] [7d356133-7d56-4698-a387-a551bfab7ebc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:00:07.370185017Z [2024-05-25 01:00:07,366: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:00:08.556200372Z [2024-05-25 01:00:08,555: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:00:08.559683336Z [2024-05-25 01:00:08,559: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:00:08.582420669Z [2024-05-25 01:00:08,582: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:00:08.584830993Z [2024-05-25 01:00:08,584: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:00:08.585090591Z [2024-05-25 01:00:08,584: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:00:08.585466221Z [2024-05-25 01:00:08,585: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:00:08.585715777Z [2024-05-25 01:00:08,585: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:00:08.586700861Z [2024-05-25 01:00:08,585: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:00:08.586714823Z [2024-05-25 01:00:08,586: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:00:08.698004262Z [2024-05-25 01:00:08,697: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:00:09.405630264Z [2024-05-25 01:00:09,405: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7d356133-7d56-4698-a387-a551bfab7ebc] succeeded in 2.4047954130001017s: None 2024-05-25T01:00:10.390745330Z [2024-05-25 01:00:10,390: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33041e7d-727e-42a2-9453-36a637d881f2] received 2024-05-25T01:00:10.400132311Z [2024-05-25 01:00:10,399: INFO/ForkPoolWorker-15] [33041e7d-727e-42a2-9453-36a637d881f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:00:10.673088868Z [2024-05-25 01:00:10,669: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:00:11.835201658Z [2024-05-25 01:00:11,834: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:00:11.838912386Z [2024-05-25 01:00:11,838: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:00:11.870332191Z [2024-05-25 01:00:11,870: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:00:11.872287572Z [2024-05-25 01:00:11,872: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:00:11.872495112Z [2024-05-25 01:00:11,872: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:00:11.872858497Z [2024-05-25 01:00:11,872: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:00:11.873048118Z [2024-05-25 01:00:11,872: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:00:11.873670227Z [2024-05-25 01:00:11,873: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:00:11.873919032Z [2024-05-25 01:00:11,873: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:00:11.979364372Z [2024-05-25 01:00:11,978: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:00:12.669029513Z [2024-05-25 01:00:12,668: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[33041e7d-727e-42a2-9453-36a637d881f2] succeeded in 2.274391562999881s: None 2024-05-25T01:01:00.907398236Z [2024-05-25 01:01:00,907: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb7777b3-6307-4215-854b-7f4288588865] received 2024-05-25T01:01:00.911176363Z [2024-05-25 01:01:00,910: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91ff0b85-ad06-4952-afea-9a8898632021] received 2024-05-25T01:01:00.916608365Z [2024-05-25 01:01:00,916: INFO/ForkPoolWorker-15] [eb7777b3-6307-4215-854b-7f4288588865] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:01:00.918422594Z [2024-05-25 01:01:00,918: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13be9e58-8088-40d4-840c-3f0ae5472146] received 2024-05-25T01:01:00.920786350Z [2024-05-25 01:01:00,920: INFO/ForkPoolWorker-16] [91ff0b85-ad06-4952-afea-9a8898632021] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:01:00.933566645Z [2024-05-25 01:01:00,933: INFO/ForkPoolWorker-1] [13be9e58-8088-40d4-840c-3f0ae5472146] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:01:01.249443511Z [2024-05-25 01:01:01,244: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:01:01.255594005Z [2024-05-25 01:01:01,252: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:01:01.291474963Z [2024-05-25 01:01:01,288: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:01:01.426305707Z [2024-05-25 01:01:01,425: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T01:01:01.430629614Z [2024-05-25 01:01:01,430: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:01:01.459257277Z [2024-05-25 01:01:01,458: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:01:01.462026136Z [2024-05-25 01:01:01,461: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:01:01.462088934Z [2024-05-25 01:01:01,461: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:01:01.462196134Z [2024-05-25 01:01:01,462: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T01:01:01.462469524Z [2024-05-25 01:01:01,462: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:01:01.610227478Z [2024-05-25 01:01:01,609: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:01:02.424081407Z [2024-05-25 01:01:02,422: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[13be9e58-8088-40d4-840c-3f0ae5472146] succeeded in 1.5032284280005115s: None 2024-05-25T01:01:02.786052327Z [2024-05-25 01:01:02,785: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:01:02.789484034Z [2024-05-25 01:01:02,789: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:01:02.792026804Z [2024-05-25 01:01:02,791: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:01:02.797542818Z [2024-05-25 01:01:02,796: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:01:02.810735380Z [2024-05-25 01:01:02,810: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:01:02.811997972Z [2024-05-25 01:01:02,811: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:01:02.812038742Z [2024-05-25 01:01:02,811: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:01:02.812206880Z [2024-05-25 01:01:02,812: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:01:02.812242235Z [2024-05-25 01:01:02,812: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:01:02.812588520Z [2024-05-25 01:01:02,812: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:01:02.812619054Z [2024-05-25 01:01:02,812: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:01:02.822275522Z [2024-05-25 01:01:02,822: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:01:02.824926622Z [2024-05-25 01:01:02,824: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:01:02.825869823Z [2024-05-25 01:01:02,825: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:01:02.826204771Z [2024-05-25 01:01:02,825: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:01:02.826380321Z [2024-05-25 01:01:02,826: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:01:02.827049952Z [2024-05-25 01:01:02,826: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:01:02.828205856Z [2024-05-25 01:01:02,828: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:01:02.907506796Z [2024-05-25 01:01:02,907: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:01:02.912295827Z [2024-05-25 01:01:02,912: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:01:05.037889013Z [2024-05-25 01:01:05,037: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eb7777b3-6307-4215-854b-7f4288588865] succeeded in 4.128706340000463s: None 2024-05-25T01:01:05.503272089Z [2024-05-25 01:01:05,502: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[91ff0b85-ad06-4952-afea-9a8898632021] succeeded in 4.589379611000368s: None 2024-05-25T01:02:00.561196483Z [2024-05-25 01:02:00,560: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a05a88f-f71c-4412-9b8e-5e502eedcdb0] received 2024-05-25T01:02:00.573625749Z [2024-05-25 01:02:00,573: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26ac7dd4-7ced-4597-ad72-107869ad9bee] received 2024-05-25T01:02:00.577003813Z [2024-05-25 01:02:00,576: INFO/ForkPoolWorker-15] [4a05a88f-f71c-4412-9b8e-5e502eedcdb0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:02:00.583090886Z [2024-05-25 01:02:00,582: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c575c81-b2ca-4e40-ad68-e91e06a4240e] received 2024-05-25T01:02:00.584310346Z [2024-05-25 01:02:00,583: INFO/ForkPoolWorker-16] [26ac7dd4-7ced-4597-ad72-107869ad9bee] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:02:00.587213528Z [2024-05-25 01:02:00,586: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[947c03a8-c417-4986-bdd3-b83119b0d0a0] received 2024-05-25T01:02:00.599496523Z [2024-05-25 01:02:00,598: INFO/ForkPoolWorker-2] [947c03a8-c417-4986-bdd3-b83119b0d0a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:02:00.601174239Z [2024-05-25 01:02:00,599: INFO/ForkPoolWorker-1] [7c575c81-b2ca-4e40-ad68-e91e06a4240e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:02:00.844173030Z [2024-05-25 01:02:00,840: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:02:00.927997480Z [2024-05-25 01:02:00,924: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:02:00.966059042Z [2024-05-25 01:02:00,963: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:02:00.996716123Z [2024-05-25 01:02:00,993: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:02:01.006018323Z [2024-05-25 01:02:01,005: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T01:02:01.010397531Z [2024-05-25 01:02:01,009: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:02:01.068598350Z [2024-05-25 01:02:01,068: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:02:01.071446449Z [2024-05-25 01:02:01,071: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:02:01.071709840Z [2024-05-25 01:02:01,071: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:02:01.071903095Z [2024-05-25 01:02:01,071: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T01:02:01.072223513Z [2024-05-25 01:02:01,072: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:02:01.151838329Z [2024-05-25 01:02:01,151: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:02:01.352671995Z [2024-05-25 01:02:01,347: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:02:01.823363466Z [2024-05-25 01:02:01,822: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[26ac7dd4-7ced-4597-ad72-107869ad9bee] succeeded in 1.2474419350000971s: None 2024-05-25T01:02:02.060780989Z [2024-05-25 01:02:02,060: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7c575c81-b2ca-4e40-ad68-e91e06a4240e] succeeded in 1.475236780999694s: None 2024-05-25T01:02:02.239303556Z [2024-05-25 01:02:02,231: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:02:02.239337551Z [2024-05-25 01:02:02,234: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:02:02.291485817Z [2024-05-25 01:02:02,291: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:02:02.297422332Z [2024-05-25 01:02:02,295: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:02:02.297455965Z [2024-05-25 01:02:02,295: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:02:02.297460282Z [2024-05-25 01:02:02,295: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:02:02.297464092Z [2024-05-25 01:02:02,295: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:02:02.297467355Z [2024-05-25 01:02:02,296: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:02:02.297471411Z [2024-05-25 01:02:02,296: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:02:02.346807908Z [2024-05-25 01:02:02,346: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T01:02:02.350380828Z [2024-05-25 01:02:02,349: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:02:02.393515506Z [2024-05-25 01:02:02,393: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:02:02.394606964Z [2024-05-25 01:02:02,394: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:02:02.394767814Z [2024-05-25 01:02:02,394: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:02:02.394980868Z [2024-05-25 01:02:02,394: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:02:02.395152103Z [2024-05-25 01:02:02,394: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T01:02:02.395583047Z [2024-05-25 01:02:02,395: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:02:02.395746977Z [2024-05-25 01:02:02,395: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:02:02.434826428Z [2024-05-25 01:02:02,434: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:02:02.492760036Z [2024-05-25 01:02:02,492: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:02:04.438317446Z [2024-05-25 01:02:04,437: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4a05a88f-f71c-4412-9b8e-5e502eedcdb0] succeeded in 3.8750321379993693s: None 2024-05-25T01:02:05.011722703Z [2024-05-25 01:02:05,010: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[947c03a8-c417-4986-bdd3-b83119b0d0a0] succeeded in 4.421644546000607s: None 2024-05-25T01:03:00.452619352Z [2024-05-25 01:03:00,451: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41d9ae71-fc88-4242-8dd6-270cecf20f5d] received 2024-05-25T01:03:00.456283445Z [2024-05-25 01:03:00,456: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8bd438ac-74a9-4bf9-9d3a-bf63dc5eee47] received 2024-05-25T01:03:00.459288016Z [2024-05-25 01:03:00,459: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4363e459-f742-44b9-86c7-c4aaccfacea0] received 2024-05-25T01:03:00.465988843Z [2024-05-25 01:03:00,465: INFO/ForkPoolWorker-15] [41d9ae71-fc88-4242-8dd6-270cecf20f5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:03:00.469263435Z [2024-05-25 01:03:00,468: INFO/ForkPoolWorker-1] [4363e459-f742-44b9-86c7-c4aaccfacea0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:03:00.471431888Z [2024-05-25 01:03:00,471: INFO/ForkPoolWorker-16] [8bd438ac-74a9-4bf9-9d3a-bf63dc5eee47] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:03:00.767306089Z [2024-05-25 01:03:00,764: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:03:00.767348459Z [2024-05-25 01:03:00,764: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:03:00.814509047Z [2024-05-25 01:03:00,811: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:03:00.916933443Z [2024-05-25 01:03:00,916: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T01:03:00.921027545Z [2024-05-25 01:03:00,920: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:03:00.950069044Z [2024-05-25 01:03:00,949: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:03:00.953065267Z [2024-05-25 01:03:00,952: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:03:00.953348250Z [2024-05-25 01:03:00,953: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:03:00.953473618Z [2024-05-25 01:03:00,953: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T01:03:00.953800960Z [2024-05-25 01:03:00,953: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:03:01.097483982Z [2024-05-25 01:03:01,097: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:03:01.713973331Z [2024-05-25 01:03:01,713: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4363e459-f742-44b9-86c7-c4aaccfacea0] succeeded in 1.252626767000038s: None 2024-05-25T01:03:01.951566212Z [2024-05-25 01:03:01,951: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:03:01.954995316Z [2024-05-25 01:03:01,954: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:03:01.988805040Z [2024-05-25 01:03:01,988: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:03:01.991339297Z [2024-05-25 01:03:01,991: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:03:01.991505413Z [2024-05-25 01:03:01,991: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:03:01.991917194Z [2024-05-25 01:03:01,991: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:03:01.992114909Z [2024-05-25 01:03:01,991: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:03:01.992740884Z [2024-05-25 01:03:01,992: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:03:01.992918157Z [2024-05-25 01:03:01,992: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:03:02.080288174Z [2024-05-25 01:03:02,079: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:03:02.083741809Z [2024-05-25 01:03:02,083: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:03:02.091576822Z [2024-05-25 01:03:02,091: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:03:02.109775204Z [2024-05-25 01:03:02,109: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:03:02.111986095Z [2024-05-25 01:03:02,111: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:03:02.112089374Z [2024-05-25 01:03:02,111: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:03:02.112271166Z [2024-05-25 01:03:02,112: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:03:02.112374045Z [2024-05-25 01:03:02,112: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:03:02.112676974Z [2024-05-25 01:03:02,112: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:03:02.113152406Z [2024-05-25 01:03:02,113: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:03:02.224413450Z [2024-05-25 01:03:02,224: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:03:03.732309485Z [2024-05-25 01:03:03,731: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[41d9ae71-fc88-4242-8dd6-270cecf20f5d] succeeded in 3.2761705920001987s: None 2024-05-25T01:03:04.084109185Z [2024-05-25 01:03:04,083: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8bd438ac-74a9-4bf9-9d3a-bf63dc5eee47] succeeded in 3.62313239300056s: None 2024-05-25T01:04:01.099272579Z [2024-05-25 01:04:01,098: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed5f9d80-bd3a-4fc2-8cd7-4d8302a220af] received 2024-05-25T01:04:01.104961873Z [2024-05-25 01:04:01,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[242d5717-94e6-47f0-a69f-ba33e5df1a85] received 2024-05-25T01:04:01.113513522Z [2024-05-25 01:04:01,113: INFO/ForkPoolWorker-15] [ed5f9d80-bd3a-4fc2-8cd7-4d8302a220af] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:04:01.120161321Z [2024-05-25 01:04:01,119: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9491b5da-08fd-48f7-a398-f5458ec2404d] received 2024-05-25T01:04:01.121926960Z [2024-05-25 01:04:01,121: INFO/ForkPoolWorker-16] [242d5717-94e6-47f0-a69f-ba33e5df1a85] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:04:01.126027971Z [2024-05-25 01:04:01,125: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dcbeb40e-c0ca-4542-9b27-efaa7bbae9cf] received 2024-05-25T01:04:01.138953081Z [2024-05-25 01:04:01,138: INFO/ForkPoolWorker-2] [dcbeb40e-c0ca-4542-9b27-efaa7bbae9cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:04:01.146963866Z [2024-05-25 01:04:01,146: INFO/ForkPoolWorker-1] [9491b5da-08fd-48f7-a398-f5458ec2404d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:04:01.500447260Z [2024-05-25 01:04:01,497: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:04:01.528548316Z [2024-05-25 01:04:01,525: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:04:01.590280548Z [2024-05-25 01:04:01,587: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:04:01.688729255Z [2024-05-25 01:04:01,685: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:04:01.724101596Z [2024-05-25 01:04:01,723: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T01:04:01.728199019Z [2024-05-25 01:04:01,727: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:04:01.752262921Z [2024-05-25 01:04:01,752: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:04:01.753442034Z [2024-05-25 01:04:01,753: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:04:01.753642495Z [2024-05-25 01:04:01,753: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:04:01.753719140Z [2024-05-25 01:04:01,753: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T01:04:01.753950159Z [2024-05-25 01:04:01,753: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:04:01.837151155Z [2024-05-25 01:04:01,836: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:04:01.861977406Z [2024-05-25 01:04:01,861: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:04:02.513560149Z [2024-05-25 01:04:02,513: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ed5f9d80-bd3a-4fc2-8cd7-4d8302a220af] succeeded in 1.4053926229989884s: None 2024-05-25T01:04:02.553766731Z [2024-05-25 01:04:02,553: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[dcbeb40e-c0ca-4542-9b27-efaa7bbae9cf] succeeded in 1.4235019460011245s: None 2024-05-25T01:04:02.842076410Z [2024-05-25 01:04:02,841: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:04:02.845533136Z [2024-05-25 01:04:02,845: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:04:02.865324765Z [2024-05-25 01:04:02,865: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:04:02.866460390Z [2024-05-25 01:04:02,866: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:04:02.866559996Z [2024-05-25 01:04:02,866: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:04:02.866729900Z [2024-05-25 01:04:02,866: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:04:02.866916948Z [2024-05-25 01:04:02,866: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:04:02.867205114Z [2024-05-25 01:04:02,867: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:04:02.867347375Z [2024-05-25 01:04:02,867: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:04:02.966798044Z [2024-05-25 01:04:02,966: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:04:03.179661755Z [2024-05-25 01:04:03,179: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:04:03.182999487Z [2024-05-25 01:04:03,182: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:04:03.209124016Z [2024-05-25 01:04:03,208: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:04:03.211216749Z [2024-05-25 01:04:03,210: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:04:03.211463619Z [2024-05-25 01:04:03,211: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:04:03.211953295Z [2024-05-25 01:04:03,211: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:04:03.212133774Z [2024-05-25 01:04:03,212: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:04:03.212633164Z [2024-05-25 01:04:03,212: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:04:03.212828433Z [2024-05-25 01:04:03,212: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:04:03.302737414Z [2024-05-25 01:04:03,302: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:04:05.263015531Z [2024-05-25 01:04:05,262: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9491b5da-08fd-48f7-a398-f5458ec2404d] succeeded in 4.139231843999369s: None 2024-05-25T01:04:05.368984101Z [2024-05-25 01:04:05,368: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[242d5717-94e6-47f0-a69f-ba33e5df1a85] succeeded in 4.261216983999475s: None 2024-05-25T01:05:00.588715786Z [2024-05-25 01:05:00,587: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a5cccff-3533-454e-97b8-2b7a322c2c1a] received 2024-05-25T01:05:00.591799683Z [2024-05-25 01:05:00,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa5bc155-3544-40a5-9c63-8c378f6f74d3] received 2024-05-25T01:05:00.593387103Z [2024-05-25 01:05:00,593: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37ac9ad2-483e-4aae-b769-4db7bb0d2cb7] received 2024-05-25T01:05:00.594664539Z [2024-05-25 01:05:00,594: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b20e00d-d346-4244-ae23-b983a375cdc2] received 2024-05-25T01:05:00.601950080Z [2024-05-25 01:05:00,601: INFO/ForkPoolWorker-15] [9a5cccff-3533-454e-97b8-2b7a322c2c1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:05:00.611358843Z [2024-05-25 01:05:00,610: INFO/ForkPoolWorker-16] [aa5bc155-3544-40a5-9c63-8c378f6f74d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:05:00.619659799Z [2024-05-25 01:05:00,619: INFO/ForkPoolWorker-2] [4b20e00d-d346-4244-ae23-b983a375cdc2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:05:00.620529413Z [2024-05-25 01:05:00,620: INFO/ForkPoolWorker-1] [37ac9ad2-483e-4aae-b769-4db7bb0d2cb7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:05:00.893675412Z [2024-05-25 01:05:00,890: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:05:01.011270068Z [2024-05-25 01:05:01,007: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:05:01.071321599Z [2024-05-25 01:05:01,066: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:05:01.158091906Z [2024-05-25 01:05:01,154: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:05:01.272194273Z [2024-05-25 01:05:01,271: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T01:05:01.276595810Z [2024-05-25 01:05:01,276: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:05:01.340010900Z [2024-05-25 01:05:01,337: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:05:01.345429380Z [2024-05-25 01:05:01,342: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:05:01.345437812Z [2024-05-25 01:05:01,343: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:05:01.345441987Z [2024-05-25 01:05:01,343: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T01:05:01.345445140Z [2024-05-25 01:05:01,343: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:05:01.528218678Z [2024-05-25 01:05:01,527: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:05:02.434661930Z [2024-05-25 01:05:02,434: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aa5bc155-3544-40a5-9c63-8c378f6f74d3] succeeded in 1.8397325999994791s: None 2024-05-25T01:05:02.613899607Z [2024-05-25 01:05:02,613: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:05:02.617782309Z [2024-05-25 01:05:02,617: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:05:02.651350738Z [2024-05-25 01:05:02,651: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:05:02.656576158Z [2024-05-25 01:05:02,656: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:05:02.656588645Z [2024-05-25 01:05:02,656: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:05:02.656705990Z [2024-05-25 01:05:02,656: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:05:02.656740073Z [2024-05-25 01:05:02,656: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:05:02.656976622Z [2024-05-25 01:05:02,656: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:05:02.657007001Z [2024-05-25 01:05:02,656: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:05:02.770726737Z [2024-05-25 01:05:02,770: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:05:03.250966722Z [2024-05-25 01:05:03,250: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:05:03.255157758Z [2024-05-25 01:05:03,254: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:05:03.278033167Z [2024-05-25 01:05:03,277: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:05:03.279235412Z [2024-05-25 01:05:03,279: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:05:03.279443349Z [2024-05-25 01:05:03,279: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:05:03.279691876Z [2024-05-25 01:05:03,279: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:05:03.279895325Z [2024-05-25 01:05:03,279: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:05:03.280375616Z [2024-05-25 01:05:03,280: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:05:03.280585804Z [2024-05-25 01:05:03,280: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:05:03.388835303Z [2024-05-25 01:05:03,387: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T01:05:03.401272216Z [2024-05-25 01:05:03,391: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:05:03.439745312Z [2024-05-25 01:05:03,439: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:05:03.453957613Z [2024-05-25 01:05:03,453: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:05:03.457911553Z [2024-05-25 01:05:03,457: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:05:03.457930149Z [2024-05-25 01:05:03,457: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:05:03.458001619Z [2024-05-25 01:05:03,457: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:05:03.458066020Z [2024-05-25 01:05:03,457: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T01:05:03.458291554Z [2024-05-25 01:05:03,458: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:05:03.458301272Z [2024-05-25 01:05:03,458: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:05:03.620188747Z [2024-05-25 01:05:03,619: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:05:04.211812478Z [2024-05-25 01:05:04,211: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[37ac9ad2-483e-4aae-b769-4db7bb0d2cb7] succeeded in 3.6143623309999384s: None 2024-05-25T01:05:04.342990412Z [2024-05-25 01:05:04,342: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9a5cccff-3533-454e-97b8-2b7a322c2c1a] succeeded in 3.749740274000942s: None 2024-05-25T01:05:05.177128053Z [2024-05-25 01:05:05,176: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c78a41d-0fe4-453e-a088-1fe5da0b1cf3] received 2024-05-25T01:05:05.187428354Z [2024-05-25 01:05:05,186: INFO/ForkPoolWorker-15] [5c78a41d-0fe4-453e-a088-1fe5da0b1cf3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:05:05.474404220Z [2024-05-25 01:05:05,470: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:05:05.572188829Z [2024-05-25 01:05:05,571: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4b20e00d-d346-4244-ae23-b983a375cdc2] succeeded in 4.971190324999043s: None 2024-05-25T01:05:06.525338114Z [2024-05-25 01:05:06,517: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:05:06.525370325Z [2024-05-25 01:05:06,520: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:05:06.568684210Z [2024-05-25 01:05:06,568: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:05:06.570657629Z [2024-05-25 01:05:06,570: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:05:06.570764936Z [2024-05-25 01:05:06,570: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:05:06.570913569Z [2024-05-25 01:05:06,570: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:05:06.571343655Z [2024-05-25 01:05:06,571: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:05:06.571560686Z [2024-05-25 01:05:06,571: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:05:06.571623577Z [2024-05-25 01:05:06,571: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:05:06.661409858Z [2024-05-25 01:05:06,660: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:05:07.464007489Z [2024-05-25 01:05:07,463: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5c78a41d-0fe4-453e-a088-1fe5da0b1cf3] succeeded in 2.284342065000601s: None 2024-05-25T01:05:07.934947749Z [2024-05-25 01:05:07,934: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d31a02b9-4636-4e7b-a98e-7f5ad59d22c1] received 2024-05-25T01:05:07.941179040Z [2024-05-25 01:05:07,940: INFO/ForkPoolWorker-15] [d31a02b9-4636-4e7b-a98e-7f5ad59d22c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:05:08.264846281Z [2024-05-25 01:05:08,261: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:05:09.498132813Z [2024-05-25 01:05:09,497: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:05:09.501471335Z [2024-05-25 01:05:09,500: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:05:09.526412116Z [2024-05-25 01:05:09,526: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:05:09.529188907Z [2024-05-25 01:05:09,528: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:05:09.529203414Z [2024-05-25 01:05:09,529: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:05:09.529529852Z [2024-05-25 01:05:09,529: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:05:09.529537227Z [2024-05-25 01:05:09,529: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:05:09.530084544Z [2024-05-25 01:05:09,529: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:05:09.530331983Z [2024-05-25 01:05:09,530: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:05:09.630417105Z [2024-05-25 01:05:09,630: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:05:10.291567971Z [2024-05-25 01:05:10,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a680433d-94e4-4fe6-a6db-2db8dbbcb24a] received 2024-05-25T01:05:10.300612470Z [2024-05-25 01:05:10,300: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d31a02b9-4636-4e7b-a98e-7f5ad59d22c1] succeeded in 2.36414550399968s: None 2024-05-25T01:05:10.301343726Z [2024-05-25 01:05:10,301: INFO/ForkPoolWorker-16] [a680433d-94e4-4fe6-a6db-2db8dbbcb24a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:05:10.614806350Z [2024-05-25 01:05:10,611: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:05:11.649389676Z [2024-05-25 01:05:11,648: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:05:11.652669206Z [2024-05-25 01:05:11,652: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:05:11.678140745Z [2024-05-25 01:05:11,677: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:05:11.679653288Z [2024-05-25 01:05:11,679: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:05:11.679780543Z [2024-05-25 01:05:11,679: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:05:11.680076862Z [2024-05-25 01:05:11,679: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:05:11.680126421Z [2024-05-25 01:05:11,680: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:05:11.680449022Z [2024-05-25 01:05:11,680: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:05:11.680496721Z [2024-05-25 01:05:11,680: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:05:11.793404987Z [2024-05-25 01:05:11,792: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:05:12.403467957Z [2024-05-25 01:05:12,402: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a680433d-94e4-4fe6-a6db-2db8dbbcb24a] succeeded in 2.1082657590013696s: None 2024-05-25T01:06:00.316495126Z [2024-05-25 01:06:00,316: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ecd0620-c661-4c17-b4e6-8ceed4943aa6] received 2024-05-25T01:06:00.321062486Z [2024-05-25 01:06:00,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89e61f8f-ddf1-452c-83b2-71cd932f0734] received 2024-05-25T01:06:00.325695663Z [2024-05-25 01:06:00,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10079a9e-b3ae-43d8-a74b-129a49272552] received 2024-05-25T01:06:00.331224634Z [2024-05-25 01:06:00,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55cbc802-7d25-46e8-a7f6-71102be656a5] received 2024-05-25T01:06:00.334970158Z [2024-05-25 01:06:00,334: INFO/ForkPoolWorker-16] [89e61f8f-ddf1-452c-83b2-71cd932f0734] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:06:00.338344822Z [2024-05-25 01:06:00,337: INFO/ForkPoolWorker-15] [1ecd0620-c661-4c17-b4e6-8ceed4943aa6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:06:00.344193207Z [2024-05-25 01:06:00,343: INFO/ForkPoolWorker-2] [55cbc802-7d25-46e8-a7f6-71102be656a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:06:00.345059538Z [2024-05-25 01:06:00,344: INFO/ForkPoolWorker-1] [10079a9e-b3ae-43d8-a74b-129a49272552] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:06:00.700391109Z [2024-05-25 01:06:00,696: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:06:00.777493675Z [2024-05-25 01:06:00,774: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:06:00.779427304Z [2024-05-25 01:06:00,776: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:06:00.801592657Z [2024-05-25 01:06:00,798: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:06:00.854853621Z [2024-05-25 01:06:00,854: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T01:06:00.858657611Z [2024-05-25 01:06:00,858: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:06:00.891151580Z [2024-05-25 01:06:00,890: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:06:00.893732159Z [2024-05-25 01:06:00,893: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:06:00.894097271Z [2024-05-25 01:06:00,893: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:06:00.894251818Z [2024-05-25 01:06:00,894: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T01:06:00.895057402Z [2024-05-25 01:06:00,894: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:06:01.017550408Z [2024-05-25 01:06:01,017: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:06:01.135303116Z [2024-05-25 01:06:01,134: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:06:01.703753434Z [2024-05-25 01:06:01,703: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[55cbc802-7d25-46e8-a7f6-71102be656a5] succeeded in 1.3687433559989586s: None 2024-05-25T01:06:01.785425113Z [2024-05-25 01:06:01,784: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1ecd0620-c661-4c17-b4e6-8ceed4943aa6] succeeded in 1.4633807589998469s: None 2024-05-25T01:06:02.177420093Z [2024-05-25 01:06:02,176: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:06:02.180601008Z [2024-05-25 01:06:02,180: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:06:02.211691633Z [2024-05-25 01:06:02,209: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:06:02.215255089Z [2024-05-25 01:06:02,213: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:06:02.215291330Z [2024-05-25 01:06:02,214: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:06:02.215296080Z [2024-05-25 01:06:02,214: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:06:02.215300903Z [2024-05-25 01:06:02,214: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:06:02.215304287Z [2024-05-25 01:06:02,214: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:06:02.215307706Z [2024-05-25 01:06:02,214: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:06:02.249365173Z [2024-05-25 01:06:02,245: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:06:02.256323987Z [2024-05-25 01:06:02,248: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:06:02.310001450Z [2024-05-25 01:06:02,309: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:06:02.320641559Z [2024-05-25 01:06:02,320: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:06:02.320703114Z [2024-05-25 01:06:02,320: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:06:02.320892091Z [2024-05-25 01:06:02,320: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:06:02.320953391Z [2024-05-25 01:06:02,320: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:06:02.321239664Z [2024-05-25 01:06:02,321: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:06:02.321359015Z [2024-05-25 01:06:02,321: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:06:02.345469272Z [2024-05-25 01:06:02,345: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:06:02.432886494Z [2024-05-25 01:06:02,432: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:06:03.801470285Z [2024-05-25 01:06:03,800: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[10079a9e-b3ae-43d8-a74b-129a49272552] succeeded in 3.469592178000312s: None 2024-05-25T01:06:04.270471136Z [2024-05-25 01:06:04,270: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[89e61f8f-ddf1-452c-83b2-71cd932f0734] succeeded in 3.947026954001558s: None 2024-05-25T01:07:01.264902731Z [2024-05-25 01:07:01,264: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e11688c2-3f26-46b6-bc97-4d82ba28f9c5] received 2024-05-25T01:07:01.282009696Z [2024-05-25 01:07:01,281: INFO/ForkPoolWorker-15] [e11688c2-3f26-46b6-bc97-4d82ba28f9c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:07:01.288992384Z [2024-05-25 01:07:01,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[310d8247-42aa-49a7-a9e1-95d0731380e2] received 2024-05-25T01:07:01.304790022Z [2024-05-25 01:07:01,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[647e3684-40f4-4f47-929c-58ba262263a4] received 2024-05-25T01:07:01.307197051Z [2024-05-25 01:07:01,306: INFO/ForkPoolWorker-16] [310d8247-42aa-49a7-a9e1-95d0731380e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:07:01.319847511Z [2024-05-25 01:07:01,319: INFO/ForkPoolWorker-1] [647e3684-40f4-4f47-929c-58ba262263a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:07:01.695315431Z [2024-05-25 01:07:01,692: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:07:01.712614704Z [2024-05-25 01:07:01,709: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:07:01.739756247Z [2024-05-25 01:07:01,735: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:07:01.873141455Z [2024-05-25 01:07:01,872: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T01:07:01.878912097Z [2024-05-25 01:07:01,878: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:07:01.918887075Z [2024-05-25 01:07:01,918: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:07:01.924415074Z [2024-05-25 01:07:01,924: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:07:01.924460105Z [2024-05-25 01:07:01,924: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:07:01.924465181Z [2024-05-25 01:07:01,924: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T01:07:01.924659157Z [2024-05-25 01:07:01,924: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:07:02.065056235Z [2024-05-25 01:07:02,064: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:07:02.875531467Z [2024-05-25 01:07:02,875: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[310d8247-42aa-49a7-a9e1-95d0731380e2] succeeded in 1.58095500699892s: None 2024-05-25T01:07:03.114911592Z [2024-05-25 01:07:03,114: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:07:03.118237775Z [2024-05-25 01:07:03,117: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:07:03.126725412Z [2024-05-25 01:07:03,126: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:07:03.130665583Z [2024-05-25 01:07:03,130: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:07:03.149019830Z [2024-05-25 01:07:03,148: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:07:03.153950801Z [2024-05-25 01:07:03,153: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:07:03.154470670Z [2024-05-25 01:07:03,153: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:07:03.154752376Z [2024-05-25 01:07:03,154: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:07:03.154902419Z [2024-05-25 01:07:03,154: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:07:03.155192850Z [2024-05-25 01:07:03,155: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:07:03.155908156Z [2024-05-25 01:07:03,155: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:07:03.161856079Z [2024-05-25 01:07:03,161: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:07:03.164639877Z [2024-05-25 01:07:03,164: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:07:03.165030610Z [2024-05-25 01:07:03,164: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:07:03.165703214Z [2024-05-25 01:07:03,165: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:07:03.166059925Z [2024-05-25 01:07:03,165: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:07:03.166552367Z [2024-05-25 01:07:03,166: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:07:03.167052979Z [2024-05-25 01:07:03,166: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:07:03.265861332Z [2024-05-25 01:07:03,265: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:07:03.268562391Z [2024-05-25 01:07:03,268: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:07:05.017894931Z [2024-05-25 01:07:05,017: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[647e3684-40f4-4f47-929c-58ba262263a4] succeeded in 3.7100583289993665s: None 2024-05-25T01:07:05.400011745Z [2024-05-25 01:07:05,399: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e11688c2-3f26-46b6-bc97-4d82ba28f9c5] succeeded in 4.1291686829990795s: None 2024-05-25T01:08:00.609696197Z [2024-05-25 01:08:00,608: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81f73574-dd4f-4802-b8f6-14f56598b7b6] received 2024-05-25T01:08:00.613615766Z [2024-05-25 01:08:00,613: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1746c05-a21e-497d-b6f7-707cb9d61267] received 2024-05-25T01:08:00.615071985Z [2024-05-25 01:08:00,614: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b8a85c4-c0d6-4a21-8622-d0b5c0076c5d] received 2024-05-25T01:08:00.616660231Z [2024-05-25 01:08:00,616: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4533cba-0ce7-4612-a5c6-edff8792708e] received 2024-05-25T01:08:00.622413211Z [2024-05-25 01:08:00,622: INFO/ForkPoolWorker-1] [2b8a85c4-c0d6-4a21-8622-d0b5c0076c5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:08:00.634241488Z [2024-05-25 01:08:00,633: INFO/ForkPoolWorker-16] [a1746c05-a21e-497d-b6f7-707cb9d61267] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:08:00.642843999Z [2024-05-25 01:08:00,642: INFO/ForkPoolWorker-15] [81f73574-dd4f-4802-b8f6-14f56598b7b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:08:00.643916222Z [2024-05-25 01:08:00,643: INFO/ForkPoolWorker-2] [b4533cba-0ce7-4612-a5c6-edff8792708e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:08:00.958525455Z [2024-05-25 01:08:00,955: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:08:00.970440387Z [2024-05-25 01:08:00,966: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:08:01.011558031Z [2024-05-25 01:08:00,998: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:08:01.056100358Z [2024-05-25 01:08:01,052: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:08:01.183756463Z [2024-05-25 01:08:01,183: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T01:08:01.188588956Z [2024-05-25 01:08:01,188: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:08:01.212860381Z [2024-05-25 01:08:01,212: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:08:01.214010302Z [2024-05-25 01:08:01,213: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:08:01.214109165Z [2024-05-25 01:08:01,213: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:08:01.214120562Z [2024-05-25 01:08:01,214: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T01:08:01.214336597Z [2024-05-25 01:08:01,214: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:08:01.365728532Z [2024-05-25 01:08:01,357: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:08:01.375422859Z [2024-05-25 01:08:01,374: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:08:02.006281615Z [2024-05-25 01:08:02,005: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2b8a85c4-c0d6-4a21-8622-d0b5c0076c5d] succeeded in 1.3886300609992759s: None 2024-05-25T01:08:02.050137094Z [2024-05-25 01:08:02,049: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a1746c05-a21e-497d-b6f7-707cb9d61267] succeeded in 1.431316672000321s: None 2024-05-25T01:08:02.312279025Z [2024-05-25 01:08:02,311: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:08:02.315895330Z [2024-05-25 01:08:02,315: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:08:02.372265460Z [2024-05-25 01:08:02,372: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:08:02.374626320Z [2024-05-25 01:08:02,373: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:08:02.374735046Z [2024-05-25 01:08:02,374: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:08:02.374970397Z [2024-05-25 01:08:02,374: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:08:02.375073945Z [2024-05-25 01:08:02,374: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:08:02.376340795Z [2024-05-25 01:08:02,375: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:08:02.376446384Z [2024-05-25 01:08:02,376: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:08:02.460416565Z [2024-05-25 01:08:02,460: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:08:02.570017467Z [2024-05-25 01:08:02,569: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T01:08:02.573284638Z [2024-05-25 01:08:02,572: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:08:02.619735410Z [2024-05-25 01:08:02,619: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:08:02.621585592Z [2024-05-25 01:08:02,621: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:08:02.621676272Z [2024-05-25 01:08:02,621: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:08:02.621858605Z [2024-05-25 01:08:02,621: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:08:02.621941654Z [2024-05-25 01:08:02,621: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T01:08:02.622291792Z [2024-05-25 01:08:02,622: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:08:02.622480548Z [2024-05-25 01:08:02,622: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:08:02.731620971Z [2024-05-25 01:08:02,731: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:08:04.001068393Z [2024-05-25 01:08:03,998: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[81f73574-dd4f-4802-b8f6-14f56598b7b6] succeeded in 3.383746641999096s: None 2024-05-25T01:08:04.721344333Z [2024-05-25 01:08:04,720: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b4533cba-0ce7-4612-a5c6-edff8792708e] succeeded in 4.098315957999148s: None 2024-05-25T01:09:00.505950865Z [2024-05-25 01:09:00,505: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0187c1d3-24e7-4f3f-b285-a76ebe479d19] received 2024-05-25T01:09:00.510313686Z [2024-05-25 01:09:00,510: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a54c807-4f3c-475f-9e9c-d6127a6b5ded] received 2024-05-25T01:09:00.518900061Z [2024-05-25 01:09:00,518: INFO/ForkPoolWorker-15] [0187c1d3-24e7-4f3f-b285-a76ebe479d19] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:09:00.522977335Z [2024-05-25 01:09:00,522: INFO/ForkPoolWorker-16] [6a54c807-4f3c-475f-9e9c-d6127a6b5ded] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:09:00.532354382Z [2024-05-25 01:09:00,532: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3387e00c-66e1-4eb5-b73f-50415e6d2af5] received 2024-05-25T01:09:00.540535962Z [2024-05-25 01:09:00,540: INFO/ForkPoolWorker-1] [3387e00c-66e1-4eb5-b73f-50415e6d2af5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:09:00.813636413Z [2024-05-25 01:09:00,810: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:09:00.829528628Z [2024-05-25 01:09:00,826: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:09:00.861647617Z [2024-05-25 01:09:00,858: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:09:01.035649034Z [2024-05-25 01:09:01,035: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T01:09:01.040581674Z [2024-05-25 01:09:01,039: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:09:01.086057897Z [2024-05-25 01:09:01,085: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:09:01.087504296Z [2024-05-25 01:09:01,087: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:09:01.087842050Z [2024-05-25 01:09:01,087: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:09:01.088477406Z [2024-05-25 01:09:01,088: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T01:09:01.089489835Z [2024-05-25 01:09:01,089: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:09:01.182479774Z [2024-05-25 01:09:01,182: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:09:01.706787454Z [2024-05-25 01:09:01,706: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0187c1d3-24e7-4f3f-b285-a76ebe479d19] succeeded in 1.1988628140006767s: None 2024-05-25T01:09:02.016142780Z [2024-05-25 01:09:02,015: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:09:02.019593351Z [2024-05-25 01:09:02,019: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:09:02.034263009Z [2024-05-25 01:09:02,033: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:09:02.038186665Z [2024-05-25 01:09:02,037: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:09:02.044575803Z [2024-05-25 01:09:02,044: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:09:02.046337786Z [2024-05-25 01:09:02,046: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:09:02.046467916Z [2024-05-25 01:09:02,046: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:09:02.046657556Z [2024-05-25 01:09:02,046: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:09:02.046853148Z [2024-05-25 01:09:02,046: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:09:02.047236314Z [2024-05-25 01:09:02,047: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:09:02.047478345Z [2024-05-25 01:09:02,047: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:09:02.066851235Z [2024-05-25 01:09:02,066: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:09:02.069791307Z [2024-05-25 01:09:02,069: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:09:02.070259515Z [2024-05-25 01:09:02,070: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:09:02.070860367Z [2024-05-25 01:09:02,070: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:09:02.071318162Z [2024-05-25 01:09:02,070: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:09:02.072443063Z [2024-05-25 01:09:02,072: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:09:02.072930233Z [2024-05-25 01:09:02,072: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:09:02.133364268Z [2024-05-25 01:09:02,133: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:09:02.176260379Z [2024-05-25 01:09:02,175: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:09:03.864695714Z [2024-05-25 01:09:03,863: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3387e00c-66e1-4eb5-b73f-50415e6d2af5] succeeded in 3.3297951109998394s: None 2024-05-25T01:09:04.300498462Z [2024-05-25 01:09:04,299: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6a54c807-4f3c-475f-9e9c-d6127a6b5ded] succeeded in 3.7873669839991635s: None 2024-05-25T01:10:00.641175694Z [2024-05-25 01:10:00,640: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf0dd8dd-9de9-4c1e-a169-6f86455fb5ba] received 2024-05-25T01:10:00.649179657Z [2024-05-25 01:10:00,648: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4041c087-78e5-47e4-baef-4841c766f754] received 2024-05-25T01:10:00.652846554Z [2024-05-25 01:10:00,652: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0daeea48-5d33-4cb6-81ba-ab5f9010fefc] received 2024-05-25T01:10:00.654567860Z [2024-05-25 01:10:00,654: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91393f24-94a3-41f8-b445-5375f6359d98] received 2024-05-25T01:10:00.657854765Z [2024-05-25 01:10:00,657: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[325ef5fa-bbf8-4faa-9c31-bad642f54e69] received 2024-05-25T01:10:00.667978010Z [2024-05-25 01:10:00,667: INFO/ForkPoolWorker-16] [4041c087-78e5-47e4-baef-4841c766f754] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:10:00.669830876Z [2024-05-25 01:10:00,667: INFO/ForkPoolWorker-15] [cf0dd8dd-9de9-4c1e-a169-6f86455fb5ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:10:00.671457247Z [2024-05-25 01:10:00,671: INFO/ForkPoolWorker-2] [91393f24-94a3-41f8-b445-5375f6359d98] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:10:00.671840090Z [2024-05-25 01:10:00,671: INFO/ForkPoolWorker-1] [0daeea48-5d33-4cb6-81ba-ab5f9010fefc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:10:00.680368852Z [2024-05-25 01:10:00,679: INFO/ForkPoolWorker-3] [325ef5fa-bbf8-4faa-9c31-bad642f54e69] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:10:01.043409138Z [2024-05-25 01:10:01,038: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:10:01.109950919Z [2024-05-25 01:10:01,102: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:10:01.170514840Z [2024-05-25 01:10:01,167: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:10:01.267229136Z [2024-05-25 01:10:01,259: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:10:01.487979777Z [2024-05-25 01:10:01,484: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:10:01.515171425Z [2024-05-25 01:10:01,514: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T01:10:01.530023765Z [2024-05-25 01:10:01,529: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:10:01.582283714Z [2024-05-25 01:10:01,582: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:10:01.585987600Z [2024-05-25 01:10:01,585: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:10:01.586257571Z [2024-05-25 01:10:01,585: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:10:01.586355612Z [2024-05-25 01:10:01,586: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T01:10:01.586663387Z [2024-05-25 01:10:01,586: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:10:01.909757070Z [2024-05-25 01:10:01,909: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:10:02.325291700Z [2024-05-25 01:10:02,324: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:10:02.664464401Z [2024-05-25 01:10:02,664: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:10:02.668012130Z [2024-05-25 01:10:02,667: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:10:02.684308161Z [2024-05-25 01:10:02,684: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:10:02.685556281Z [2024-05-25 01:10:02,685: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:10:02.685769075Z [2024-05-25 01:10:02,685: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:10:02.685935346Z [2024-05-25 01:10:02,685: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:10:02.686037593Z [2024-05-25 01:10:02,685: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:10:02.686587181Z [2024-05-25 01:10:02,686: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:10:02.686788579Z [2024-05-25 01:10:02,686: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:10:02.782964803Z [2024-05-25 01:10:02,782: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:10:02.793295194Z [2024-05-25 01:10:02,792: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0daeea48-5d33-4cb6-81ba-ab5f9010fefc] succeeded in 2.1365609589993255s: None 2024-05-25T01:10:02.965971997Z [2024-05-25 01:10:02,965: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:10:02.969320978Z [2024-05-25 01:10:02,968: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:10:02.987466904Z [2024-05-25 01:10:02,987: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:10:02.988468668Z [2024-05-25 01:10:02,988: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:10:02.988483164Z [2024-05-25 01:10:02,988: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:10:02.988661646Z [2024-05-25 01:10:02,988: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:10:02.988713249Z [2024-05-25 01:10:02,988: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:10:02.989008745Z [2024-05-25 01:10:02,988: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:10:02.989051868Z [2024-05-25 01:10:02,988: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:10:03.082512047Z [2024-05-25 01:10:03,081: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:10:03.096636567Z [2024-05-25 01:10:03,096: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[325ef5fa-bbf8-4faa-9c31-bad642f54e69] succeeded in 2.4327797460009606s: None 2024-05-25T01:10:03.246620092Z [2024-05-25 01:10:03,246: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T01:10:03.251716250Z [2024-05-25 01:10:03,251: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:10:03.279168990Z [2024-05-25 01:10:03,278: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:10:03.280954943Z [2024-05-25 01:10:03,280: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:10:03.281130301Z [2024-05-25 01:10:03,280: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:10:03.281445833Z [2024-05-25 01:10:03,281: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:10:03.281685162Z [2024-05-25 01:10:03,281: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T01:10:03.282016478Z [2024-05-25 01:10:03,281: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:10:03.282158641Z [2024-05-25 01:10:03,282: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:10:03.406229927Z [2024-05-25 01:10:03,405: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:10:04.143342447Z [2024-05-25 01:10:04,142: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[91393f24-94a3-41f8-b445-5375f6359d98] succeeded in 3.485407557000144s: None 2024-05-25T01:10:04.378624999Z [2024-05-25 01:10:04,378: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4041c087-78e5-47e4-baef-4841c766f754] succeeded in 3.72620995699981s: None 2024-05-25T01:10:04.595510746Z [2024-05-25 01:10:04,594: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe09d221-b9a8-45dc-af7a-999876d239a7] received 2024-05-25T01:10:04.602715807Z [2024-05-25 01:10:04,602: INFO/ForkPoolWorker-16] [fe09d221-b9a8-45dc-af7a-999876d239a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:10:04.888430806Z [2024-05-25 01:10:04,885: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:10:04.947164564Z [2024-05-25 01:10:04,946: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cf0dd8dd-9de9-4c1e-a169-6f86455fb5ba] succeeded in 4.302162840000165s: None 2024-05-25T01:10:05.990706031Z [2024-05-25 01:10:05,990: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:10:05.994484625Z [2024-05-25 01:10:05,993: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:10:06.032704219Z [2024-05-25 01:10:06,032: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:10:06.035074184Z [2024-05-25 01:10:06,034: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:10:06.035200556Z [2024-05-25 01:10:06,034: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:10:06.035314594Z [2024-05-25 01:10:06,035: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:10:06.035394717Z [2024-05-25 01:10:06,035: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:10:06.035778666Z [2024-05-25 01:10:06,035: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:10:06.035890923Z [2024-05-25 01:10:06,035: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:10:06.146405159Z [2024-05-25 01:10:06,146: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:10:06.856340363Z [2024-05-25 01:10:06,855: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fe09d221-b9a8-45dc-af7a-999876d239a7] succeeded in 2.2584700400002475s: None 2024-05-25T01:10:07.009008828Z [2024-05-25 01:10:07,008: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c31fc95-8c9a-4909-9357-788250c3dd9b] received 2024-05-25T01:10:07.018829232Z [2024-05-25 01:10:07,018: INFO/ForkPoolWorker-15] [2c31fc95-8c9a-4909-9357-788250c3dd9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:10:07.333152632Z [2024-05-25 01:10:07,329: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:10:08.531398173Z [2024-05-25 01:10:08,531: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:10:08.534916045Z [2024-05-25 01:10:08,534: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:10:08.558240692Z [2024-05-25 01:10:08,558: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:10:08.559393684Z [2024-05-25 01:10:08,559: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:10:08.559481234Z [2024-05-25 01:10:08,559: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:10:08.559625709Z [2024-05-25 01:10:08,559: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:10:08.559673759Z [2024-05-25 01:10:08,559: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:10:08.560010805Z [2024-05-25 01:10:08,559: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:10:08.560066138Z [2024-05-25 01:10:08,559: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:10:08.647496004Z [2024-05-25 01:10:08,646: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:10:09.213584196Z [2024-05-25 01:10:09,213: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2c31fc95-8c9a-4909-9357-788250c3dd9b] succeeded in 2.2028282299997954s: None 2024-05-25T01:10:09.823562431Z [2024-05-25 01:10:09,822: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[150cfcfd-984c-459b-83d0-540d1097f9c5] received 2024-05-25T01:10:09.831842828Z [2024-05-25 01:10:09,831: INFO/ForkPoolWorker-15] [150cfcfd-984c-459b-83d0-540d1097f9c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:10:10.166306096Z [2024-05-25 01:10:10,162: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:10:11.311483088Z [2024-05-25 01:10:11,311: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:10:11.314733883Z [2024-05-25 01:10:11,314: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:10:11.343077525Z [2024-05-25 01:10:11,342: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:10:11.344525532Z [2024-05-25 01:10:11,344: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:10:11.344554316Z [2024-05-25 01:10:11,344: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:10:11.344683148Z [2024-05-25 01:10:11,344: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:10:11.344896871Z [2024-05-25 01:10:11,344: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:10:11.345142297Z [2024-05-25 01:10:11,344: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:10:11.345161041Z [2024-05-25 01:10:11,345: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:10:11.427416821Z [2024-05-25 01:10:11,426: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:10:12.021002060Z [2024-05-25 01:10:12,020: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[150cfcfd-984c-459b-83d0-540d1097f9c5] succeeded in 2.194579398001224s: None 2024-05-25T01:11:00.442862080Z [2024-05-25 01:11:00,442: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b84cbc85-b058-4c38-a128-455b8249b235] received 2024-05-25T01:11:00.445953382Z [2024-05-25 01:11:00,445: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c35348f8-4d30-43bb-b165-2a44b2557ee3] received 2024-05-25T01:11:00.453385240Z [2024-05-25 01:11:00,453: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bbd25918-9886-4c75-a79b-a6b4a7e7bc27] received 2024-05-25T01:11:00.455051492Z [2024-05-25 01:11:00,454: INFO/ForkPoolWorker-15] [b84cbc85-b058-4c38-a128-455b8249b235] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:11:00.463247180Z [2024-05-25 01:11:00,462: INFO/ForkPoolWorker-1] [bbd25918-9886-4c75-a79b-a6b4a7e7bc27] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:11:00.464019534Z [2024-05-25 01:11:00,463: INFO/ForkPoolWorker-16] [c35348f8-4d30-43bb-b165-2a44b2557ee3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:11:00.732246321Z [2024-05-25 01:11:00,729: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:11:00.741168766Z [2024-05-25 01:11:00,738: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:11:00.833962506Z [2024-05-25 01:11:00,830: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:11:01.004937785Z [2024-05-25 01:11:01,004: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T01:11:01.011984455Z [2024-05-25 01:11:01,011: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:11:01.059708275Z [2024-05-25 01:11:01,059: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:11:01.063463478Z [2024-05-25 01:11:01,062: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:11:01.063490880Z [2024-05-25 01:11:01,062: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:11:01.063495161Z [2024-05-25 01:11:01,062: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T01:11:01.064795459Z [2024-05-25 01:11:01,063: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:11:01.180959808Z [2024-05-25 01:11:01,180: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:11:01.794173493Z [2024-05-25 01:11:01,793: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bbd25918-9886-4c75-a79b-a6b4a7e7bc27] succeeded in 1.338725911000438s: None 2024-05-25T01:11:02.041577611Z [2024-05-25 01:11:02,041: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:11:02.044899139Z [2024-05-25 01:11:02,044: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:11:02.059429910Z [2024-05-25 01:11:02,058: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:11:02.066064084Z [2024-05-25 01:11:02,063: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:11:02.068013877Z [2024-05-25 01:11:02,067: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:11:02.069593580Z [2024-05-25 01:11:02,069: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:11:02.069699574Z [2024-05-25 01:11:02,069: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:11:02.069948842Z [2024-05-25 01:11:02,069: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:11:02.070106266Z [2024-05-25 01:11:02,069: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:11:02.070490326Z [2024-05-25 01:11:02,070: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:11:02.070629377Z [2024-05-25 01:11:02,070: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:11:02.088301371Z [2024-05-25 01:11:02,088: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:11:02.090868658Z [2024-05-25 01:11:02,090: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:11:02.090908772Z [2024-05-25 01:11:02,090: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:11:02.091021778Z [2024-05-25 01:11:02,090: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:11:02.091063893Z [2024-05-25 01:11:02,090: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:11:02.091706554Z [2024-05-25 01:11:02,091: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:11:02.091808586Z [2024-05-25 01:11:02,091: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:11:02.144422277Z [2024-05-25 01:11:02,144: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:11:02.201865635Z [2024-05-25 01:11:02,194: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:11:03.698727082Z [2024-05-25 01:11:03,698: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b84cbc85-b058-4c38-a128-455b8249b235] succeeded in 3.2531705939982203s: None 2024-05-25T01:11:04.095949072Z [2024-05-25 01:11:04,095: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c35348f8-4d30-43bb-b165-2a44b2557ee3] succeeded in 3.64424590300041s: None 2024-05-25T01:12:00.420923887Z [2024-05-25 01:12:00,420: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a4f7f43-288f-4490-a2d2-4550024a5570] received 2024-05-25T01:12:00.423322853Z [2024-05-25 01:12:00,423: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e20a8c5b-11e9-4afd-9629-b1a63a5a3248] received 2024-05-25T01:12:00.425985483Z [2024-05-25 01:12:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db154d92-1f56-4e96-a420-9ef6ad913dde] received 2024-05-25T01:12:00.437368892Z [2024-05-25 01:12:00,436: INFO/ForkPoolWorker-15] [8a4f7f43-288f-4490-a2d2-4550024a5570] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:12:00.438191779Z [2024-05-25 01:12:00,437: INFO/ForkPoolWorker-16] [e20a8c5b-11e9-4afd-9629-b1a63a5a3248] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:12:00.438697214Z [2024-05-25 01:12:00,438: INFO/ForkPoolWorker-1] [db154d92-1f56-4e96-a420-9ef6ad913dde] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:12:00.441705436Z [2024-05-25 01:12:00,441: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5686325-6459-44a9-b986-b9c8069276fb] received 2024-05-25T01:12:00.469780833Z [2024-05-25 01:12:00,469: INFO/ForkPoolWorker-2] [c5686325-6459-44a9-b986-b9c8069276fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:12:00.755724948Z [2024-05-25 01:12:00,752: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:12:00.766808300Z [2024-05-25 01:12:00,762: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:12:00.874083478Z [2024-05-25 01:12:00,870: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:12:00.931158985Z [2024-05-25 01:12:00,927: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:12:01.084491208Z [2024-05-25 01:12:01,084: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T01:12:01.098768888Z [2024-05-25 01:12:01,096: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:12:01.134458744Z [2024-05-25 01:12:01,134: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:12:01.137753362Z [2024-05-25 01:12:01,137: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:12:01.137985894Z [2024-05-25 01:12:01,137: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:12:01.138145287Z [2024-05-25 01:12:01,138: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T01:12:01.138472882Z [2024-05-25 01:12:01,138: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:12:01.247331269Z [2024-05-25 01:12:01,247: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:12:01.255435063Z [2024-05-25 01:12:01,255: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:12:01.834340497Z [2024-05-25 01:12:01,833: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8a4f7f43-288f-4490-a2d2-4550024a5570] succeeded in 1.4102599050002027s: None 2024-05-25T01:12:02.025326829Z [2024-05-25 01:12:02,024: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c5686325-6459-44a9-b986-b9c8069276fb] succeeded in 1.5811986810003873s: None 2024-05-25T01:12:02.284740411Z [2024-05-25 01:12:02,284: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:12:02.288398824Z [2024-05-25 01:12:02,287: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:12:02.310685016Z [2024-05-25 01:12:02,310: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:12:02.312082010Z [2024-05-25 01:12:02,311: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:12:02.312239020Z [2024-05-25 01:12:02,312: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:12:02.312410599Z [2024-05-25 01:12:02,312: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:12:02.312447820Z [2024-05-25 01:12:02,312: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:12:02.312707249Z [2024-05-25 01:12:02,312: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:12:02.313101892Z [2024-05-25 01:12:02,312: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:12:02.333061526Z [2024-05-25 01:12:02,332: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:12:02.336526442Z [2024-05-25 01:12:02,336: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:12:02.360524526Z [2024-05-25 01:12:02,360: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:12:02.362326178Z [2024-05-25 01:12:02,362: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:12:02.362506149Z [2024-05-25 01:12:02,362: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:12:02.362730287Z [2024-05-25 01:12:02,362: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:12:02.362860380Z [2024-05-25 01:12:02,362: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:12:02.363380106Z [2024-05-25 01:12:02,363: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:12:02.363520807Z [2024-05-25 01:12:02,363: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:12:02.401786170Z [2024-05-25 01:12:02,401: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:12:02.457504931Z [2024-05-25 01:12:02,457: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:12:04.470543292Z [2024-05-25 01:12:04,469: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e20a8c5b-11e9-4afd-9629-b1a63a5a3248] succeeded in 4.043954804999885s: None 2024-05-25T01:12:04.974935475Z [2024-05-25 01:12:04,974: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[db154d92-1f56-4e96-a420-9ef6ad913dde] succeeded in 4.546145732998411s: None 2024-05-25T01:13:01.166644656Z [2024-05-25 01:13:01,166: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bbca28a0-2113-4b33-b6bf-28900d136e79] received 2024-05-25T01:13:01.176405403Z [2024-05-25 01:13:01,176: INFO/ForkPoolWorker-15] [bbca28a0-2113-4b33-b6bf-28900d136e79] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:13:01.177073961Z [2024-05-25 01:13:01,176: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11316ed1-d03f-4827-a0e9-e25585809bc5] received 2024-05-25T01:13:01.181413559Z [2024-05-25 01:13:01,181: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2589f407-fdcb-45a2-936b-7f6f9c512a0f] received 2024-05-25T01:13:01.187166036Z [2024-05-25 01:13:01,186: INFO/ForkPoolWorker-16] [11316ed1-d03f-4827-a0e9-e25585809bc5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:13:01.193163915Z [2024-05-25 01:13:01,192: INFO/ForkPoolWorker-1] [2589f407-fdcb-45a2-936b-7f6f9c512a0f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:13:01.476485954Z [2024-05-25 01:13:01,472: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:13:01.504474611Z [2024-05-25 01:13:01,500: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:13:01.538579458Z [2024-05-25 01:13:01,534: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:13:01.634490378Z [2024-05-25 01:13:01,634: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T01:13:01.638328451Z [2024-05-25 01:13:01,637: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:13:01.655720553Z [2024-05-25 01:13:01,655: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:13:01.656579508Z [2024-05-25 01:13:01,656: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:13:01.656656535Z [2024-05-25 01:13:01,656: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:13:01.656706946Z [2024-05-25 01:13:01,656: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T01:13:01.656886218Z [2024-05-25 01:13:01,656: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:13:01.756152310Z [2024-05-25 01:13:01,755: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:13:02.357148482Z [2024-05-25 01:13:02,356: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[11316ed1-d03f-4827-a0e9-e25585809bc5] succeeded in 1.1783611690007092s: None 2024-05-25T01:13:02.721099742Z [2024-05-25 01:13:02,720: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:13:02.724422893Z [2024-05-25 01:13:02,723: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:13:02.744982888Z [2024-05-25 01:13:02,744: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:13:02.746425401Z [2024-05-25 01:13:02,746: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:13:02.746436761Z [2024-05-25 01:13:02,746: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:13:02.746706373Z [2024-05-25 01:13:02,746: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:13:02.746830921Z [2024-05-25 01:13:02,746: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:13:02.747627636Z [2024-05-25 01:13:02,747: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:13:02.747751103Z [2024-05-25 01:13:02,747: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:13:02.849761059Z [2024-05-25 01:13:02,849: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:13:02.850283328Z [2024-05-25 01:13:02,849: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:13:02.855186875Z [2024-05-25 01:13:02,854: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:13:02.893897642Z [2024-05-25 01:13:02,893: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:13:02.895832355Z [2024-05-25 01:13:02,895: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:13:02.896111336Z [2024-05-25 01:13:02,895: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:13:02.896437299Z [2024-05-25 01:13:02,896: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:13:02.896671717Z [2024-05-25 01:13:02,896: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:13:02.897151026Z [2024-05-25 01:13:02,896: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:13:02.897962662Z [2024-05-25 01:13:02,897: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:13:02.990913892Z [2024-05-25 01:13:02,988: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:13:05.242747490Z [2024-05-25 01:13:05,242: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2589f407-fdcb-45a2-936b-7f6f9c512a0f] succeeded in 4.059780219000459s: None 2024-05-25T01:13:05.551127255Z [2024-05-25 01:13:05,550: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bbca28a0-2113-4b33-b6bf-28900d136e79] succeeded in 4.381776608999644s: None 2024-05-25T01:14:01.134411594Z [2024-05-25 01:14:01,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fed321a9-16ca-4519-a31b-5d96e38e605f] received 2024-05-25T01:14:01.136236858Z [2024-05-25 01:14:01,136: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[472cc444-1596-448f-ae52-58b01669c54f] received 2024-05-25T01:14:01.145843152Z [2024-05-25 01:14:01,145: INFO/ForkPoolWorker-15] [fed321a9-16ca-4519-a31b-5d96e38e605f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:14:01.148958485Z [2024-05-25 01:14:01,148: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[781b3849-7daf-4755-bde2-ef89125385b5] received 2024-05-25T01:14:01.152658535Z [2024-05-25 01:14:01,152: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[432638e6-f263-4ea6-be25-f2d4123c197c] received 2024-05-25T01:14:01.153499289Z [2024-05-25 01:14:01,153: INFO/ForkPoolWorker-16] [472cc444-1596-448f-ae52-58b01669c54f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:14:01.161867289Z [2024-05-25 01:14:01,161: INFO/ForkPoolWorker-2] [432638e6-f263-4ea6-be25-f2d4123c197c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:14:01.162888047Z [2024-05-25 01:14:01,162: INFO/ForkPoolWorker-1] [781b3849-7daf-4755-bde2-ef89125385b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:14:01.529635986Z [2024-05-25 01:14:01,525: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:14:01.538441706Z [2024-05-25 01:14:01,531: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:14:01.622114948Z [2024-05-25 01:14:01,618: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:14:01.788080676Z [2024-05-25 01:14:01,787: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T01:14:01.792752837Z [2024-05-25 01:14:01,792: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:14:01.832439249Z [2024-05-25 01:14:01,829: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:14:01.844509052Z [2024-05-25 01:14:01,844: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:14:01.848660688Z [2024-05-25 01:14:01,848: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:14:01.848911842Z [2024-05-25 01:14:01,848: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:14:01.848987834Z [2024-05-25 01:14:01,848: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T01:14:01.849262167Z [2024-05-25 01:14:01,849: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:14:01.935753185Z [2024-05-25 01:14:01,935: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:14:02.302220769Z [2024-05-25 01:14:02,301: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:14:02.595399693Z [2024-05-25 01:14:02,595: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[432638e6-f263-4ea6-be25-f2d4123c197c] succeeded in 1.440993387999697s: None 2024-05-25T01:14:02.908122692Z [2024-05-25 01:14:02,907: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fed321a9-16ca-4519-a31b-5d96e38e605f] succeeded in 1.7701614819998213s: None 2024-05-25T01:14:03.076436927Z [2024-05-25 01:14:03,076: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:14:03.080267004Z [2024-05-25 01:14:03,079: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:14:03.096306182Z [2024-05-25 01:14:03,095: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:14:03.099665671Z [2024-05-25 01:14:03,099: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:14:03.104726089Z [2024-05-25 01:14:03,104: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:14:03.105800901Z [2024-05-25 01:14:03,105: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:14:03.105814084Z [2024-05-25 01:14:03,105: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:14:03.105939463Z [2024-05-25 01:14:03,105: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:14:03.105956053Z [2024-05-25 01:14:03,105: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:14:03.106158126Z [2024-05-25 01:14:03,106: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:14:03.106198166Z [2024-05-25 01:14:03,106: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:14:03.117547048Z [2024-05-25 01:14:03,117: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:14:03.118778175Z [2024-05-25 01:14:03,118: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:14:03.118890814Z [2024-05-25 01:14:03,118: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:14:03.119074714Z [2024-05-25 01:14:03,118: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:14:03.119159168Z [2024-05-25 01:14:03,119: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:14:03.119473647Z [2024-05-25 01:14:03,119: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:14:03.119522936Z [2024-05-25 01:14:03,119: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:14:03.192073869Z [2024-05-25 01:14:03,191: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:14:03.192338098Z [2024-05-25 01:14:03,192: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:14:04.986830860Z [2024-05-25 01:14:04,985: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[781b3849-7daf-4755-bde2-ef89125385b5] succeeded in 3.834418270000242s: None 2024-05-25T01:14:05.208465146Z [2024-05-25 01:14:05,207: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[472cc444-1596-448f-ae52-58b01669c54f] succeeded in 4.069273520000934s: None 2024-05-25T01:15:01.182555709Z [2024-05-25 01:15:01,182: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c2dd4fa-7bcb-48a1-9451-1b47d2e79ca2] received 2024-05-25T01:15:01.184406054Z [2024-05-25 01:15:01,184: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a570eacb-4c9b-4aaf-b476-ef247f0ff882] received 2024-05-25T01:15:01.192109667Z [2024-05-25 01:15:01,191: INFO/ForkPoolWorker-16] [a570eacb-4c9b-4aaf-b476-ef247f0ff882] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:15:01.198061350Z [2024-05-25 01:15:01,197: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d670ebe-bab0-448d-99b3-0777168d8bc6] received 2024-05-25T01:15:01.199311380Z [2024-05-25 01:15:01,198: INFO/ForkPoolWorker-15] [6c2dd4fa-7bcb-48a1-9451-1b47d2e79ca2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:15:01.205875158Z [2024-05-25 01:15:01,205: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3679d356-847e-49db-bcf6-26f262833dbd] received 2024-05-25T01:15:01.216730738Z [2024-05-25 01:15:01,216: INFO/ForkPoolWorker-1] [1d670ebe-bab0-448d-99b3-0777168d8bc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:15:01.219870382Z [2024-05-25 01:15:01,219: INFO/ForkPoolWorker-2] [3679d356-847e-49db-bcf6-26f262833dbd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:15:01.591683826Z [2024-05-25 01:15:01,586: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:15:01.617703010Z [2024-05-25 01:15:01,611: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:15:01.634574342Z [2024-05-25 01:15:01,631: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:15:01.656624880Z [2024-05-25 01:15:01,649: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:15:01.738482368Z [2024-05-25 01:15:01,738: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T01:15:01.742507625Z [2024-05-25 01:15:01,742: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:15:01.797609956Z [2024-05-25 01:15:01,797: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:15:01.799207980Z [2024-05-25 01:15:01,798: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:15:01.799365034Z [2024-05-25 01:15:01,799: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:15:01.799424084Z [2024-05-25 01:15:01,799: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T01:15:01.799702092Z [2024-05-25 01:15:01,799: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:15:01.914561111Z [2024-05-25 01:15:01,914: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:15:02.547943789Z [2024-05-25 01:15:02,547: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3679d356-847e-49db-bcf6-26f262833dbd] succeeded in 1.3389404120007384s: None 2024-05-25T01:15:02.955435387Z [2024-05-25 01:15:02,955: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:15:02.958958884Z [2024-05-25 01:15:02,958: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:15:02.972995137Z [2024-05-25 01:15:02,972: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:15:02.977506377Z [2024-05-25 01:15:02,977: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:15:02.979402277Z [2024-05-25 01:15:02,979: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:15:02.980190279Z [2024-05-25 01:15:02,980: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:15:02.982240418Z [2024-05-25 01:15:02,982: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:15:02.982398753Z [2024-05-25 01:15:02,982: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:15:02.982601374Z [2024-05-25 01:15:02,982: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:15:02.982712354Z [2024-05-25 01:15:02,982: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:15:02.983028331Z [2024-05-25 01:15:02,982: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:15:02.983138631Z [2024-05-25 01:15:02,982: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:15:02.983434006Z [2024-05-25 01:15:02,983: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:15:03.004697877Z [2024-05-25 01:15:03,004: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:15:03.005945264Z [2024-05-25 01:15:03,005: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:15:03.006020257Z [2024-05-25 01:15:03,005: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:15:03.006194310Z [2024-05-25 01:15:03,006: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:15:03.006249600Z [2024-05-25 01:15:03,006: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:15:03.006505267Z [2024-05-25 01:15:03,006: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:15:03.006553171Z [2024-05-25 01:15:03,006: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:15:03.010096937Z [2024-05-25 01:15:03,009: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:15:03.013347191Z [2024-05-25 01:15:03,011: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:15:03.013474031Z [2024-05-25 01:15:03,013: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:15:03.013644576Z [2024-05-25 01:15:03,013: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:15:03.013816391Z [2024-05-25 01:15:03,013: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:15:03.014067504Z [2024-05-25 01:15:03,013: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:15:03.014445371Z [2024-05-25 01:15:03,014: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:15:03.097768938Z [2024-05-25 01:15:03,097: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:15:03.102124779Z [2024-05-25 01:15:03,101: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:15:03.104301554Z [2024-05-25 01:15:03,104: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:15:03.765829065Z [2024-05-25 01:15:03,765: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6c2dd4fa-7bcb-48a1-9451-1b47d2e79ca2] succeeded in 2.5793511320007383s: None 2024-05-25T01:15:03.852610595Z [2024-05-25 01:15:03,852: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[326557e0-59a5-4e96-aacc-1885aae1f257] received 2024-05-25T01:15:03.864659999Z [2024-05-25 01:15:03,862: INFO/ForkPoolWorker-15] [326557e0-59a5-4e96-aacc-1885aae1f257] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:15:04.237599203Z [2024-05-25 01:15:04,234: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:15:04.675186257Z [2024-05-25 01:15:04,674: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a570eacb-4c9b-4aaf-b476-ef247f0ff882] succeeded in 3.4886592279999604s: None 2024-05-25T01:15:05.104484725Z [2024-05-25 01:15:05,104: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1d670ebe-bab0-448d-99b3-0777168d8bc6] succeeded in 3.896391243000835s: None 2024-05-25T01:15:05.648681411Z [2024-05-25 01:15:05,648: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:15:05.652256556Z [2024-05-25 01:15:05,651: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:15:05.670331089Z [2024-05-25 01:15:05,670: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:15:05.672209191Z [2024-05-25 01:15:05,671: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:15:05.672344660Z [2024-05-25 01:15:05,672: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:15:05.672571879Z [2024-05-25 01:15:05,672: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:15:05.672717163Z [2024-05-25 01:15:05,672: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:15:05.673051875Z [2024-05-25 01:15:05,672: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:15:05.673143199Z [2024-05-25 01:15:05,673: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:15:05.767610390Z [2024-05-25 01:15:05,767: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:15:06.400848518Z [2024-05-25 01:15:06,399: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[326557e0-59a5-4e96-aacc-1885aae1f257] succeeded in 2.544570453999768s: None 2024-05-25T01:15:06.956237790Z [2024-05-25 01:15:06,956: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d4b9406-7c95-43aa-a1b9-4fccee44e27a] received 2024-05-25T01:15:06.975173482Z [2024-05-25 01:15:06,974: INFO/ForkPoolWorker-15] [8d4b9406-7c95-43aa-a1b9-4fccee44e27a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:15:07.258834849Z [2024-05-25 01:15:07,255: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:15:08.581068314Z [2024-05-25 01:15:08,580: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:15:08.584697930Z [2024-05-25 01:15:08,584: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:15:08.614950417Z [2024-05-25 01:15:08,614: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:15:08.616953760Z [2024-05-25 01:15:08,616: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:15:08.617119182Z [2024-05-25 01:15:08,616: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:15:08.617503423Z [2024-05-25 01:15:08,617: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:15:08.617717878Z [2024-05-25 01:15:08,617: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:15:08.618327709Z [2024-05-25 01:15:08,618: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:15:08.618525743Z [2024-05-25 01:15:08,618: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:15:08.731198152Z [2024-05-25 01:15:08,730: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:15:09.371720063Z [2024-05-25 01:15:09,371: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8d4b9406-7c95-43aa-a1b9-4fccee44e27a] succeeded in 2.4125267029994575s: None 2024-05-25T01:15:10.123975409Z [2024-05-25 01:15:10,123: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06cae2fc-2926-432d-b70a-1e026872f9ed] received 2024-05-25T01:15:10.130673924Z [2024-05-25 01:15:10,130: INFO/ForkPoolWorker-15] [06cae2fc-2926-432d-b70a-1e026872f9ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:15:10.406749702Z [2024-05-25 01:15:10,403: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:15:11.473612527Z [2024-05-25 01:15:11,473: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:15:11.477340235Z [2024-05-25 01:15:11,476: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:15:11.507099205Z [2024-05-25 01:15:11,506: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:15:11.508746831Z [2024-05-25 01:15:11,508: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:15:11.508789831Z [2024-05-25 01:15:11,508: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:15:11.509029615Z [2024-05-25 01:15:11,508: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:15:11.509095557Z [2024-05-25 01:15:11,508: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:15:11.509919779Z [2024-05-25 01:15:11,509: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:15:11.510038116Z [2024-05-25 01:15:11,509: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:15:11.614618116Z [2024-05-25 01:15:11,614: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:15:12.283666778Z [2024-05-25 01:15:12,283: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[06cae2fc-2926-432d-b70a-1e026872f9ed] succeeded in 2.157696402999136s: None 2024-05-25T01:16:01.029313023Z [2024-05-25 01:16:01,028: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6fc4d50-8950-4aab-a78b-953573a7f1f3] received 2024-05-25T01:16:01.036655477Z [2024-05-25 01:16:01,036: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f6c3f62-87fd-4924-94ac-f3074960b4f1] received 2024-05-25T01:16:01.039619342Z [2024-05-25 01:16:01,039: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[448e8160-a1aa-4644-8f31-1bbe09d0f2b9] received 2024-05-25T01:16:01.047901980Z [2024-05-25 01:16:01,047: INFO/ForkPoolWorker-16] [5f6c3f62-87fd-4924-94ac-f3074960b4f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:16:01.048176830Z [2024-05-25 01:16:01,047: INFO/ForkPoolWorker-15] [b6fc4d50-8950-4aab-a78b-953573a7f1f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:16:01.050824594Z [2024-05-25 01:16:01,050: INFO/ForkPoolWorker-1] [448e8160-a1aa-4644-8f31-1bbe09d0f2b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:16:01.320318706Z [2024-05-25 01:16:01,319: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77e007a8-175c-4c17-b371-69125f36ff7a] received 2024-05-25T01:16:01.322346846Z [2024-05-25 01:16:01,319: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:16:01.329991050Z [2024-05-25 01:16:01,327: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:16:01.353075902Z [2024-05-25 01:16:01,352: INFO/ForkPoolWorker-2] [77e007a8-175c-4c17-b371-69125f36ff7a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:16:01.353635782Z [2024-05-25 01:16:01,350: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:16:01.550974117Z [2024-05-25 01:16:01,550: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T01:16:01.556439350Z [2024-05-25 01:16:01,555: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:16:01.584747420Z [2024-05-25 01:16:01,584: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:16:01.586023376Z [2024-05-25 01:16:01,585: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:16:01.586155455Z [2024-05-25 01:16:01,586: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:16:01.586229028Z [2024-05-25 01:16:01,586: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T01:16:01.586428195Z [2024-05-25 01:16:01,586: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:16:01.667654457Z [2024-05-25 01:16:01,667: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:16:01.677320737Z [2024-05-25 01:16:01,674: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:16:01.691256309Z [2024-05-25 01:16:01,690: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:16:02.189355124Z [2024-05-25 01:16:02,187: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b6fc4d50-8950-4aab-a78b-953573a7f1f3] succeeded in 1.1545113200008927s: None 2024-05-25T01:16:02.315022840Z [2024-05-25 01:16:02,314: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5f6c3f62-87fd-4924-94ac-f3074960b4f1] succeeded in 1.2768143989997043s: None 2024-05-25T01:16:02.817313319Z [2024-05-25 01:16:02,816: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:16:02.820485717Z [2024-05-25 01:16:02,820: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:16:02.844468517Z [2024-05-25 01:16:02,844: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:16:02.846175015Z [2024-05-25 01:16:02,845: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:16:02.846203718Z [2024-05-25 01:16:02,845: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:16:02.846229097Z [2024-05-25 01:16:02,846: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:16:02.846249360Z [2024-05-25 01:16:02,846: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:16:02.846578794Z [2024-05-25 01:16:02,846: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:16:02.846591830Z [2024-05-25 01:16:02,846: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:16:02.873116689Z [2024-05-25 01:16:02,872: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T01:16:02.876889962Z [2024-05-25 01:16:02,876: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:16:02.902080016Z [2024-05-25 01:16:02,901: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:16:02.903619510Z [2024-05-25 01:16:02,903: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:16:02.903635275Z [2024-05-25 01:16:02,903: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:16:02.903814421Z [2024-05-25 01:16:02,903: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:16:02.903866881Z [2024-05-25 01:16:02,903: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T01:16:02.904264077Z [2024-05-25 01:16:02,904: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:16:02.904342849Z [2024-05-25 01:16:02,904: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:16:02.932752877Z [2024-05-25 01:16:02,932: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:16:02.974787485Z [2024-05-25 01:16:02,974: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:16:04.866312776Z [2024-05-25 01:16:04,865: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[448e8160-a1aa-4644-8f31-1bbe09d0f2b9] succeeded in 3.8245458469991718s: None 2024-05-25T01:16:05.339550021Z [2024-05-25 01:16:05,338: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[77e007a8-175c-4c17-b371-69125f36ff7a] succeeded in 4.014918177999789s: None 2024-05-25T01:17:00.951990528Z [2024-05-25 01:17:00,951: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46fa019e-2ebb-4e80-a822-3435fb607628] received 2024-05-25T01:17:00.960504048Z [2024-05-25 01:17:00,959: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ddd5659-4f56-4057-9f25-416415abee16] received 2024-05-25T01:17:00.965725696Z [2024-05-25 01:17:00,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3b1daa3-7036-4290-93f0-c3bf069442af] received 2024-05-25T01:17:00.968476068Z [2024-05-25 01:17:00,968: INFO/ForkPoolWorker-15] [46fa019e-2ebb-4e80-a822-3435fb607628] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:17:00.987535649Z [2024-05-25 01:17:00,986: INFO/ForkPoolWorker-1] [e3b1daa3-7036-4290-93f0-c3bf069442af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:17:00.988272259Z [2024-05-25 01:17:00,986: INFO/ForkPoolWorker-16] [5ddd5659-4f56-4057-9f25-416415abee16] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:17:01.291156976Z [2024-05-25 01:17:01,287: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:17:01.364704045Z [2024-05-25 01:17:01,361: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:17:01.405395104Z [2024-05-25 01:17:01,401: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:17:01.487091093Z [2024-05-25 01:17:01,486: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T01:17:01.490869018Z [2024-05-25 01:17:01,490: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:17:01.519394893Z [2024-05-25 01:17:01,519: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:17:01.521993079Z [2024-05-25 01:17:01,521: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:17:01.522304206Z [2024-05-25 01:17:01,522: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:17:01.522520202Z [2024-05-25 01:17:01,522: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T01:17:01.522940688Z [2024-05-25 01:17:01,522: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:17:01.626677209Z [2024-05-25 01:17:01,626: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:17:02.245320479Z [2024-05-25 01:17:02,236: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5ddd5659-4f56-4057-9f25-416415abee16] succeeded in 1.272997905000011s: None 2024-05-25T01:17:02.604298982Z [2024-05-25 01:17:02,603: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:17:02.607593589Z [2024-05-25 01:17:02,607: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:17:02.630325012Z [2024-05-25 01:17:02,630: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:17:02.631744772Z [2024-05-25 01:17:02,631: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:17:02.631901442Z [2024-05-25 01:17:02,631: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:17:02.632063328Z [2024-05-25 01:17:02,631: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:17:02.632154786Z [2024-05-25 01:17:02,632: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:17:02.632450520Z [2024-05-25 01:17:02,632: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:17:02.632567436Z [2024-05-25 01:17:02,632: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:17:02.697247367Z [2024-05-25 01:17:02,696: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:17:02.700715389Z [2024-05-25 01:17:02,700: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:17:02.719979327Z [2024-05-25 01:17:02,719: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:17:02.722174091Z [2024-05-25 01:17:02,721: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:17:02.722190230Z [2024-05-25 01:17:02,722: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:17:02.722455692Z [2024-05-25 01:17:02,722: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:17:02.722574677Z [2024-05-25 01:17:02,722: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:17:02.722979348Z [2024-05-25 01:17:02,722: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:17:02.723110000Z [2024-05-25 01:17:02,722: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:17:02.735300696Z [2024-05-25 01:17:02,735: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:17:02.815721835Z [2024-05-25 01:17:02,815: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:17:04.560107346Z [2024-05-25 01:17:04,559: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e3b1daa3-7036-4290-93f0-c3bf069442af] succeeded in 3.591628459000276s: None 2024-05-25T01:17:05.205849795Z [2024-05-25 01:17:05,205: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[46fa019e-2ebb-4e80-a822-3435fb607628] succeeded in 4.250319291000778s: None 2024-05-25T01:18:00.428082703Z [2024-05-25 01:18:00,427: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9731d9ea-62e4-4a46-ac1f-344232348025] received 2024-05-25T01:18:00.431345297Z [2024-05-25 01:18:00,431: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e1642b73-6453-4ad6-82b0-f083f96f38a1] received 2024-05-25T01:18:00.442614745Z [2024-05-25 01:18:00,442: INFO/ForkPoolWorker-15] [9731d9ea-62e4-4a46-ac1f-344232348025] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:18:00.444072965Z [2024-05-25 01:18:00,443: INFO/ForkPoolWorker-16] [e1642b73-6453-4ad6-82b0-f083f96f38a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:18:00.444852013Z [2024-05-25 01:18:00,444: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb3afc34-cc4c-4a7d-98ba-2008135107ca] received 2024-05-25T01:18:00.447613004Z [2024-05-25 01:18:00,447: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fbd3eba2-6f6d-4c51-9aa4-669750f656ea] received 2024-05-25T01:18:00.459925022Z [2024-05-25 01:18:00,459: INFO/ForkPoolWorker-1] [bb3afc34-cc4c-4a7d-98ba-2008135107ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:18:00.468836972Z [2024-05-25 01:18:00,468: INFO/ForkPoolWorker-2] [fbd3eba2-6f6d-4c51-9aa4-669750f656ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:18:00.756248341Z [2024-05-25 01:18:00,752: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:18:00.758527153Z [2024-05-25 01:18:00,755: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:18:00.794372579Z [2024-05-25 01:18:00,791: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:18:00.856565973Z [2024-05-25 01:18:00,851: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:18:00.957648670Z [2024-05-25 01:18:00,957: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T01:18:00.961810830Z [2024-05-25 01:18:00,961: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:18:00.996052265Z [2024-05-25 01:18:00,995: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:18:00.997400513Z [2024-05-25 01:18:00,997: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:18:00.997535184Z [2024-05-25 01:18:00,997: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:18:00.997560518Z [2024-05-25 01:18:00,997: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T01:18:00.998918170Z [2024-05-25 01:18:00,998: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:18:01.024680136Z [2024-05-25 01:18:01,024: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:18:01.127218299Z [2024-05-25 01:18:01,126: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:18:01.620161052Z [2024-05-25 01:18:01,619: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9731d9ea-62e4-4a46-ac1f-344232348025] succeeded in 1.1892803119990276s: None 2024-05-25T01:18:01.857250594Z [2024-05-25 01:18:01,856: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fbd3eba2-6f6d-4c51-9aa4-669750f656ea] succeeded in 1.406962704999387s: None 2024-05-25T01:18:01.957713788Z [2024-05-25 01:18:01,956: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:18:01.961196842Z [2024-05-25 01:18:01,960: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:18:01.986843540Z [2024-05-25 01:18:01,986: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:18:01.988560352Z [2024-05-25 01:18:01,988: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:18:01.988607308Z [2024-05-25 01:18:01,988: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:18:01.989082448Z [2024-05-25 01:18:01,988: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:18:01.989115751Z [2024-05-25 01:18:01,988: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:18:01.989612243Z [2024-05-25 01:18:01,989: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:18:01.990175455Z [2024-05-25 01:18:01,989: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:18:02.078709084Z [2024-05-25 01:18:02,078: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:18:02.176132073Z [2024-05-25 01:18:02,175: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:18:02.180824383Z [2024-05-25 01:18:02,180: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:18:02.244431409Z [2024-05-25 01:18:02,242: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:18:02.250828737Z [2024-05-25 01:18:02,250: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:18:02.250895706Z [2024-05-25 01:18:02,250: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:18:02.250936413Z [2024-05-25 01:18:02,250: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:18:02.250985283Z [2024-05-25 01:18:02,250: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:18:02.251185553Z [2024-05-25 01:18:02,251: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:18:02.251223590Z [2024-05-25 01:18:02,251: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:18:02.346542504Z [2024-05-25 01:18:02,346: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:18:03.886009626Z [2024-05-25 01:18:03,870: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bb3afc34-cc4c-4a7d-98ba-2008135107ca] succeeded in 3.4234670820005704s: None 2024-05-25T01:18:04.039041061Z [2024-05-25 01:18:04,038: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e1642b73-6453-4ad6-82b0-f083f96f38a1] succeeded in 3.6021594459998596s: None 2024-05-25T01:19:00.364853839Z [2024-05-25 01:19:00,364: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c87c04b-dc44-47c8-9296-925c6cb2bb88] received 2024-05-25T01:19:00.375748833Z [2024-05-25 01:19:00,374: INFO/ForkPoolWorker-15] [5c87c04b-dc44-47c8-9296-925c6cb2bb88] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:19:00.377602391Z [2024-05-25 01:19:00,377: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[822d89b4-0ee6-4ac4-ab65-d1cb9b76a7bc] received 2024-05-25T01:19:00.385976767Z [2024-05-25 01:19:00,385: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a07b478-b9ab-4819-a644-04c62027e237] received 2024-05-25T01:19:00.403778221Z [2024-05-25 01:19:00,403: INFO/ForkPoolWorker-1] [8a07b478-b9ab-4819-a644-04c62027e237] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:19:00.409182326Z [2024-05-25 01:19:00,408: INFO/ForkPoolWorker-16] [822d89b4-0ee6-4ac4-ab65-d1cb9b76a7bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:19:00.702346288Z [2024-05-25 01:19:00,699: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:19:00.749002600Z [2024-05-25 01:19:00,741: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:19:00.771721761Z [2024-05-25 01:19:00,768: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:19:00.899366147Z [2024-05-25 01:19:00,898: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T01:19:00.904325208Z [2024-05-25 01:19:00,903: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:19:00.944146576Z [2024-05-25 01:19:00,943: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:19:00.945944501Z [2024-05-25 01:19:00,945: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:19:00.946109693Z [2024-05-25 01:19:00,945: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:19:00.946121128Z [2024-05-25 01:19:00,946: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T01:19:00.946322555Z [2024-05-25 01:19:00,946: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:19:01.047121119Z [2024-05-25 01:19:01,046: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:19:01.649009461Z [2024-05-25 01:19:01,648: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8a07b478-b9ab-4819-a644-04c62027e237] succeeded in 1.260602155000015s: None 2024-05-25T01:19:02.007419573Z [2024-05-25 01:19:02,007: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:19:02.016629541Z [2024-05-25 01:19:02,016: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:19:02.041773526Z [2024-05-25 01:19:02,041: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:19:02.043209090Z [2024-05-25 01:19:02,042: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:19:02.043406780Z [2024-05-25 01:19:02,043: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:19:02.043632913Z [2024-05-25 01:19:02,043: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:19:02.043771927Z [2024-05-25 01:19:02,043: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:19:02.044164336Z [2024-05-25 01:19:02,043: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:19:02.044334838Z [2024-05-25 01:19:02,044: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:19:02.107004995Z [2024-05-25 01:19:02,106: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:19:02.113220459Z [2024-05-25 01:19:02,112: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:19:02.139813368Z [2024-05-25 01:19:02,139: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:19:02.140705912Z [2024-05-25 01:19:02,140: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:19:02.142249838Z [2024-05-25 01:19:02,141: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:19:02.142453351Z [2024-05-25 01:19:02,142: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:19:02.142779291Z [2024-05-25 01:19:02,142: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:19:02.142976439Z [2024-05-25 01:19:02,142: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:19:02.143386565Z [2024-05-25 01:19:02,143: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:19:02.144531271Z [2024-05-25 01:19:02,144: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:19:02.311463720Z [2024-05-25 01:19:02,311: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:19:03.952407613Z [2024-05-25 01:19:03,951: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5c87c04b-dc44-47c8-9296-925c6cb2bb88] succeeded in 3.5849437990000297s: None 2024-05-25T01:19:04.016672301Z [2024-05-25 01:19:04,016: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[822d89b4-0ee6-4ac4-ab65-d1cb9b76a7bc] succeeded in 3.6372598569996626s: None 2024-05-25T01:20:00.398089702Z [2024-05-25 01:20:00,387: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58de2303-94e2-4792-8672-adcb5ab7adc6] received 2024-05-25T01:20:00.401141095Z [2024-05-25 01:20:00,400: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b1b15e3-c121-42ef-ae4c-5a0ec3771152] received 2024-05-25T01:20:00.405291007Z [2024-05-25 01:20:00,402: INFO/ForkPoolWorker-15] [58de2303-94e2-4792-8672-adcb5ab7adc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:20:00.409860311Z [2024-05-25 01:20:00,409: INFO/ForkPoolWorker-16] [6b1b15e3-c121-42ef-ae4c-5a0ec3771152] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:20:00.417149131Z [2024-05-25 01:20:00,415: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1370844e-d13a-45b8-9422-b0b21a400cb7] received 2024-05-25T01:20:00.417773903Z [2024-05-25 01:20:00,417: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d75aaecc-bb4b-4578-baa4-83780e4ed6cb] received 2024-05-25T01:20:00.422858870Z [2024-05-25 01:20:00,422: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18cb2a1e-189e-4aab-8ddf-bcbc4aa550e7] received 2024-05-25T01:20:00.431830182Z [2024-05-25 01:20:00,431: INFO/ForkPoolWorker-1] [1370844e-d13a-45b8-9422-b0b21a400cb7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:20:00.438374273Z [2024-05-25 01:20:00,438: INFO/ForkPoolWorker-2] [d75aaecc-bb4b-4578-baa4-83780e4ed6cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:20:00.439881005Z [2024-05-25 01:20:00,439: INFO/ForkPoolWorker-3] [18cb2a1e-189e-4aab-8ddf-bcbc4aa550e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:20:00.809235057Z [2024-05-25 01:20:00,804: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:20:00.822008061Z [2024-05-25 01:20:00,817: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:20:00.823745959Z [2024-05-25 01:20:00,820: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:20:00.866880680Z [2024-05-25 01:20:00,863: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:20:00.954729048Z [2024-05-25 01:20:00,951: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:20:01.019030636Z [2024-05-25 01:20:01,018: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-25T01:20:01.022711294Z [2024-05-25 01:20:01,022: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:20:01.076124275Z [2024-05-25 01:20:01,075: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T01:20:01.079330194Z [2024-05-25 01:20:01,079: INFO/ForkPoolWorker-3] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:20:01.079363173Z [2024-05-25 01:20:01,079: INFO/ForkPoolWorker-3] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:20:01.079435080Z [2024-05-25 01:20:01,079: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-25T01:20:01.079573768Z [2024-05-25 01:20:01,079: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:20:01.191546568Z [2024-05-25 01:20:01,191: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:20:01.224536243Z [2024-05-25 01:20:01,224: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:20:01.934062281Z [2024-05-25 01:20:01,933: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d75aaecc-bb4b-4578-baa4-83780e4ed6cb] succeeded in 1.5118390240004373s: None 2024-05-25T01:20:01.947508956Z [2024-05-25 01:20:01,947: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[18cb2a1e-189e-4aab-8ddf-bcbc4aa550e7] succeeded in 1.5227522349996434s: None 2024-05-25T01:20:02.323012579Z [2024-05-25 01:20:02,322: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:20:02.326867772Z [2024-05-25 01:20:02,326: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:20:02.363977708Z [2024-05-25 01:20:02,363: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:20:02.366533219Z [2024-05-25 01:20:02,366: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:20:02.366587270Z [2024-05-25 01:20:02,366: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:20:02.366676592Z [2024-05-25 01:20:02,366: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:20:02.366722406Z [2024-05-25 01:20:02,366: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:20:02.366917170Z [2024-05-25 01:20:02,366: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:20:02.366961767Z [2024-05-25 01:20:02,366: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:20:02.459702694Z [2024-05-25 01:20:02,459: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:20:02.463138862Z [2024-05-25 01:20:02,462: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:20:02.464074464Z [2024-05-25 01:20:02,463: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:20:02.467278585Z [2024-05-25 01:20:02,466: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:20:02.469695547Z [2024-05-25 01:20:02,469: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:20:02.487197977Z [2024-05-25 01:20:02,485: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:20:02.488212174Z [2024-05-25 01:20:02,488: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:20:02.488228480Z [2024-05-25 01:20:02,488: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:20:02.488343177Z [2024-05-25 01:20:02,488: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:20:02.488370403Z [2024-05-25 01:20:02,488: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:20:02.488598075Z [2024-05-25 01:20:02,488: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:20:02.488661811Z [2024-05-25 01:20:02,488: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:20:02.492879029Z [2024-05-25 01:20:02,492: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:20:02.495556042Z [2024-05-25 01:20:02,495: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:20:02.495997385Z [2024-05-25 01:20:02,495: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:20:02.496268896Z [2024-05-25 01:20:02,496: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:20:02.496994273Z [2024-05-25 01:20:02,496: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:20:02.497481861Z [2024-05-25 01:20:02,497: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:20:02.497626909Z [2024-05-25 01:20:02,497: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:20:02.566502754Z [2024-05-25 01:20:02,566: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:20:02.599973600Z [2024-05-25 01:20:02,599: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:20:03.127215964Z [2024-05-25 01:20:03,126: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1370844e-d13a-45b8-9422-b0b21a400cb7] succeeded in 2.7096640140007366s: None 2024-05-25T01:20:03.243506226Z [2024-05-25 01:20:03,243: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[811202f8-950b-4b1f-a2a7-c535e85f25cb] received 2024-05-25T01:20:03.251218871Z [2024-05-25 01:20:03,250: INFO/ForkPoolWorker-1] [811202f8-950b-4b1f-a2a7-c535e85f25cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:20:03.521770230Z [2024-05-25 01:20:03,518: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:20:04.168602953Z [2024-05-25 01:20:04,167: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6b1b15e3-c121-42ef-ae4c-5a0ec3771152] succeeded in 3.7624532069985435s: None 2024-05-25T01:20:04.704963500Z [2024-05-25 01:20:04,704: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:20:04.705515944Z [2024-05-25 01:20:04,704: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[58de2303-94e2-4792-8672-adcb5ab7adc6] succeeded in 4.308619244000511s: None 2024-05-25T01:20:04.708463948Z [2024-05-25 01:20:04,708: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:20:04.736606123Z [2024-05-25 01:20:04,736: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:20:04.739745345Z [2024-05-25 01:20:04,739: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:20:04.740214996Z [2024-05-25 01:20:04,739: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:20:04.740827173Z [2024-05-25 01:20:04,740: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:20:04.741144611Z [2024-05-25 01:20:04,740: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:20:04.741963383Z [2024-05-25 01:20:04,741: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:20:04.742290147Z [2024-05-25 01:20:04,742: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:20:04.847897983Z [2024-05-25 01:20:04,847: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:20:05.553542281Z [2024-05-25 01:20:05,553: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[811202f8-950b-4b1f-a2a7-c535e85f25cb] succeeded in 2.308030513000631s: None 2024-05-25T01:20:06.442483647Z [2024-05-25 01:20:06,442: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eaaca740-0c5c-429e-83b5-b178efec60cc] received 2024-05-25T01:20:06.452310825Z [2024-05-25 01:20:06,451: INFO/ForkPoolWorker-15] [eaaca740-0c5c-429e-83b5-b178efec60cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:20:06.771000574Z [2024-05-25 01:20:06,768: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:20:07.875971761Z [2024-05-25 01:20:07,875: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:20:07.879891889Z [2024-05-25 01:20:07,879: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:20:07.936124714Z [2024-05-25 01:20:07,935: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:20:07.937100108Z [2024-05-25 01:20:07,936: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:20:07.937141924Z [2024-05-25 01:20:07,937: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:20:07.937580912Z [2024-05-25 01:20:07,937: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:20:07.937666150Z [2024-05-25 01:20:07,937: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:20:07.937850904Z [2024-05-25 01:20:07,937: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:20:07.937899658Z [2024-05-25 01:20:07,937: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:20:08.028649096Z [2024-05-25 01:20:08,028: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:20:08.646693687Z [2024-05-25 01:20:08,646: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eaaca740-0c5c-429e-83b5-b178efec60cc] succeeded in 2.201622430999123s: None 2024-05-25T01:20:09.147569558Z [2024-05-25 01:20:09,147: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7b11720-cfe6-41ff-8452-e0246811a4b4] received 2024-05-25T01:20:09.158942567Z [2024-05-25 01:20:09,158: INFO/ForkPoolWorker-15] [b7b11720-cfe6-41ff-8452-e0246811a4b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:20:09.465957008Z [2024-05-25 01:20:09,462: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:20:10.564859612Z [2024-05-25 01:20:10,564: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:20:10.568124964Z [2024-05-25 01:20:10,567: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:20:10.586777858Z [2024-05-25 01:20:10,586: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:20:10.588344841Z [2024-05-25 01:20:10,588: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:20:10.588361368Z [2024-05-25 01:20:10,588: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:20:10.588466673Z [2024-05-25 01:20:10,588: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:20:10.588478222Z [2024-05-25 01:20:10,588: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:20:10.588722153Z [2024-05-25 01:20:10,588: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:20:10.588729374Z [2024-05-25 01:20:10,588: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:20:10.681466388Z [2024-05-25 01:20:10,680: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:20:11.288073303Z [2024-05-25 01:20:11,286: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b7b11720-cfe6-41ff-8452-e0246811a4b4] succeeded in 2.1372623429997475s: None 2024-05-25T01:21:01.303466985Z [2024-05-25 01:21:01,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a8e6d235-975b-4aff-b389-10b40bfe72a7] received 2024-05-25T01:21:01.306549725Z [2024-05-25 01:21:01,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a4fa049-801b-48af-b7f9-bb23c4611f6e] received 2024-05-25T01:21:01.310692576Z [2024-05-25 01:21:01,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[250d14ef-b04a-483c-b82f-7b7041c85abf] received 2024-05-25T01:21:01.320354413Z [2024-05-25 01:21:01,320: INFO/ForkPoolWorker-1] [250d14ef-b04a-483c-b82f-7b7041c85abf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:21:01.321828410Z [2024-05-25 01:21:01,321: INFO/ForkPoolWorker-15] [a8e6d235-975b-4aff-b389-10b40bfe72a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:21:01.325647175Z [2024-05-25 01:21:01,325: INFO/ForkPoolWorker-16] [4a4fa049-801b-48af-b7f9-bb23c4611f6e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:21:01.684583591Z [2024-05-25 01:21:01,681: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:21:01.692957958Z [2024-05-25 01:21:01,690: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:21:01.693556738Z [2024-05-25 01:21:01,690: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:21:01.835104580Z [2024-05-25 01:21:01,834: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T01:21:01.839100246Z [2024-05-25 01:21:01,838: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:21:01.866020865Z [2024-05-25 01:21:01,865: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:21:01.868008393Z [2024-05-25 01:21:01,867: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:21:01.868261236Z [2024-05-25 01:21:01,868: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:21:01.868393699Z [2024-05-25 01:21:01,868: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T01:21:01.868884700Z [2024-05-25 01:21:01,868: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:21:01.967059794Z [2024-05-25 01:21:01,966: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:21:02.647517606Z [2024-05-25 01:21:02,646: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[250d14ef-b04a-483c-b82f-7b7041c85abf] succeeded in 1.3339000349988055s: None 2024-05-25T01:21:02.824901051Z [2024-05-25 01:21:02,824: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:21:02.828289108Z [2024-05-25 01:21:02,827: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:21:02.830067265Z [2024-05-25 01:21:02,829: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:21:02.833311563Z [2024-05-25 01:21:02,832: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:21:02.854153417Z [2024-05-25 01:21:02,853: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:21:02.855231417Z [2024-05-25 01:21:02,855: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:21:02.855244506Z [2024-05-25 01:21:02,855: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:21:02.855360618Z [2024-05-25 01:21:02,855: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:21:02.855369221Z [2024-05-25 01:21:02,855: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:21:02.855568394Z [2024-05-25 01:21:02,855: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:21:02.855575712Z [2024-05-25 01:21:02,855: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:21:02.859067655Z [2024-05-25 01:21:02,858: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:21:02.860451328Z [2024-05-25 01:21:02,860: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:21:02.860544030Z [2024-05-25 01:21:02,860: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:21:02.860743350Z [2024-05-25 01:21:02,860: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:21:02.860835796Z [2024-05-25 01:21:02,860: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:21:02.861188992Z [2024-05-25 01:21:02,860: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:21:02.861336758Z [2024-05-25 01:21:02,861: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:21:02.949845124Z [2024-05-25 01:21:02,949: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:21:02.978129860Z [2024-05-25 01:21:02,977: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:21:04.968821580Z [2024-05-25 01:21:04,968: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a8e6d235-975b-4aff-b389-10b40bfe72a7] succeeded in 3.661994596999648s: None 2024-05-25T01:21:05.385570694Z [2024-05-25 01:21:05,384: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4a4fa049-801b-48af-b7f9-bb23c4611f6e] succeeded in 4.074906716001351s: None 2024-05-25T01:22:01.186570055Z [2024-05-25 01:22:01,186: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0982256a-0790-49bc-ac84-b12ae276525e] received 2024-05-25T01:22:01.189384445Z [2024-05-25 01:22:01,189: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae249270-c86c-480e-8de1-d67b8c8c7843] received 2024-05-25T01:22:01.192014026Z [2024-05-25 01:22:01,191: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39501510-1305-4460-8e38-66a601e8287f] received 2024-05-25T01:22:01.193756786Z [2024-05-25 01:22:01,193: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b63b2c39-7141-477f-926a-f2f142c14889] received 2024-05-25T01:22:01.217859965Z [2024-05-25 01:22:01,203: INFO/ForkPoolWorker-15] [0982256a-0790-49bc-ac84-b12ae276525e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:22:01.217881802Z [2024-05-25 01:22:01,215: INFO/ForkPoolWorker-16] [ae249270-c86c-480e-8de1-d67b8c8c7843] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:22:01.219182278Z [2024-05-25 01:22:01,218: INFO/ForkPoolWorker-1] [39501510-1305-4460-8e38-66a601e8287f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:22:01.223576452Z [2024-05-25 01:22:01,223: INFO/ForkPoolWorker-2] [b63b2c39-7141-477f-926a-f2f142c14889] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:22:01.569380026Z [2024-05-25 01:22:01,566: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:22:01.598079438Z [2024-05-25 01:22:01,595: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:22:01.623517947Z [2024-05-25 01:22:01,619: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:22:01.818601692Z [2024-05-25 01:22:01,815: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:22:01.828634188Z [2024-05-25 01:22:01,828: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T01:22:01.833135596Z [2024-05-25 01:22:01,832: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:22:01.868205524Z [2024-05-25 01:22:01,867: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:22:01.869507572Z [2024-05-25 01:22:01,869: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:22:01.870112290Z [2024-05-25 01:22:01,869: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:22:01.870321135Z [2024-05-25 01:22:01,870: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T01:22:01.871509193Z [2024-05-25 01:22:01,871: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:22:01.920898085Z [2024-05-25 01:22:01,920: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:22:01.968226679Z [2024-05-25 01:22:01,967: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:22:02.646347704Z [2024-05-25 01:22:02,645: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0982256a-0790-49bc-ac84-b12ae276525e] succeeded in 1.4577693270002783s: None 2024-05-25T01:22:02.681064975Z [2024-05-25 01:22:02,680: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[39501510-1305-4460-8e38-66a601e8287f] succeeded in 1.4850850540005922s: None 2024-05-25T01:22:02.945484881Z [2024-05-25 01:22:02,945: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:22:02.948959842Z [2024-05-25 01:22:02,948: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:22:02.965539454Z [2024-05-25 01:22:02,965: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:22:02.966761038Z [2024-05-25 01:22:02,966: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:22:02.966872264Z [2024-05-25 01:22:02,966: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:22:02.967013613Z [2024-05-25 01:22:02,966: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:22:02.967087798Z [2024-05-25 01:22:02,966: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:22:02.967342969Z [2024-05-25 01:22:02,967: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:22:02.967459997Z [2024-05-25 01:22:02,967: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:22:03.044980861Z [2024-05-25 01:22:03,044: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:22:03.241176177Z [2024-05-25 01:22:03,240: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T01:22:03.244574988Z [2024-05-25 01:22:03,244: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:22:03.278557457Z [2024-05-25 01:22:03,278: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:22:03.280466828Z [2024-05-25 01:22:03,280: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:22:03.280694354Z [2024-05-25 01:22:03,280: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:22:03.281047033Z [2024-05-25 01:22:03,280: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:22:03.281316618Z [2024-05-25 01:22:03,280: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T01:22:03.281734224Z [2024-05-25 01:22:03,281: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:22:03.281880901Z [2024-05-25 01:22:03,281: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:22:03.358541977Z [2024-05-25 01:22:03,358: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:22:04.645897824Z [2024-05-25 01:22:04,645: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ae249270-c86c-480e-8de1-d67b8c8c7843] succeeded in 3.453431666999677s: None 2024-05-25T01:22:05.276221844Z [2024-05-25 01:22:05,275: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b63b2c39-7141-477f-926a-f2f142c14889] succeeded in 4.076044989000366s: None 2024-05-25T01:23:00.632766018Z [2024-05-25 01:23:00,632: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8845260-e651-4fb4-ad9d-dcf0fbe12e75] received 2024-05-25T01:23:00.636865927Z [2024-05-25 01:23:00,636: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4616e74c-5c7f-4d9c-95a1-0ae8a61dad45] received 2024-05-25T01:23:00.645321416Z [2024-05-25 01:23:00,644: INFO/ForkPoolWorker-15] [b8845260-e651-4fb4-ad9d-dcf0fbe12e75] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:23:00.646203696Z [2024-05-25 01:23:00,646: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c28eadf-c0a1-4ba4-ab27-1c52d4442048] received 2024-05-25T01:23:00.649753070Z [2024-05-25 01:23:00,649: INFO/ForkPoolWorker-16] [4616e74c-5c7f-4d9c-95a1-0ae8a61dad45] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:23:00.655447481Z [2024-05-25 01:23:00,655: INFO/ForkPoolWorker-1] [1c28eadf-c0a1-4ba4-ab27-1c52d4442048] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:23:00.937005432Z [2024-05-25 01:23:00,930: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:23:00.978879581Z [2024-05-25 01:23:00,976: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:23:01.088063946Z [2024-05-25 01:23:01,084: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:23:01.258931121Z [2024-05-25 01:23:01,258: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T01:23:01.262808206Z [2024-05-25 01:23:01,262: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:23:01.288480965Z [2024-05-25 01:23:01,288: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:23:01.289656519Z [2024-05-25 01:23:01,289: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:23:01.289816112Z [2024-05-25 01:23:01,289: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:23:01.289927946Z [2024-05-25 01:23:01,289: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T01:23:01.290148088Z [2024-05-25 01:23:01,290: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:23:01.419559608Z [2024-05-25 01:23:01,419: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:23:01.971495633Z [2024-05-25 01:23:01,971: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b8845260-e651-4fb4-ad9d-dcf0fbe12e75] succeeded in 1.3357579330004228s: None 2024-05-25T01:23:02.143257358Z [2024-05-25 01:23:02,142: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:23:02.146784945Z [2024-05-25 01:23:02,146: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:23:02.184093048Z [2024-05-25 01:23:02,183: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:23:02.201360811Z [2024-05-25 01:23:02,198: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:23:02.201389770Z [2024-05-25 01:23:02,198: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:23:02.201399382Z [2024-05-25 01:23:02,198: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:23:02.201418435Z [2024-05-25 01:23:02,198: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:23:02.201422348Z [2024-05-25 01:23:02,199: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:23:02.201425740Z [2024-05-25 01:23:02,199: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:23:02.270638427Z [2024-05-25 01:23:02,270: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:23:02.275782864Z [2024-05-25 01:23:02,275: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:23:02.346196415Z [2024-05-25 01:23:02,346: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:23:02.348707697Z [2024-05-25 01:23:02,348: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:23:02.352884409Z [2024-05-25 01:23:02,352: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:23:02.352919108Z [2024-05-25 01:23:02,352: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:23:02.353081212Z [2024-05-25 01:23:02,352: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:23:02.353195210Z [2024-05-25 01:23:02,353: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:23:02.353516456Z [2024-05-25 01:23:02,353: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:23:02.353601671Z [2024-05-25 01:23:02,353: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:23:02.474056625Z [2024-05-25 01:23:02,473: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:23:04.223388376Z [2024-05-25 01:23:04,222: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1c28eadf-c0a1-4ba4-ab27-1c52d4442048] succeeded in 3.5753547869990143s: None 2024-05-25T01:23:04.652433385Z [2024-05-25 01:23:04,651: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4616e74c-5c7f-4d9c-95a1-0ae8a61dad45] succeeded in 4.012106940001104s: None 2024-05-25T01:24:01.104788744Z [2024-05-25 01:24:01,104: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c07079fe-6c40-4b6a-8d1b-aaf46a631789] received 2024-05-25T01:24:01.107249996Z [2024-05-25 01:24:01,107: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e1677203-303f-4db1-8cf2-d743067651ad] received 2024-05-25T01:24:01.112424944Z [2024-05-25 01:24:01,112: INFO/ForkPoolWorker-15] [c07079fe-6c40-4b6a-8d1b-aaf46a631789] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:24:01.128626242Z [2024-05-25 01:24:01,128: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2346574f-552c-43d9-a36e-7c8a5a67c3ad] received 2024-05-25T01:24:01.130721334Z [2024-05-25 01:24:01,130: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a8fab58-14a9-4b22-bc59-fa9a67f24ff3] received 2024-05-25T01:24:01.134414873Z [2024-05-25 01:24:01,131: INFO/ForkPoolWorker-16] [e1677203-303f-4db1-8cf2-d743067651ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:24:01.137369893Z [2024-05-25 01:24:01,137: INFO/ForkPoolWorker-1] [2346574f-552c-43d9-a36e-7c8a5a67c3ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:24:01.138047955Z [2024-05-25 01:24:01,137: INFO/ForkPoolWorker-2] [0a8fab58-14a9-4b22-bc59-fa9a67f24ff3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:24:01.508787576Z [2024-05-25 01:24:01,505: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:24:01.551993278Z [2024-05-25 01:24:01,548: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:24:01.559343706Z [2024-05-25 01:24:01,555: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:24:01.651452199Z [2024-05-25 01:24:01,645: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:24:01.826558188Z [2024-05-25 01:24:01,826: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:24:01.965006426Z [2024-05-25 01:24:01,964: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T01:24:01.969082051Z [2024-05-25 01:24:01,968: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:24:02.039810231Z [2024-05-25 01:24:02,039: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:24:02.041372943Z [2024-05-25 01:24:02,041: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:24:02.041601568Z [2024-05-25 01:24:02,041: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:24:02.041762822Z [2024-05-25 01:24:02,041: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T01:24:02.042063243Z [2024-05-25 01:24:02,041: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:24:02.189306974Z [2024-05-25 01:24:02,188: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:24:02.679596372Z [2024-05-25 01:24:02,679: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c07079fe-6c40-4b6a-8d1b-aaf46a631789] succeeded in 1.5733175440000196s: None 2024-05-25T01:24:03.022745933Z [2024-05-25 01:24:03,022: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:24:03.031738621Z [2024-05-25 01:24:03,031: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:24:03.082260350Z [2024-05-25 01:24:03,082: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:24:03.086406483Z [2024-05-25 01:24:03,086: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:24:03.086463485Z [2024-05-25 01:24:03,086: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:24:03.086672511Z [2024-05-25 01:24:03,086: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:24:03.094262795Z [2024-05-25 01:24:03,093: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0a8fab58-14a9-4b22-bc59-fa9a67f24ff3] succeeded in 1.9614750720011216s: None 2024-05-25T01:24:03.095167004Z [2024-05-25 01:24:03,086: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:24:03.095521432Z [2024-05-25 01:24:03,095: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:24:03.095900646Z [2024-05-25 01:24:03,095: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:24:03.143291770Z [2024-05-25 01:24:03,142: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:24:03.146631799Z [2024-05-25 01:24:03,146: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:24:03.164395774Z [2024-05-25 01:24:03,164: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:24:03.167977381Z [2024-05-25 01:24:03,167: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:24:03.167996341Z [2024-05-25 01:24:03,167: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:24:03.169183658Z [2024-05-25 01:24:03,168: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:24:03.169196832Z [2024-05-25 01:24:03,169: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:24:03.169480134Z [2024-05-25 01:24:03,169: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:24:03.169491177Z [2024-05-25 01:24:03,169: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:24:03.199154224Z [2024-05-25 01:24:03,198: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:24:03.259301344Z [2024-05-25 01:24:03,259: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:24:04.900491559Z [2024-05-25 01:24:04,899: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2346574f-552c-43d9-a36e-7c8a5a67c3ad] succeeded in 3.769238409000536s: None 2024-05-25T01:24:05.002934754Z [2024-05-25 01:24:05,002: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e1677203-303f-4db1-8cf2-d743067651ad] succeeded in 3.890989083000022s: None 2024-05-25T01:25:00.486950660Z [2024-05-25 01:25:00,485: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae4f4482-8ddc-4b56-a48d-4c7a3ef390c1] received 2024-05-25T01:25:00.492974044Z [2024-05-25 01:25:00,492: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de2b249a-fb4d-4c69-a56a-8d5239806b6e] received 2024-05-25T01:25:00.496881454Z [2024-05-25 01:25:00,496: INFO/ForkPoolWorker-15] [ae4f4482-8ddc-4b56-a48d-4c7a3ef390c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:25:00.503065595Z [2024-05-25 01:25:00,502: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c102627f-d901-46f7-a278-169ccf11bbb2] received 2024-05-25T01:25:00.516457958Z [2024-05-25 01:25:00,516: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb720c4d-7bf8-428a-96f9-d4580009fb7f] received 2024-05-25T01:25:00.517044907Z [2024-05-25 01:25:00,516: INFO/ForkPoolWorker-16] [de2b249a-fb4d-4c69-a56a-8d5239806b6e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:25:00.519189176Z [2024-05-25 01:25:00,518: INFO/ForkPoolWorker-1] [c102627f-d901-46f7-a278-169ccf11bbb2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:25:00.533553995Z [2024-05-25 01:25:00,533: INFO/ForkPoolWorker-2] [fb720c4d-7bf8-428a-96f9-d4580009fb7f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:25:00.822333000Z [2024-05-25 01:25:00,819: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:25:00.879350225Z [2024-05-25 01:25:00,872: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:25:00.899322589Z [2024-05-25 01:25:00,896: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:25:00.969247715Z [2024-05-25 01:25:00,965: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:25:01.164482048Z [2024-05-25 01:25:01,164: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T01:25:01.170650692Z [2024-05-25 01:25:01,170: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:25:01.226422957Z [2024-05-25 01:25:01,226: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:25:01.229985468Z [2024-05-25 01:25:01,229: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:25:01.230261348Z [2024-05-25 01:25:01,229: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:25:01.230413753Z [2024-05-25 01:25:01,230: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T01:25:01.230695767Z [2024-05-25 01:25:01,230: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:25:01.377333704Z [2024-05-25 01:25:01,376: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:25:02.217355853Z [2024-05-25 01:25:02,214: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c102627f-d901-46f7-a278-169ccf11bbb2] succeeded in 1.7089652289996593s: None 2024-05-25T01:25:02.392738536Z [2024-05-25 01:25:02,392: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T01:25:02.396110613Z [2024-05-25 01:25:02,395: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:25:02.400675619Z [2024-05-25 01:25:02,400: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:25:02.404037593Z [2024-05-25 01:25:02,403: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:25:02.427985779Z [2024-05-25 01:25:02,427: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:25:02.429282074Z [2024-05-25 01:25:02,428: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:25:02.429307222Z [2024-05-25 01:25:02,429: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:25:02.429523617Z [2024-05-25 01:25:02,429: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:25:02.429600676Z [2024-05-25 01:25:02,429: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T01:25:02.429898489Z [2024-05-25 01:25:02,429: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:25:02.429911531Z [2024-05-25 01:25:02,429: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:25:02.435424178Z [2024-05-25 01:25:02,435: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:25:02.436494329Z [2024-05-25 01:25:02,436: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:25:02.436606682Z [2024-05-25 01:25:02,436: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:25:02.436749370Z [2024-05-25 01:25:02,436: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:25:02.436853807Z [2024-05-25 01:25:02,436: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:25:02.437047768Z [2024-05-25 01:25:02,436: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:25:02.437146584Z [2024-05-25 01:25:02,437: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:25:02.507008519Z [2024-05-25 01:25:02,506: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:25:02.510534611Z [2024-05-25 01:25:02,510: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:25:02.519470400Z [2024-05-25 01:25:02,519: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:25:02.542246944Z [2024-05-25 01:25:02,542: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:25:02.543436535Z [2024-05-25 01:25:02,543: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:25:02.543930468Z [2024-05-25 01:25:02,543: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:25:02.544420854Z [2024-05-25 01:25:02,544: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:25:02.544588300Z [2024-05-25 01:25:02,544: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:25:02.544996005Z [2024-05-25 01:25:02,544: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:25:02.545113929Z [2024-05-25 01:25:02,545: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:25:02.547329366Z [2024-05-25 01:25:02,547: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:25:02.647144742Z [2024-05-25 01:25:02,646: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:25:03.273176296Z [2024-05-25 01:25:03,272: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[de2b249a-fb4d-4c69-a56a-8d5239806b6e] succeeded in 2.777747037998779s: None 2024-05-25T01:25:03.443981249Z [2024-05-25 01:25:03,443: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82d83f50-c4ae-43ac-a9fc-29eec8bb3472] received 2024-05-25T01:25:03.453266086Z [2024-05-25 01:25:03,452: INFO/ForkPoolWorker-16] [82d83f50-c4ae-43ac-a9fc-29eec8bb3472] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:25:03.764682443Z [2024-05-25 01:25:03,761: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:25:04.048512087Z [2024-05-25 01:25:04,048: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ae4f4482-8ddc-4b56-a48d-4c7a3ef390c1] succeeded in 3.55951581500085s: None 2024-05-25T01:25:04.412457675Z [2024-05-25 01:25:04,412: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fb720c4d-7bf8-428a-96f9-d4580009fb7f] succeeded in 3.8936867719985457s: None 2024-05-25T01:25:05.030446483Z [2024-05-25 01:25:05,029: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:25:05.034020158Z [2024-05-25 01:25:05,033: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:25:05.054474047Z [2024-05-25 01:25:05,054: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:25:05.055598718Z [2024-05-25 01:25:05,055: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:25:05.055641690Z [2024-05-25 01:25:05,055: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:25:05.055838114Z [2024-05-25 01:25:05,055: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:25:05.055902693Z [2024-05-25 01:25:05,055: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:25:05.056167678Z [2024-05-25 01:25:05,056: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:25:05.056344626Z [2024-05-25 01:25:05,056: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:25:05.138145681Z [2024-05-25 01:25:05,137: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:25:05.801661461Z [2024-05-25 01:25:05,801: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[82d83f50-c4ae-43ac-a9fc-29eec8bb3472] succeeded in 2.355690690001211s: None 2024-05-25T01:25:06.796249461Z [2024-05-25 01:25:06,795: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77865e2d-c2d0-4816-b067-5bce840e9a16] received 2024-05-25T01:25:06.819179875Z [2024-05-25 01:25:06,818: INFO/ForkPoolWorker-15] [77865e2d-c2d0-4816-b067-5bce840e9a16] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:25:07.100026302Z [2024-05-25 01:25:07,096: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:25:08.340260285Z [2024-05-25 01:25:08,339: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:25:08.343780670Z [2024-05-25 01:25:08,343: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:25:08.368665335Z [2024-05-25 01:25:08,368: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:25:08.370507217Z [2024-05-25 01:25:08,370: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:25:08.370762891Z [2024-05-25 01:25:08,370: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:25:08.371038508Z [2024-05-25 01:25:08,370: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:25:08.371233181Z [2024-05-25 01:25:08,371: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:25:08.371614486Z [2024-05-25 01:25:08,371: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:25:08.371843182Z [2024-05-25 01:25:08,371: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:25:08.461331462Z [2024-05-25 01:25:08,460: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:25:09.118036045Z [2024-05-25 01:25:09,117: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[77865e2d-c2d0-4816-b067-5bce840e9a16] succeeded in 2.312141974000042s: None 2024-05-25T01:25:09.125824020Z [2024-05-25 01:25:09,125: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35daab2b-ea54-4c9c-8ee9-2e41f0882a6c] received 2024-05-25T01:25:09.135852450Z [2024-05-25 01:25:09,135: INFO/ForkPoolWorker-15] [35daab2b-ea54-4c9c-8ee9-2e41f0882a6c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:25:09.462723449Z [2024-05-25 01:25:09,459: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:25:10.598508640Z [2024-05-25 01:25:10,598: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:25:10.601915163Z [2024-05-25 01:25:10,601: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:25:10.624665538Z [2024-05-25 01:25:10,624: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:25:10.625969815Z [2024-05-25 01:25:10,625: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:25:10.625985829Z [2024-05-25 01:25:10,625: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:25:10.626223960Z [2024-05-25 01:25:10,625: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:25:10.626237960Z [2024-05-25 01:25:10,626: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:25:10.626532949Z [2024-05-25 01:25:10,626: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:25:10.626794215Z [2024-05-25 01:25:10,626: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:25:10.709326169Z [2024-05-25 01:25:10,708: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:25:11.373019974Z [2024-05-25 01:25:11,372: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[35daab2b-ea54-4c9c-8ee9-2e41f0882a6c] succeeded in 2.2441549100003613s: None 2024-05-25T01:26:00.529512814Z [2024-05-25 01:26:00,529: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ed4b001-c081-4c5e-b4b0-317dc7b57529] received 2024-05-25T01:26:00.534916626Z [2024-05-25 01:26:00,534: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a00a84e7-4f8d-49aa-8418-d6097a3354d1] received 2024-05-25T01:26:00.538004890Z [2024-05-25 01:26:00,537: INFO/ForkPoolWorker-15] [9ed4b001-c081-4c5e-b4b0-317dc7b57529] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:26:00.563816848Z [2024-05-25 01:26:00,563: INFO/ForkPoolWorker-16] [a00a84e7-4f8d-49aa-8418-d6097a3354d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:26:00.564223113Z [2024-05-25 01:26:00,563: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e96efaa-1785-4feb-9514-b78ee2192567] received 2024-05-25T01:26:00.578863139Z [2024-05-25 01:26:00,578: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc0a28d7-3d8f-4eec-8f6e-203a95fdf682] received 2024-05-25T01:26:00.580966338Z [2024-05-25 01:26:00,580: INFO/ForkPoolWorker-1] [5e96efaa-1785-4feb-9514-b78ee2192567] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:26:00.589606755Z [2024-05-25 01:26:00,588: INFO/ForkPoolWorker-2] [fc0a28d7-3d8f-4eec-8f6e-203a95fdf682] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:26:00.877526874Z [2024-05-25 01:26:00,874: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:26:00.888103740Z [2024-05-25 01:26:00,885: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:26:00.915063942Z [2024-05-25 01:26:00,912: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:26:00.995188850Z [2024-05-25 01:26:00,988: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:26:01.105990945Z [2024-05-25 01:26:01,105: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:26:01.143695081Z [2024-05-25 01:26:01,143: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T01:26:01.147966311Z [2024-05-25 01:26:01,147: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:26:01.173697978Z [2024-05-25 01:26:01,173: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:26:01.178681146Z [2024-05-25 01:26:01,178: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:26:01.178893054Z [2024-05-25 01:26:01,178: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:26:01.179005019Z [2024-05-25 01:26:01,178: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T01:26:01.179327065Z [2024-05-25 01:26:01,179: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:26:01.384893842Z [2024-05-25 01:26:01,384: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:26:01.873943112Z [2024-05-25 01:26:01,873: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9ed4b001-c081-4c5e-b4b0-317dc7b57529] succeeded in 1.3422980240011384s: None 2024-05-25T01:26:02.193336406Z [2024-05-25 01:26:02,186: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fc0a28d7-3d8f-4eec-8f6e-203a95fdf682] succeeded in 1.6062738660002651s: None 2024-05-25T01:26:02.810436096Z [2024-05-25 01:26:02,810: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:26:02.813659825Z [2024-05-25 01:26:02,813: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:26:02.851233816Z [2024-05-25 01:26:02,850: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:26:02.852922481Z [2024-05-25 01:26:02,852: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:26:02.853067641Z [2024-05-25 01:26:02,852: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:26:02.853294989Z [2024-05-25 01:26:02,853: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:26:02.853445060Z [2024-05-25 01:26:02,853: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:26:02.854051097Z [2024-05-25 01:26:02,853: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:26:02.854117174Z [2024-05-25 01:26:02,854: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:26:02.957788383Z [2024-05-25 01:26:02,957: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:26:02.971349657Z [2024-05-25 01:26:02,971: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:26:02.975077895Z [2024-05-25 01:26:02,974: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:26:03.011062193Z [2024-05-25 01:26:03,010: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:26:03.013177185Z [2024-05-25 01:26:03,012: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:26:03.013318282Z [2024-05-25 01:26:03,013: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:26:03.013506124Z [2024-05-25 01:26:03,013: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:26:03.013645210Z [2024-05-25 01:26:03,013: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:26:03.013946231Z [2024-05-25 01:26:03,013: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:26:03.014150486Z [2024-05-25 01:26:03,013: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:26:03.135682828Z [2024-05-25 01:26:03,135: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:26:04.787155818Z [2024-05-25 01:26:04,786: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5e96efaa-1785-4feb-9514-b78ee2192567] succeeded in 4.214947579999716s: None 2024-05-25T01:26:05.294182626Z [2024-05-25 01:26:05,293: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a00a84e7-4f8d-49aa-8418-d6097a3354d1] succeeded in 4.7556551300003775s: None 2024-05-25T01:27:00.789791084Z [2024-05-25 01:27:00,789: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a0a946c-2a9c-4f9c-853e-a39d70268283] received 2024-05-25T01:27:00.792908062Z [2024-05-25 01:27:00,792: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63b367ff-83bb-45ed-ace1-33b8facb0592] received 2024-05-25T01:27:00.795808147Z [2024-05-25 01:27:00,795: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61e71a3c-af87-407d-86f4-c8968bf215d2] received 2024-05-25T01:27:00.802557336Z [2024-05-25 01:27:00,802: INFO/ForkPoolWorker-16] [63b367ff-83bb-45ed-ace1-33b8facb0592] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:27:00.806017806Z [2024-05-25 01:27:00,805: INFO/ForkPoolWorker-15] [2a0a946c-2a9c-4f9c-853e-a39d70268283] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:27:00.816149519Z [2024-05-25 01:27:00,815: INFO/ForkPoolWorker-1] [61e71a3c-af87-407d-86f4-c8968bf215d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:27:01.075263940Z [2024-05-25 01:27:01,072: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:27:01.119095312Z [2024-05-25 01:27:01,115: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:27:01.175143880Z [2024-05-25 01:27:01,171: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:27:01.218487575Z [2024-05-25 01:27:01,217: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T01:27:01.222336175Z [2024-05-25 01:27:01,221: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:27:01.249245474Z [2024-05-25 01:27:01,249: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:27:01.251251004Z [2024-05-25 01:27:01,250: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:27:01.251504474Z [2024-05-25 01:27:01,251: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:27:01.252068270Z [2024-05-25 01:27:01,251: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T01:27:01.252895482Z [2024-05-25 01:27:01,252: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:27:01.369320277Z [2024-05-25 01:27:01,367: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:27:01.959988507Z [2024-05-25 01:27:01,959: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2a0a946c-2a9c-4f9c-853e-a39d70268283] succeeded in 1.1650865000010526s: None 2024-05-25T01:27:02.328553349Z [2024-05-25 01:27:02,328: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:27:02.331685004Z [2024-05-25 01:27:02,331: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:27:02.360821707Z [2024-05-25 01:27:02,360: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:27:02.362156227Z [2024-05-25 01:27:02,361: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:27:02.362217533Z [2024-05-25 01:27:02,362: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:27:02.362363236Z [2024-05-25 01:27:02,362: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:27:02.362411070Z [2024-05-25 01:27:02,362: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:27:02.362641281Z [2024-05-25 01:27:02,362: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:27:02.362689784Z [2024-05-25 01:27:02,362: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:27:02.434670391Z [2024-05-25 01:27:02,434: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:27:02.435664276Z [2024-05-25 01:27:02,435: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:27:02.439065548Z [2024-05-25 01:27:02,438: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:27:02.458079851Z [2024-05-25 01:27:02,457: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:27:02.459272931Z [2024-05-25 01:27:02,459: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:27:02.459444827Z [2024-05-25 01:27:02,459: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:27:02.459676356Z [2024-05-25 01:27:02,459: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:27:02.459850575Z [2024-05-25 01:27:02,459: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:27:02.460172207Z [2024-05-25 01:27:02,460: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:27:02.460413189Z [2024-05-25 01:27:02,460: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:27:02.549713756Z [2024-05-25 01:27:02,549: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:27:04.439391903Z [2024-05-25 01:27:04,438: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[63b367ff-83bb-45ed-ace1-33b8facb0592] succeeded in 3.6446329339996737s: None 2024-05-25T01:27:04.473988464Z [2024-05-25 01:27:04,473: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[61e71a3c-af87-407d-86f4-c8968bf215d2] succeeded in 3.6747149950006133s: None 2024-05-25T01:28:01.087276203Z [2024-05-25 01:28:01,086: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87f6287b-5656-47ff-b018-ae88df3685d3] received 2024-05-25T01:28:01.091862698Z [2024-05-25 01:28:01,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84dc820a-6453-427c-b04e-ad22cb47a783] received 2024-05-25T01:28:01.096786599Z [2024-05-25 01:28:01,096: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f22920c9-b128-4fe2-95c2-fd905bf2613f] received 2024-05-25T01:28:01.100124858Z [2024-05-25 01:28:01,099: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96f8c86a-a3c5-4cc5-8f2d-75408f53bc05] received 2024-05-25T01:28:01.100147192Z [2024-05-25 01:28:01,099: INFO/ForkPoolWorker-16] [84dc820a-6453-427c-b04e-ad22cb47a783] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:28:01.100383937Z [2024-05-25 01:28:01,098: INFO/ForkPoolWorker-15] [87f6287b-5656-47ff-b018-ae88df3685d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:28:01.107897202Z [2024-05-25 01:28:01,107: INFO/ForkPoolWorker-1] [f22920c9-b128-4fe2-95c2-fd905bf2613f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:28:01.112647926Z [2024-05-25 01:28:01,112: INFO/ForkPoolWorker-2] [96f8c86a-a3c5-4cc5-8f2d-75408f53bc05] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:28:01.455261516Z [2024-05-25 01:28:01,451: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:28:01.465791640Z [2024-05-25 01:28:01,462: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:28:01.532697508Z [2024-05-25 01:28:01,528: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:28:01.553662291Z [2024-05-25 01:28:01,549: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:28:01.690450080Z [2024-05-25 01:28:01,690: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T01:28:01.700816333Z [2024-05-25 01:28:01,700: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:28:01.728049752Z [2024-05-25 01:28:01,727: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:28:01.729194613Z [2024-05-25 01:28:01,729: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:28:01.729265750Z [2024-05-25 01:28:01,729: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:28:01.729407478Z [2024-05-25 01:28:01,729: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T01:28:01.729550861Z [2024-05-25 01:28:01,729: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:28:01.829998949Z [2024-05-25 01:28:01,829: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:28:01.842965343Z [2024-05-25 01:28:01,842: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:28:02.586117205Z [2024-05-25 01:28:02,585: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[87f6287b-5656-47ff-b018-ae88df3685d3] succeeded in 1.4960084689992073s: None 2024-05-25T01:28:02.634800458Z [2024-05-25 01:28:02,632: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[96f8c86a-a3c5-4cc5-8f2d-75408f53bc05] succeeded in 1.5312888010012102s: None 2024-05-25T01:28:02.922154162Z [2024-05-25 01:28:02,921: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:28:02.925670201Z [2024-05-25 01:28:02,925: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:28:02.930171122Z [2024-05-25 01:28:02,929: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:28:02.933470445Z [2024-05-25 01:28:02,932: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:28:02.952895461Z [2024-05-25 01:28:02,952: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:28:02.955221675Z [2024-05-25 01:28:02,954: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:28:02.955499192Z [2024-05-25 01:28:02,955: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:28:02.955833935Z [2024-05-25 01:28:02,955: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:28:02.956002402Z [2024-05-25 01:28:02,955: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:28:02.956351338Z [2024-05-25 01:28:02,956: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:28:02.956506755Z [2024-05-25 01:28:02,956: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:28:02.962922523Z [2024-05-25 01:28:02,962: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:28:02.966417655Z [2024-05-25 01:28:02,965: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:28:02.966463405Z [2024-05-25 01:28:02,966: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:28:02.966585575Z [2024-05-25 01:28:02,966: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:28:02.966708222Z [2024-05-25 01:28:02,966: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:28:02.966915995Z [2024-05-25 01:28:02,966: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:28:02.967010566Z [2024-05-25 01:28:02,966: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:28:03.049594058Z [2024-05-25 01:28:03,049: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:28:03.077491851Z [2024-05-25 01:28:03,077: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:28:05.277845031Z [2024-05-25 01:28:05,276: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f22920c9-b128-4fe2-95c2-fd905bf2613f] succeeded in 4.176058111999737s: None 2024-05-25T01:28:05.935241141Z [2024-05-25 01:28:05,934: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[84dc820a-6453-427c-b04e-ad22cb47a783] succeeded in 4.841049304999615s: None 2024-05-25T01:29:00.173252161Z [2024-05-25 01:29:00,172: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f788f82-97e2-41b8-bf1c-d772d33ee31e] received 2024-05-25T01:29:00.175513214Z [2024-05-25 01:29:00,175: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[518a1723-8d03-4493-a1c6-303339fc9e6a] received 2024-05-25T01:29:00.179467199Z [2024-05-25 01:29:00,179: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[850e5a23-0e14-4027-b2cf-ef736ceeb1de] received 2024-05-25T01:29:00.185154720Z [2024-05-25 01:29:00,184: INFO/ForkPoolWorker-15] [0f788f82-97e2-41b8-bf1c-d772d33ee31e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:29:00.186830612Z [2024-05-25 01:29:00,186: INFO/ForkPoolWorker-16] [518a1723-8d03-4493-a1c6-303339fc9e6a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:29:00.191788419Z [2024-05-25 01:29:00,191: INFO/ForkPoolWorker-1] [850e5a23-0e14-4027-b2cf-ef736ceeb1de] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:29:00.509356488Z [2024-05-25 01:29:00,506: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:29:00.533892412Z [2024-05-25 01:29:00,529: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:29:00.534624404Z [2024-05-25 01:29:00,531: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:29:00.709917962Z [2024-05-25 01:29:00,709: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T01:29:00.713919428Z [2024-05-25 01:29:00,713: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:29:00.762371660Z [2024-05-25 01:29:00,762: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:29:00.764948019Z [2024-05-25 01:29:00,764: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:29:00.765131443Z [2024-05-25 01:29:00,764: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:29:00.765255211Z [2024-05-25 01:29:00,765: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T01:29:00.765652583Z [2024-05-25 01:29:00,765: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:29:00.878604191Z [2024-05-25 01:29:00,878: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:29:01.456171679Z [2024-05-25 01:29:01,455: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[850e5a23-0e14-4027-b2cf-ef736ceeb1de] succeeded in 1.2750166799996805s: None 2024-05-25T01:29:01.613656600Z [2024-05-25 01:29:01,613: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:29:01.616900796Z [2024-05-25 01:29:01,616: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:29:01.638974367Z [2024-05-25 01:29:01,638: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:29:01.640384675Z [2024-05-25 01:29:01,640: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:29:01.640510714Z [2024-05-25 01:29:01,640: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:29:01.640697413Z [2024-05-25 01:29:01,640: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:29:01.640790401Z [2024-05-25 01:29:01,640: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:29:01.641058198Z [2024-05-25 01:29:01,640: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:29:01.641191711Z [2024-05-25 01:29:01,641: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:29:01.708742907Z [2024-05-25 01:29:01,708: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:29:01.749876456Z [2024-05-25 01:29:01,749: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:29:01.753070941Z [2024-05-25 01:29:01,752: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:29:01.777952270Z [2024-05-25 01:29:01,777: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:29:01.779364229Z [2024-05-25 01:29:01,779: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:29:01.779542966Z [2024-05-25 01:29:01,779: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:29:01.779837130Z [2024-05-25 01:29:01,779: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:29:01.780057035Z [2024-05-25 01:29:01,779: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:29:01.780391001Z [2024-05-25 01:29:01,780: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:29:01.780542532Z [2024-05-25 01:29:01,780: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:29:01.852965870Z [2024-05-25 01:29:01,852: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:29:03.405197256Z [2024-05-25 01:29:03,404: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[518a1723-8d03-4493-a1c6-303339fc9e6a] succeeded in 3.22668988300029s: None 2024-05-25T01:29:03.591830720Z [2024-05-25 01:29:03,591: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0f788f82-97e2-41b8-bf1c-d772d33ee31e] succeeded in 3.416568622000341s: None 2024-05-25T01:30:01.355221676Z [2024-05-25 01:30:01,349: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c04b16e7-ea40-48f7-a4f3-3fc82c4f2543] received 2024-05-25T01:30:01.355259062Z [2024-05-25 01:30:01,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29982fd0-024e-49a9-a4d4-86e4e69e82e5] received 2024-05-25T01:30:01.355263226Z [2024-05-25 01:30:01,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65eb3552-04f6-4790-8e7f-31a45323c67b] received 2024-05-25T01:30:01.355266656Z [2024-05-25 01:30:01,354: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ca94ec8-200c-41b3-a2cb-218bf3f64782] received 2024-05-25T01:30:01.361345019Z [2024-05-25 01:30:01,355: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cfc85466-7b00-4850-a082-66e75ac6cadb] received 2024-05-25T01:30:01.380749812Z [2024-05-25 01:30:01,370: INFO/ForkPoolWorker-2] [1ca94ec8-200c-41b3-a2cb-218bf3f64782] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:30:01.380769026Z [2024-05-25 01:30:01,371: INFO/ForkPoolWorker-1] [65eb3552-04f6-4790-8e7f-31a45323c67b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:30:01.380774100Z [2024-05-25 01:30:01,372: INFO/ForkPoolWorker-3] [cfc85466-7b00-4850-a082-66e75ac6cadb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:30:01.380777588Z [2024-05-25 01:30:01,375: INFO/ForkPoolWorker-15] [c04b16e7-ea40-48f7-a4f3-3fc82c4f2543] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:30:01.383489457Z [2024-05-25 01:30:01,381: INFO/ForkPoolWorker-16] [29982fd0-024e-49a9-a4d4-86e4e69e82e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:30:01.756248177Z [2024-05-25 01:30:01,753: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:30:01.784603304Z [2024-05-25 01:30:01,780: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:30:01.842616644Z [2024-05-25 01:30:01,835: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:30:01.880287399Z [2024-05-25 01:30:01,876: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:30:02.046475917Z [2024-05-25 01:30:02,036: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:30:02.127101163Z [2024-05-25 01:30:02,126: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:30:02.374124279Z [2024-05-25 01:30:02,373: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T01:30:02.383003944Z [2024-05-25 01:30:02,382: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:30:02.474378630Z [2024-05-25 01:30:02,474: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:30:02.475344889Z [2024-05-25 01:30:02,475: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:30:02.475528646Z [2024-05-25 01:30:02,475: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:30:02.475687711Z [2024-05-25 01:30:02,475: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T01:30:02.475996467Z [2024-05-25 01:30:02,475: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:30:02.594837125Z [2024-05-25 01:30:02,594: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:30:02.773841210Z [2024-05-25 01:30:02,773: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[cfc85466-7b00-4850-a082-66e75ac6cadb] succeeded in 1.41565786800129s: None 2024-05-25T01:30:03.165448909Z [2024-05-25 01:30:03,165: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c04b16e7-ea40-48f7-a4f3-3fc82c4f2543] succeeded in 1.8041945069999201s: None 2024-05-25T01:30:03.269798351Z [2024-05-25 01:30:03,269: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:30:03.273132427Z [2024-05-25 01:30:03,272: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:30:03.283361763Z [2024-05-25 01:30:03,282: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T01:30:03.290313830Z [2024-05-25 01:30:03,288: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:30:03.295110139Z [2024-05-25 01:30:03,294: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:30:03.296302112Z [2024-05-25 01:30:03,296: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:30:03.296355365Z [2024-05-25 01:30:03,296: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:30:03.296507039Z [2024-05-25 01:30:03,296: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:30:03.296563028Z [2024-05-25 01:30:03,296: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:30:03.297389740Z [2024-05-25 01:30:03,297: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:30:03.297411572Z [2024-05-25 01:30:03,297: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:30:03.321300523Z [2024-05-25 01:30:03,321: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:30:03.323098390Z [2024-05-25 01:30:03,322: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:30:03.323322485Z [2024-05-25 01:30:03,323: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:30:03.323652870Z [2024-05-25 01:30:03,323: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:30:03.323864113Z [2024-05-25 01:30:03,323: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T01:30:03.324285983Z [2024-05-25 01:30:03,324: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:30:03.324484736Z [2024-05-25 01:30:03,324: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:30:03.383262302Z [2024-05-25 01:30:03,382: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:30:03.406035982Z [2024-05-25 01:30:03,405: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:30:03.504959051Z [2024-05-25 01:30:03,504: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:30:03.508039806Z [2024-05-25 01:30:03,507: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:30:03.528685809Z [2024-05-25 01:30:03,528: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:30:03.530454879Z [2024-05-25 01:30:03,530: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:30:03.530870652Z [2024-05-25 01:30:03,530: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:30:03.531018081Z [2024-05-25 01:30:03,530: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:30:03.531305734Z [2024-05-25 01:30:03,531: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:30:03.531628216Z [2024-05-25 01:30:03,531: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:30:03.531718625Z [2024-05-25 01:30:03,531: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:30:03.607407548Z [2024-05-25 01:30:03,607: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:30:04.007856972Z [2024-05-25 01:30:04,007: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1ca94ec8-200c-41b3-a2cb-218bf3f64782] succeeded in 2.64714106899919s: None 2024-05-25T01:30:04.646041888Z [2024-05-25 01:30:04,645: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f125a8df-21ca-4f78-8ec1-463a522b522a] received 2024-05-25T01:30:04.655719988Z [2024-05-25 01:30:04,655: INFO/ForkPoolWorker-15] [f125a8df-21ca-4f78-8ec1-463a522b522a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:30:04.957793329Z [2024-05-25 01:30:04,955: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:30:05.169810154Z [2024-05-25 01:30:05,169: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[65eb3552-04f6-4790-8e7f-31a45323c67b] succeeded in 3.811696717999439s: None 2024-05-25T01:30:05.999684373Z [2024-05-25 01:30:05,999: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:30:06.003856729Z [2024-05-25 01:30:06,003: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:30:06.033565869Z [2024-05-25 01:30:06,033: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:30:06.034989610Z [2024-05-25 01:30:06,034: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:30:06.035207850Z [2024-05-25 01:30:06,035: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:30:06.035435277Z [2024-05-25 01:30:06,035: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:30:06.035646746Z [2024-05-25 01:30:06,035: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:30:06.035994259Z [2024-05-25 01:30:06,035: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:30:06.036164501Z [2024-05-25 01:30:06,036: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:30:06.120670289Z [2024-05-25 01:30:06,120: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:30:06.644803047Z [2024-05-25 01:30:06,644: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[29982fd0-024e-49a9-a4d4-86e4e69e82e5] succeeded in 5.27872259600008s: None 2024-05-25T01:30:06.775602870Z [2024-05-25 01:30:06,772: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f125a8df-21ca-4f78-8ec1-463a522b522a] succeeded in 2.125214068000787s: None 2024-05-25T01:30:07.505881044Z [2024-05-25 01:30:07,505: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[355ddddc-db98-45ae-b668-0c32bb4b6e69] received 2024-05-25T01:30:07.514619671Z [2024-05-25 01:30:07,514: INFO/ForkPoolWorker-15] [355ddddc-db98-45ae-b668-0c32bb4b6e69] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:30:07.762872834Z [2024-05-25 01:30:07,759: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:30:08.846752936Z [2024-05-25 01:30:08,846: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:30:08.850005558Z [2024-05-25 01:30:08,849: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:30:08.875348113Z [2024-05-25 01:30:08,875: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:30:08.877021671Z [2024-05-25 01:30:08,876: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:30:08.877041321Z [2024-05-25 01:30:08,876: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:30:08.877190778Z [2024-05-25 01:30:08,877: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:30:08.877274113Z [2024-05-25 01:30:08,877: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:30:08.877503007Z [2024-05-25 01:30:08,877: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:30:08.877572021Z [2024-05-25 01:30:08,877: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:30:08.951316883Z [2024-05-25 01:30:08,950: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:30:09.537913568Z [2024-05-25 01:30:09,537: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[355ddddc-db98-45ae-b668-0c32bb4b6e69] succeeded in 2.0300564999997732s: None 2024-05-25T01:30:09.857078875Z [2024-05-25 01:30:09,856: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c55ba35-7747-4baa-bc58-b56f5a1874b9] received 2024-05-25T01:30:09.869021779Z [2024-05-25 01:30:09,868: INFO/ForkPoolWorker-15] [7c55ba35-7747-4baa-bc58-b56f5a1874b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:30:10.145239120Z [2024-05-25 01:30:10,142: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:30:11.217104839Z [2024-05-25 01:30:11,216: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:30:11.221612571Z [2024-05-25 01:30:11,219: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:30:11.243311606Z [2024-05-25 01:30:11,243: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:30:11.244755822Z [2024-05-25 01:30:11,244: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:30:11.244779652Z [2024-05-25 01:30:11,244: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:30:11.245021216Z [2024-05-25 01:30:11,244: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:30:11.245190174Z [2024-05-25 01:30:11,244: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:30:11.245714156Z [2024-05-25 01:30:11,245: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:30:11.246208814Z [2024-05-25 01:30:11,245: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:30:11.358923189Z [2024-05-25 01:30:11,358: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:30:12.003146682Z [2024-05-25 01:30:12,002: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7c55ba35-7747-4baa-bc58-b56f5a1874b9] succeeded in 2.141719738001484s: None 2024-05-25T01:31:00.676563870Z [2024-05-25 01:31:00,676: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ccfba3d8-6418-4ae0-97a9-bda048166955] received 2024-05-25T01:31:00.688976724Z [2024-05-25 01:31:00,688: INFO/ForkPoolWorker-15] [ccfba3d8-6418-4ae0-97a9-bda048166955] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:31:00.695349445Z [2024-05-25 01:31:00,695: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b91c07c-547f-4f1a-92d3-8ad08855dd43] received 2024-05-25T01:31:00.706444824Z [2024-05-25 01:31:00,706: INFO/ForkPoolWorker-16] [9b91c07c-547f-4f1a-92d3-8ad08855dd43] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:31:00.717695278Z [2024-05-25 01:31:00,717: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bef0f22-bef4-4aa0-a9e9-32acaf1e446b] received 2024-05-25T01:31:00.725386587Z [2024-05-25 01:31:00,725: INFO/ForkPoolWorker-1] [9bef0f22-bef4-4aa0-a9e9-32acaf1e446b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:31:01.001039051Z [2024-05-25 01:31:00,998: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:31:01.055496036Z [2024-05-25 01:31:01,052: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:31:01.080691078Z [2024-05-25 01:31:01,077: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:31:01.157393233Z [2024-05-25 01:31:01,156: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T01:31:01.161274100Z [2024-05-25 01:31:01,160: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:31:01.184985709Z [2024-05-25 01:31:01,184: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:31:01.186124103Z [2024-05-25 01:31:01,185: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:31:01.186188746Z [2024-05-25 01:31:01,186: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:31:01.186257589Z [2024-05-25 01:31:01,186: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T01:31:01.186475716Z [2024-05-25 01:31:01,186: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:31:01.273456288Z [2024-05-25 01:31:01,273: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:31:01.874794466Z [2024-05-25 01:31:01,874: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9bef0f22-bef4-4aa0-a9e9-32acaf1e446b] succeeded in 1.155370872000276s: None 2024-05-25T01:31:02.226983959Z [2024-05-25 01:31:02,219: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:31:02.227013710Z [2024-05-25 01:31:02,223: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:31:02.301651219Z [2024-05-25 01:31:02,296: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:31:02.301668705Z [2024-05-25 01:31:02,299: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:31:02.332587912Z [2024-05-25 01:31:02,332: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:31:02.333754034Z [2024-05-25 01:31:02,333: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:31:02.333784505Z [2024-05-25 01:31:02,333: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:31:02.333897903Z [2024-05-25 01:31:02,333: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:31:02.333927206Z [2024-05-25 01:31:02,333: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:31:02.334119416Z [2024-05-25 01:31:02,334: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:31:02.334141388Z [2024-05-25 01:31:02,334: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:31:02.346348154Z [2024-05-25 01:31:02,346: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:31:02.349743151Z [2024-05-25 01:31:02,349: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:31:02.349757702Z [2024-05-25 01:31:02,349: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:31:02.349989053Z [2024-05-25 01:31:02,349: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:31:02.350178884Z [2024-05-25 01:31:02,349: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:31:02.350338439Z [2024-05-25 01:31:02,350: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:31:02.350371738Z [2024-05-25 01:31:02,350: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:31:02.446739852Z [2024-05-25 01:31:02,446: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:31:02.451729570Z [2024-05-25 01:31:02,451: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:31:03.977015773Z [2024-05-25 01:31:03,976: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9b91c07c-547f-4f1a-92d3-8ad08855dd43] succeeded in 3.279821009000443s: None 2024-05-25T01:31:04.319460831Z [2024-05-25 01:31:04,318: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ccfba3d8-6418-4ae0-97a9-bda048166955] succeeded in 3.64088941800037s: None 2024-05-25T01:32:01.075401013Z [2024-05-25 01:32:01,075: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4bdee540-e82f-4ee1-a900-f37e5d9a21ca] received 2024-05-25T01:32:01.082969248Z [2024-05-25 01:32:01,082: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d41cad2-1bcc-4990-ad89-de4eb8e16389] received 2024-05-25T01:32:01.083104726Z [2024-05-25 01:32:01,082: INFO/ForkPoolWorker-15] [4bdee540-e82f-4ee1-a900-f37e5d9a21ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:32:01.086089313Z [2024-05-25 01:32:01,085: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c1ce282-6167-4a68-b0d9-6235b5fa1c3e] received 2024-05-25T01:32:01.094356696Z [2024-05-25 01:32:01,094: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12dda14c-922f-4836-9f71-c518dbd19597] received 2024-05-25T01:32:01.099783413Z [2024-05-25 01:32:01,099: INFO/ForkPoolWorker-1] [0c1ce282-6167-4a68-b0d9-6235b5fa1c3e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:32:01.103202586Z [2024-05-25 01:32:01,102: INFO/ForkPoolWorker-2] [12dda14c-922f-4836-9f71-c518dbd19597] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:32:01.108232214Z [2024-05-25 01:32:01,107: INFO/ForkPoolWorker-16] [4d41cad2-1bcc-4990-ad89-de4eb8e16389] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:32:01.450040343Z [2024-05-25 01:32:01,447: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:32:01.465503548Z [2024-05-25 01:32:01,457: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:32:01.480313818Z [2024-05-25 01:32:01,476: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:32:01.500474805Z [2024-05-25 01:32:01,488: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:32:01.726812362Z [2024-05-25 01:32:01,722: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T01:32:01.732126967Z [2024-05-25 01:32:01,731: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:32:01.770479235Z [2024-05-25 01:32:01,770: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:32:01.773193079Z [2024-05-25 01:32:01,772: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:32:01.773490275Z [2024-05-25 01:32:01,773: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:32:01.773667524Z [2024-05-25 01:32:01,773: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T01:32:01.773943678Z [2024-05-25 01:32:01,773: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:32:01.814366403Z [2024-05-25 01:32:01,814: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:32:01.860212572Z [2024-05-25 01:32:01,859: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:32:02.457494538Z [2024-05-25 01:32:02,457: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[12dda14c-922f-4836-9f71-c518dbd19597] succeeded in 1.3610442970002623s: None 2024-05-25T01:32:02.500338638Z [2024-05-25 01:32:02,499: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4bdee540-e82f-4ee1-a900-f37e5d9a21ca] succeeded in 1.4231324290012708s: None 2024-05-25T01:32:02.724934699Z [2024-05-25 01:32:02,724: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:32:02.728092591Z [2024-05-25 01:32:02,727: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:32:02.745608344Z [2024-05-25 01:32:02,745: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:32:02.746690951Z [2024-05-25 01:32:02,746: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:32:02.746720431Z [2024-05-25 01:32:02,746: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:32:02.746779794Z [2024-05-25 01:32:02,746: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:32:02.746791340Z [2024-05-25 01:32:02,746: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:32:02.747037070Z [2024-05-25 01:32:02,746: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:32:02.747048291Z [2024-05-25 01:32:02,746: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:32:02.808086639Z [2024-05-25 01:32:02,807: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:32:02.811611238Z [2024-05-25 01:32:02,811: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:32:02.831240109Z [2024-05-25 01:32:02,831: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:32:02.833765977Z [2024-05-25 01:32:02,833: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:32:02.833782925Z [2024-05-25 01:32:02,833: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:32:02.834003530Z [2024-05-25 01:32:02,833: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:32:02.834017824Z [2024-05-25 01:32:02,833: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:32:02.834336533Z [2024-05-25 01:32:02,834: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:32:02.834373620Z [2024-05-25 01:32:02,834: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:32:02.844444326Z [2024-05-25 01:32:02,844: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:32:02.918737446Z [2024-05-25 01:32:02,918: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:32:04.672396042Z [2024-05-25 01:32:04,672: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4d41cad2-1bcc-4990-ad89-de4eb8e16389] succeeded in 3.58636622099948s: None 2024-05-25T01:32:05.296460578Z [2024-05-25 01:32:05,295: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0c1ce282-6167-4a68-b0d9-6235b5fa1c3e] succeeded in 4.2080036899988045s: None 2024-05-25T01:33:00.286259803Z [2024-05-25 01:33:00,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17213b18-c275-4bed-b292-702a0a74d3d9] received 2024-05-25T01:33:00.290490478Z [2024-05-25 01:33:00,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[839da832-85e5-472e-acd4-fef52543f631] received 2024-05-25T01:33:00.291576145Z [2024-05-25 01:33:00,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fc6de7f-16b2-44b8-a079-0bec14e84659] received 2024-05-25T01:33:00.292474549Z [2024-05-25 01:33:00,292: INFO/ForkPoolWorker-15] [17213b18-c275-4bed-b292-702a0a74d3d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:33:00.297582896Z [2024-05-25 01:33:00,297: INFO/ForkPoolWorker-16] [839da832-85e5-472e-acd4-fef52543f631] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:33:00.299860329Z [2024-05-25 01:33:00,299: INFO/ForkPoolWorker-1] [9fc6de7f-16b2-44b8-a079-0bec14e84659] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:33:00.585461466Z [2024-05-25 01:33:00,582: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:33:00.586745278Z [2024-05-25 01:33:00,583: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:33:00.595718885Z [2024-05-25 01:33:00,593: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:33:00.738676860Z [2024-05-25 01:33:00,738: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T01:33:00.742313116Z [2024-05-25 01:33:00,741: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:33:00.771906562Z [2024-05-25 01:33:00,771: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:33:00.773118520Z [2024-05-25 01:33:00,772: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:33:00.773342255Z [2024-05-25 01:33:00,773: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:33:00.773445152Z [2024-05-25 01:33:00,773: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T01:33:00.773754470Z [2024-05-25 01:33:00,773: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:33:00.863623883Z [2024-05-25 01:33:00,863: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:33:01.525614402Z [2024-05-25 01:33:01,524: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[839da832-85e5-472e-acd4-fef52543f631] succeeded in 1.2325302959998226s: None 2024-05-25T01:33:01.729379708Z [2024-05-25 01:33:01,728: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:33:01.734017507Z [2024-05-25 01:33:01,733: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:33:01.755841936Z [2024-05-25 01:33:01,755: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:33:01.757421125Z [2024-05-25 01:33:01,757: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:33:01.757559217Z [2024-05-25 01:33:01,757: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:33:01.757732420Z [2024-05-25 01:33:01,757: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:33:01.757833730Z [2024-05-25 01:33:01,757: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:33:01.758136947Z [2024-05-25 01:33:01,757: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:33:01.758260977Z [2024-05-25 01:33:01,758: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:33:01.777583744Z [2024-05-25 01:33:01,777: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:33:01.781230809Z [2024-05-25 01:33:01,780: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:33:01.810588337Z [2024-05-25 01:33:01,810: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:33:01.811934322Z [2024-05-25 01:33:01,811: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:33:01.811963475Z [2024-05-25 01:33:01,811: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:33:01.812096887Z [2024-05-25 01:33:01,811: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:33:01.812217102Z [2024-05-25 01:33:01,812: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:33:01.812477264Z [2024-05-25 01:33:01,812: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:33:01.812600112Z [2024-05-25 01:33:01,812: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:33:01.828469384Z [2024-05-25 01:33:01,828: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:33:01.888250151Z [2024-05-25 01:33:01,888: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:33:03.939877150Z [2024-05-25 01:33:03,939: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[17213b18-c275-4bed-b292-702a0a74d3d9] succeeded in 3.6523535790001915s: None 2024-05-25T01:33:04.863518679Z [2024-05-25 01:33:04,863: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9fc6de7f-16b2-44b8-a079-0bec14e84659] succeeded in 4.569239681000909s: None 2024-05-25T01:34:00.511192473Z [2024-05-25 01:34:00,510: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[318697f6-3c69-4047-b38b-247c15e21172] received 2024-05-25T01:34:00.516856044Z [2024-05-25 01:34:00,516: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2980198d-03b2-4ce8-8f27-3c53c3b00655] received 2024-05-25T01:34:00.519001543Z [2024-05-25 01:34:00,518: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e11c4b1c-3865-4351-82e8-716045770d37] received 2024-05-25T01:34:00.521785751Z [2024-05-25 01:34:00,521: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8e8a4e2-105b-40ff-9b74-2c322d86a0d1] received 2024-05-25T01:34:00.533546024Z [2024-05-25 01:34:00,532: INFO/ForkPoolWorker-2] [d8e8a4e2-105b-40ff-9b74-2c322d86a0d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:34:00.534628950Z [2024-05-25 01:34:00,534: INFO/ForkPoolWorker-1] [e11c4b1c-3865-4351-82e8-716045770d37] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:34:00.539426411Z [2024-05-25 01:34:00,538: INFO/ForkPoolWorker-16] [2980198d-03b2-4ce8-8f27-3c53c3b00655] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:34:00.539754081Z [2024-05-25 01:34:00,539: INFO/ForkPoolWorker-15] [318697f6-3c69-4047-b38b-247c15e21172] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:34:00.840957142Z [2024-05-25 01:34:00,837: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:34:00.844220993Z [2024-05-25 01:34:00,841: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:34:00.892622494Z [2024-05-25 01:34:00,889: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:34:00.896778901Z [2024-05-25 01:34:00,893: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:34:01.077443185Z [2024-05-25 01:34:01,077: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T01:34:01.081572401Z [2024-05-25 01:34:01,081: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:34:01.137965229Z [2024-05-25 01:34:01,137: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:34:01.140124434Z [2024-05-25 01:34:01,139: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:34:01.140264608Z [2024-05-25 01:34:01,140: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:34:01.140320662Z [2024-05-25 01:34:01,140: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T01:34:01.140554770Z [2024-05-25 01:34:01,140: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:34:01.233836921Z [2024-05-25 01:34:01,233: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:34:01.244338546Z [2024-05-25 01:34:01,243: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:34:01.839119529Z [2024-05-25 01:34:01,838: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2980198d-03b2-4ce8-8f27-3c53c3b00655] succeeded in 1.318825120000838s: None 2024-05-25T01:34:01.851215770Z [2024-05-25 01:34:01,850: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e11c4b1c-3865-4351-82e8-716045770d37] succeeded in 1.3284871649993875s: None 2024-05-25T01:34:02.036210425Z [2024-05-25 01:34:02,035: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:34:02.039417383Z [2024-05-25 01:34:02,038: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:34:02.062291539Z [2024-05-25 01:34:02,062: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:34:02.064778770Z [2024-05-25 01:34:02,064: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:34:02.064969355Z [2024-05-25 01:34:02,064: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:34:02.065193005Z [2024-05-25 01:34:02,064: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:34:02.065380478Z [2024-05-25 01:34:02,065: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:34:02.065803971Z [2024-05-25 01:34:02,065: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:34:02.065814278Z [2024-05-25 01:34:02,065: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:34:02.095375681Z [2024-05-25 01:34:02,094: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T01:34:02.099005965Z [2024-05-25 01:34:02,098: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:34:02.149803405Z [2024-05-25 01:34:02,149: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:34:02.153112547Z [2024-05-25 01:34:02,152: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:34:02.153191294Z [2024-05-25 01:34:02,153: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:34:02.153421003Z [2024-05-25 01:34:02,153: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:34:02.153524733Z [2024-05-25 01:34:02,153: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T01:34:02.153976053Z [2024-05-25 01:34:02,153: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:34:02.155126275Z [2024-05-25 01:34:02,153: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:34:02.155785742Z [2024-05-25 01:34:02,155: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:34:02.288782323Z [2024-05-25 01:34:02,288: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:34:03.840158925Z [2024-05-25 01:34:03,839: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[318697f6-3c69-4047-b38b-247c15e21172] succeeded in 3.3253746850004973s: None 2024-05-25T01:34:04.126057788Z [2024-05-25 01:34:04,125: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d8e8a4e2-105b-40ff-9b74-2c322d86a0d1] succeeded in 3.598546000999704s: None 2024-05-25T01:35:00.586757383Z [2024-05-25 01:35:00,586: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed9f6b0f-123f-4008-98df-7670cb435ffe] received 2024-05-25T01:35:00.593316201Z [2024-05-25 01:35:00,592: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31bf35b1-96dc-4b55-bbc1-136ca160daec] received 2024-05-25T01:35:00.597692169Z [2024-05-25 01:35:00,597: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[09ee2057-27a7-4660-b755-c3ac8a7937ae] received 2024-05-25T01:35:00.602050007Z [2024-05-25 01:35:00,601: INFO/ForkPoolWorker-15] [ed9f6b0f-123f-4008-98df-7670cb435ffe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:35:00.603160570Z [2024-05-25 01:35:00,602: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[095304a3-f8b1-4e11-a4ca-d7fcad067e14] received 2024-05-25T01:35:00.604947706Z [2024-05-25 01:35:00,604: INFO/ForkPoolWorker-16] [31bf35b1-96dc-4b55-bbc1-136ca160daec] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:35:00.612743173Z [2024-05-25 01:35:00,612: INFO/ForkPoolWorker-1] [09ee2057-27a7-4660-b755-c3ac8a7937ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:35:00.617925348Z [2024-05-25 01:35:00,617: INFO/ForkPoolWorker-2] [095304a3-f8b1-4e11-a4ca-d7fcad067e14] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:35:00.902359303Z [2024-05-25 01:35:00,899: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:35:00.921242275Z [2024-05-25 01:35:00,917: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:35:00.927337689Z [2024-05-25 01:35:00,924: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:35:01.081431231Z [2024-05-25 01:35:01,080: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T01:35:01.085075754Z [2024-05-25 01:35:01,084: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:35:01.135198503Z [2024-05-25 01:35:01,134: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:35:01.140377005Z [2024-05-25 01:35:01,140: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:35:01.140443727Z [2024-05-25 01:35:01,140: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:35:01.140483371Z [2024-05-25 01:35:01,140: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T01:35:01.141704137Z [2024-05-25 01:35:01,141: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:35:01.142156763Z [2024-05-25 01:35:01,137: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:35:01.407961187Z [2024-05-25 01:35:01,407: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:35:02.065260171Z [2024-05-25 01:35:02,064: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[31bf35b1-96dc-4b55-bbc1-136ca160daec] succeeded in 1.469681145999857s: None 2024-05-25T01:35:02.408962795Z [2024-05-25 01:35:02,408: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T01:35:02.412239967Z [2024-05-25 01:35:02,411: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:35:02.486836753Z [2024-05-25 01:35:02,486: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:35:02.489755909Z [2024-05-25 01:35:02,489: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:35:02.489777084Z [2024-05-25 01:35:02,489: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:35:02.489875766Z [2024-05-25 01:35:02,489: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:35:02.489911768Z [2024-05-25 01:35:02,489: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T01:35:02.490139164Z [2024-05-25 01:35:02,490: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:35:02.490151246Z [2024-05-25 01:35:02,490: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:35:02.506327789Z [2024-05-25 01:35:02,506: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:35:02.510774989Z [2024-05-25 01:35:02,509: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:35:02.557811017Z [2024-05-25 01:35:02,557: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:35:02.562339028Z [2024-05-25 01:35:02,562: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:35:02.562358934Z [2024-05-25 01:35:02,562: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:35:02.562421693Z [2024-05-25 01:35:02,562: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:35:02.562447288Z [2024-05-25 01:35:02,562: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:35:02.562660313Z [2024-05-25 01:35:02,562: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:35:02.562677149Z [2024-05-25 01:35:02,562: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:35:02.584585652Z [2024-05-25 01:35:02,584: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:35:02.678574717Z [2024-05-25 01:35:02,678: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:35:02.735978655Z [2024-05-25 01:35:02,735: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:35:02.739097038Z [2024-05-25 01:35:02,738: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:35:02.763705447Z [2024-05-25 01:35:02,763: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:35:02.767773798Z [2024-05-25 01:35:02,767: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:35:02.767815678Z [2024-05-25 01:35:02,767: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:35:02.767869436Z [2024-05-25 01:35:02,767: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:35:02.767918647Z [2024-05-25 01:35:02,767: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:35:02.768111308Z [2024-05-25 01:35:02,768: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:35:02.768121392Z [2024-05-25 01:35:02,768: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:35:02.863706245Z [2024-05-25 01:35:02,863: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:35:03.461200108Z [2024-05-25 01:35:03,460: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[09ee2057-27a7-4660-b755-c3ac8a7937ae] succeeded in 2.859257666999838s: None 2024-05-25T01:35:03.643380735Z [2024-05-25 01:35:03,642: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c4f245f-c344-4106-8c34-c70fd7e97de0] received 2024-05-25T01:35:03.652711559Z [2024-05-25 01:35:03,652: INFO/ForkPoolWorker-16] [7c4f245f-c344-4106-8c34-c70fd7e97de0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:35:03.950132882Z [2024-05-25 01:35:03,946: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:35:04.103190616Z [2024-05-25 01:35:04,102: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ed9f6b0f-123f-4008-98df-7670cb435ffe] succeeded in 3.512004774000161s: None 2024-05-25T01:35:04.278095347Z [2024-05-25 01:35:04,277: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[095304a3-f8b1-4e11-a4ca-d7fcad067e14] succeeded in 3.6728816340000776s: None 2024-05-25T01:35:05.098000506Z [2024-05-25 01:35:05,096: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:35:05.101349903Z [2024-05-25 01:35:05,100: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:35:05.123118960Z [2024-05-25 01:35:05,122: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:35:05.124331942Z [2024-05-25 01:35:05,124: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:35:05.124365718Z [2024-05-25 01:35:05,124: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:35:05.124516111Z [2024-05-25 01:35:05,124: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:35:05.124532477Z [2024-05-25 01:35:05,124: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:35:05.124823592Z [2024-05-25 01:35:05,124: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:35:05.124929234Z [2024-05-25 01:35:05,124: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:35:05.205986276Z [2024-05-25 01:35:05,205: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:35:05.903852531Z [2024-05-25 01:35:05,903: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7c4f245f-c344-4106-8c34-c70fd7e97de0] succeeded in 2.2581161289999727s: None 2024-05-25T01:35:06.964295174Z [2024-05-25 01:35:06,964: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f535713-30cb-4e84-9e0d-3e9a5cac0b85] received 2024-05-25T01:35:06.973944362Z [2024-05-25 01:35:06,973: INFO/ForkPoolWorker-15] [5f535713-30cb-4e84-9e0d-3e9a5cac0b85] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:35:07.276068271Z [2024-05-25 01:35:07,272: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:35:08.394069632Z [2024-05-25 01:35:08,393: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:35:08.397565958Z [2024-05-25 01:35:08,397: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:35:08.427012414Z [2024-05-25 01:35:08,426: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:35:08.428882849Z [2024-05-25 01:35:08,428: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:35:08.429045998Z [2024-05-25 01:35:08,428: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:35:08.429362712Z [2024-05-25 01:35:08,429: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:35:08.429381953Z [2024-05-25 01:35:08,429: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:35:08.430458863Z [2024-05-25 01:35:08,430: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:35:08.430579701Z [2024-05-25 01:35:08,430: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:35:08.541423751Z [2024-05-25 01:35:08,541: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:35:09.091891741Z [2024-05-25 01:35:09,091: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5f535713-30cb-4e84-9e0d-3e9a5cac0b85] succeeded in 2.1248998869996285s: None 2024-05-25T01:35:09.258532411Z [2024-05-25 01:35:09,258: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54eb7901-a494-4852-82b4-23ef4be6a6e1] received 2024-05-25T01:35:09.266115195Z [2024-05-25 01:35:09,265: INFO/ForkPoolWorker-15] [54eb7901-a494-4852-82b4-23ef4be6a6e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:35:09.546486347Z [2024-05-25 01:35:09,543: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:35:10.606148272Z [2024-05-25 01:35:10,605: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:35:10.609343471Z [2024-05-25 01:35:10,608: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:35:10.631391649Z [2024-05-25 01:35:10,631: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:35:10.633165441Z [2024-05-25 01:35:10,632: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:35:10.633319773Z [2024-05-25 01:35:10,633: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:35:10.633546310Z [2024-05-25 01:35:10,633: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:35:10.633594921Z [2024-05-25 01:35:10,633: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:35:10.633978026Z [2024-05-25 01:35:10,633: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:35:10.634094558Z [2024-05-25 01:35:10,633: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:35:10.734648312Z [2024-05-25 01:35:10,734: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:35:11.376334195Z [2024-05-25 01:35:11,374: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[54eb7901-a494-4852-82b4-23ef4be6a6e1] succeeded in 2.113941485999021s: None 2024-05-25T01:36:01.210002976Z [2024-05-25 01:36:01,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f99b43e-79aa-47a8-a30d-82a6145153ab] received 2024-05-25T01:36:01.212284368Z [2024-05-25 01:36:01,212: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee2b9ef9-44ab-4828-b3fa-6503f1af2db0] received 2024-05-25T01:36:01.214047760Z [2024-05-25 01:36:01,213: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ace68a3e-8bc6-42a1-a31d-c8793cc93c32] received 2024-05-25T01:36:01.215518575Z [2024-05-25 01:36:01,215: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93ac9701-5aee-467f-83bf-ca83abfdc736] received 2024-05-25T01:36:01.225568312Z [2024-05-25 01:36:01,225: INFO/ForkPoolWorker-15] [2f99b43e-79aa-47a8-a30d-82a6145153ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:36:01.226611884Z [2024-05-25 01:36:01,226: INFO/ForkPoolWorker-1] [ace68a3e-8bc6-42a1-a31d-c8793cc93c32] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:36:01.226646805Z [2024-05-25 01:36:01,226: INFO/ForkPoolWorker-2] [93ac9701-5aee-467f-83bf-ca83abfdc736] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:36:01.230180978Z [2024-05-25 01:36:01,229: INFO/ForkPoolWorker-16] [ee2b9ef9-44ab-4828-b3fa-6503f1af2db0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:36:01.622281568Z [2024-05-25 01:36:01,619: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:36:01.648453091Z [2024-05-25 01:36:01,645: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:36:01.699792226Z [2024-05-25 01:36:01,696: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:36:01.709898944Z [2024-05-25 01:36:01,706: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:36:01.899679238Z [2024-05-25 01:36:01,899: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:36:01.932332671Z [2024-05-25 01:36:01,931: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T01:36:01.936579743Z [2024-05-25 01:36:01,936: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:36:01.966417758Z [2024-05-25 01:36:01,966: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:36:01.967414383Z [2024-05-25 01:36:01,967: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:36:01.967441007Z [2024-05-25 01:36:01,967: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:36:01.967501934Z [2024-05-25 01:36:01,967: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T01:36:01.968157170Z [2024-05-25 01:36:01,967: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:36:02.064560569Z [2024-05-25 01:36:02,064: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:36:02.643492251Z [2024-05-25 01:36:02,643: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ee2b9ef9-44ab-4828-b3fa-6503f1af2db0] succeeded in 1.4287688990007155s: None 2024-05-25T01:36:02.799279980Z [2024-05-25 01:36:02,797: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ace68a3e-8bc6-42a1-a31d-c8793cc93c32] succeeded in 1.5809770850009954s: None 2024-05-25T01:36:02.966316461Z [2024-05-25 01:36:02,965: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:36:02.969711020Z [2024-05-25 01:36:02,969: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:36:02.995861936Z [2024-05-25 01:36:02,995: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:36:02.997177402Z [2024-05-25 01:36:02,996: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:36:02.997448977Z [2024-05-25 01:36:02,997: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:36:02.997680656Z [2024-05-25 01:36:02,997: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:36:02.997788952Z [2024-05-25 01:36:02,997: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:36:02.998074986Z [2024-05-25 01:36:02,997: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:36:02.998242169Z [2024-05-25 01:36:02,998: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:36:03.118430969Z [2024-05-25 01:36:03,118: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:36:03.127066015Z [2024-05-25 01:36:03,126: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T01:36:03.130468954Z [2024-05-25 01:36:03,129: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:36:03.161031454Z [2024-05-25 01:36:03,160: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:36:03.162441144Z [2024-05-25 01:36:03,162: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:36:03.162835013Z [2024-05-25 01:36:03,162: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:36:03.163045450Z [2024-05-25 01:36:03,162: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:36:03.163798281Z [2024-05-25 01:36:03,163: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T01:36:03.164076067Z [2024-05-25 01:36:03,163: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:36:03.164172680Z [2024-05-25 01:36:03,164: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:36:03.249715705Z [2024-05-25 01:36:03,249: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:36:05.423386840Z [2024-05-25 01:36:05,422: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2f99b43e-79aa-47a8-a30d-82a6145153ab] succeeded in 4.209486085001117s: None 2024-05-25T01:36:05.933698870Z [2024-05-25 01:36:05,932: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[93ac9701-5aee-467f-83bf-ca83abfdc736] succeeded in 4.716233660999933s: None 2024-05-25T01:37:01.184220431Z [2024-05-25 01:37:01,183: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44f6390e-9e38-46e5-9957-823cf68b9f6c] received 2024-05-25T01:37:01.186496600Z [2024-05-25 01:37:01,186: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10621fcd-87ae-4884-97d3-08d2745d05eb] received 2024-05-25T01:37:01.190260052Z [2024-05-25 01:37:01,190: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f3f11b4-22fa-4aed-ab4f-57695ec01fb1] received 2024-05-25T01:37:01.199051442Z [2024-05-25 01:37:01,198: INFO/ForkPoolWorker-15] [44f6390e-9e38-46e5-9957-823cf68b9f6c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:37:01.202405106Z [2024-05-25 01:37:01,202: INFO/ForkPoolWorker-1] [5f3f11b4-22fa-4aed-ab4f-57695ec01fb1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:37:01.206359106Z [2024-05-25 01:37:01,205: INFO/ForkPoolWorker-16] [10621fcd-87ae-4884-97d3-08d2745d05eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:37:01.559304580Z [2024-05-25 01:37:01,555: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:37:01.573070466Z [2024-05-25 01:37:01,569: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:37:01.595287232Z [2024-05-25 01:37:01,592: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:37:01.713058971Z [2024-05-25 01:37:01,712: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T01:37:01.717406751Z [2024-05-25 01:37:01,716: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:37:01.750945197Z [2024-05-25 01:37:01,750: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:37:01.753200299Z [2024-05-25 01:37:01,752: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:37:01.753301256Z [2024-05-25 01:37:01,753: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:37:01.753369699Z [2024-05-25 01:37:01,753: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T01:37:01.754023005Z [2024-05-25 01:37:01,753: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:37:01.853265056Z [2024-05-25 01:37:01,852: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:37:02.548336724Z [2024-05-25 01:37:02,547: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[44f6390e-9e38-46e5-9957-823cf68b9f6c] succeeded in 1.360391324999s: None 2024-05-25T01:37:02.673781126Z [2024-05-25 01:37:02,673: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:37:02.677032657Z [2024-05-25 01:37:02,676: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:37:02.698624224Z [2024-05-25 01:37:02,698: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:37:02.700189593Z [2024-05-25 01:37:02,699: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:37:02.700330679Z [2024-05-25 01:37:02,700: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:37:02.700566533Z [2024-05-25 01:37:02,700: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:37:02.700716826Z [2024-05-25 01:37:02,700: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:37:02.701004956Z [2024-05-25 01:37:02,700: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:37:02.701151551Z [2024-05-25 01:37:02,701: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:37:02.785721288Z [2024-05-25 01:37:02,785: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:37:02.788780098Z [2024-05-25 01:37:02,788: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:37:02.796941827Z [2024-05-25 01:37:02,796: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:37:02.815344283Z [2024-05-25 01:37:02,815: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:37:02.816583618Z [2024-05-25 01:37:02,816: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:37:02.816719867Z [2024-05-25 01:37:02,816: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:37:02.816883428Z [2024-05-25 01:37:02,816: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:37:02.816966285Z [2024-05-25 01:37:02,816: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:37:02.817189552Z [2024-05-25 01:37:02,817: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:37:02.817554458Z [2024-05-25 01:37:02,817: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:37:02.898571855Z [2024-05-25 01:37:02,898: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:37:04.180311896Z [2024-05-25 01:37:04,179: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[10621fcd-87ae-4884-97d3-08d2745d05eb] succeeded in 2.9897106410007837s: None 2024-05-25T01:37:04.655928211Z [2024-05-25 01:37:04,655: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5f3f11b4-22fa-4aed-ab4f-57695ec01fb1] succeeded in 3.4606142190004903s: None 2024-05-25T01:38:01.196237538Z [2024-05-25 01:38:01,195: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3544ae0f-4ba5-40c2-92ae-176fad83c4b2] received 2024-05-25T01:38:01.198962671Z [2024-05-25 01:38:01,198: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26603dbe-39af-41d4-b26e-3bf24a66f12f] received 2024-05-25T01:38:01.205249142Z [2024-05-25 01:38:01,204: INFO/ForkPoolWorker-15] [3544ae0f-4ba5-40c2-92ae-176fad83c4b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:38:01.210069250Z [2024-05-25 01:38:01,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da2cfa3a-fd7d-49c0-8212-3266ea25ab4e] received 2024-05-25T01:38:01.216417693Z [2024-05-25 01:38:01,213: INFO/ForkPoolWorker-16] [26603dbe-39af-41d4-b26e-3bf24a66f12f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:38:01.216783043Z [2024-05-25 01:38:01,216: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f3da8fb-7461-4f03-b7bf-20b26d898358] received 2024-05-25T01:38:01.229939355Z [2024-05-25 01:38:01,229: INFO/ForkPoolWorker-1] [da2cfa3a-fd7d-49c0-8212-3266ea25ab4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:38:01.233371923Z [2024-05-25 01:38:01,233: INFO/ForkPoolWorker-2] [2f3da8fb-7461-4f03-b7bf-20b26d898358] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:38:01.533030733Z [2024-05-25 01:38:01,523: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:38:01.592832401Z [2024-05-25 01:38:01,588: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:38:01.611724061Z [2024-05-25 01:38:01,603: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:38:01.682821260Z [2024-05-25 01:38:01,678: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:38:01.885231866Z [2024-05-25 01:38:01,884: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T01:38:01.898528013Z [2024-05-25 01:38:01,897: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:38:01.955697350Z [2024-05-25 01:38:01,955: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:38:01.961547108Z [2024-05-25 01:38:01,961: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:38:01.961784115Z [2024-05-25 01:38:01,961: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:38:01.961950759Z [2024-05-25 01:38:01,961: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T01:38:01.962274979Z [2024-05-25 01:38:01,962: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:38:01.994304578Z [2024-05-25 01:38:01,993: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:38:02.118305330Z [2024-05-25 01:38:02,117: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:38:02.820272728Z [2024-05-25 01:38:02,819: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3544ae0f-4ba5-40c2-92ae-176fad83c4b2] succeeded in 1.6198478960013745s: None 2024-05-25T01:38:03.009051444Z [2024-05-25 01:38:03,008: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2f3da8fb-7461-4f03-b7bf-20b26d898358] succeeded in 1.7855397699986497s: None 2024-05-25T01:38:03.152810305Z [2024-05-25 01:38:03,152: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:38:03.156061606Z [2024-05-25 01:38:03,155: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:38:03.161048549Z [2024-05-25 01:38:03,160: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:38:03.164894000Z [2024-05-25 01:38:03,164: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:38:03.179496089Z [2024-05-25 01:38:03,179: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:38:03.181109640Z [2024-05-25 01:38:03,180: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:38:03.181276682Z [2024-05-25 01:38:03,181: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:38:03.181495588Z [2024-05-25 01:38:03,181: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:38:03.181514166Z [2024-05-25 01:38:03,181: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:38:03.181773151Z [2024-05-25 01:38:03,181: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:38:03.181801215Z [2024-05-25 01:38:03,181: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:38:03.194409565Z [2024-05-25 01:38:03,194: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:38:03.196323331Z [2024-05-25 01:38:03,196: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:38:03.196510061Z [2024-05-25 01:38:03,196: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:38:03.196696845Z [2024-05-25 01:38:03,196: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:38:03.196800957Z [2024-05-25 01:38:03,196: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:38:03.197133717Z [2024-05-25 01:38:03,196: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:38:03.197289036Z [2024-05-25 01:38:03,197: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:38:03.270208123Z [2024-05-25 01:38:03,269: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:38:03.274927417Z [2024-05-25 01:38:03,274: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:38:04.950294186Z [2024-05-25 01:38:04,949: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[da2cfa3a-fd7d-49c0-8212-3266ea25ab4e] succeeded in 3.737375967999469s: None 2024-05-25T01:38:05.376428565Z [2024-05-25 01:38:05,375: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[26603dbe-39af-41d4-b26e-3bf24a66f12f] succeeded in 4.172851544999503s: None 2024-05-25T01:39:01.096317625Z [2024-05-25 01:39:01,095: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2563e44-57d0-4e2f-8af3-45034269a0f0] received 2024-05-25T01:39:01.098412660Z [2024-05-25 01:39:01,098: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51f89789-2566-4671-bea9-36ccb42bbb2f] received 2024-05-25T01:39:01.103913092Z [2024-05-25 01:39:01,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75f77fe2-6e24-4c88-8ba1-b36b06d9354f] received 2024-05-25T01:39:01.105006870Z [2024-05-25 01:39:01,104: INFO/ForkPoolWorker-15] [d2563e44-57d0-4e2f-8af3-45034269a0f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:39:01.107837017Z [2024-05-25 01:39:01,107: INFO/ForkPoolWorker-16] [51f89789-2566-4671-bea9-36ccb42bbb2f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:39:01.115654212Z [2024-05-25 01:39:01,115: INFO/ForkPoolWorker-1] [75f77fe2-6e24-4c88-8ba1-b36b06d9354f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:39:01.404174402Z [2024-05-25 01:39:01,393: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:39:01.504377144Z [2024-05-25 01:39:01,501: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:39:01.516288947Z [2024-05-25 01:39:01,512: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:39:01.682722220Z [2024-05-25 01:39:01,681: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T01:39:01.688455081Z [2024-05-25 01:39:01,687: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:39:01.718526043Z [2024-05-25 01:39:01,718: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:39:01.733506073Z [2024-05-25 01:39:01,733: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:39:01.733555565Z [2024-05-25 01:39:01,733: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:39:01.733604477Z [2024-05-25 01:39:01,733: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T01:39:01.735790547Z [2024-05-25 01:39:01,735: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:39:01.860243518Z [2024-05-25 01:39:01,859: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:39:02.479879095Z [2024-05-25 01:39:02,479: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d2563e44-57d0-4e2f-8af3-45034269a0f0] succeeded in 1.3792454689992155s: None 2024-05-25T01:39:02.929261244Z [2024-05-25 01:39:02,928: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:39:02.936017665Z [2024-05-25 01:39:02,935: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:39:02.981385602Z [2024-05-25 01:39:02,981: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:39:02.986550267Z [2024-05-25 01:39:02,986: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:39:02.986592964Z [2024-05-25 01:39:02,986: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:39:02.986864549Z [2024-05-25 01:39:02,986: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:39:02.986988384Z [2024-05-25 01:39:02,986: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:39:02.987512358Z [2024-05-25 01:39:02,987: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:39:02.987585302Z [2024-05-25 01:39:02,987: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:39:02.990203342Z [2024-05-25 01:39:02,989: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:39:02.993986932Z [2024-05-25 01:39:02,993: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:39:03.020196276Z [2024-05-25 01:39:03,019: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:39:03.022075577Z [2024-05-25 01:39:03,021: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:39:03.022280312Z [2024-05-25 01:39:03,022: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:39:03.022505695Z [2024-05-25 01:39:03,022: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:39:03.022611717Z [2024-05-25 01:39:03,022: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:39:03.022969295Z [2024-05-25 01:39:03,022: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:39:03.023112247Z [2024-05-25 01:39:03,022: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:39:03.088830555Z [2024-05-25 01:39:03,088: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:39:03.115046116Z [2024-05-25 01:39:03,114: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:39:04.882227022Z [2024-05-25 01:39:04,881: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[51f89789-2566-4671-bea9-36ccb42bbb2f] succeeded in 3.7825083150000864s: None 2024-05-25T01:39:05.371307587Z [2024-05-25 01:39:05,370: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[75f77fe2-6e24-4c88-8ba1-b36b06d9354f] succeeded in 4.26211747600064s: None 2024-05-25T01:40:00.452015189Z [2024-05-25 01:40:00,451: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd9150de-0513-45e2-99d9-9b1ce5e41489] received 2024-05-25T01:40:00.454850751Z [2024-05-25 01:40:00,454: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d109e635-9783-4bb3-a78b-b221666531e9] received 2024-05-25T01:40:00.456417868Z [2024-05-25 01:40:00,456: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a1df366-7e05-48c1-89b1-ee365ce6ecc4] received 2024-05-25T01:40:00.457886546Z [2024-05-25 01:40:00,457: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd82e19b-d0a6-43da-80b6-cb1efe884830] received 2024-05-25T01:40:00.462286697Z [2024-05-25 01:40:00,462: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80ab262c-9542-4552-bb8f-7bd2795eb95d] received 2024-05-25T01:40:00.463362858Z [2024-05-25 01:40:00,463: INFO/ForkPoolWorker-15] [bd9150de-0513-45e2-99d9-9b1ce5e41489] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:40:00.467602296Z [2024-05-25 01:40:00,467: INFO/ForkPoolWorker-16] [d109e635-9783-4bb3-a78b-b221666531e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:40:00.468065349Z [2024-05-25 01:40:00,467: INFO/ForkPoolWorker-1] [1a1df366-7e05-48c1-89b1-ee365ce6ecc4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:40:00.471303813Z [2024-05-25 01:40:00,470: INFO/ForkPoolWorker-3] [80ab262c-9542-4552-bb8f-7bd2795eb95d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:40:00.474241759Z [2024-05-25 01:40:00,473: INFO/ForkPoolWorker-2] [dd82e19b-d0a6-43da-80b6-cb1efe884830] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:40:00.803165568Z [2024-05-25 01:40:00,800: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:40:00.814960260Z [2024-05-25 01:40:00,809: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:40:00.887523932Z [2024-05-25 01:40:00,884: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:40:00.956051420Z [2024-05-25 01:40:00,953: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:40:00.985944485Z [2024-05-25 01:40:00,976: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:40:01.098993245Z [2024-05-25 01:40:01,098: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:40:01.251581920Z [2024-05-25 01:40:01,251: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-25T01:40:01.256448594Z [2024-05-25 01:40:01,256: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:40:01.294176443Z [2024-05-25 01:40:01,293: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T01:40:01.298285964Z [2024-05-25 01:40:01,298: INFO/ForkPoolWorker-3] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:40:01.298793881Z [2024-05-25 01:40:01,298: INFO/ForkPoolWorker-3] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:40:01.298888083Z [2024-05-25 01:40:01,298: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-25T01:40:01.299327239Z [2024-05-25 01:40:01,299: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:40:01.465344350Z [2024-05-25 01:40:01,465: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:40:01.862568789Z [2024-05-25 01:40:01,862: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[dd82e19b-d0a6-43da-80b6-cb1efe884830] succeeded in 1.4019054870004766s: None 2024-05-25T01:40:02.084869313Z [2024-05-25 01:40:02,084: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[80ab262c-9542-4552-bb8f-7bd2795eb95d] succeeded in 1.6206559160000324s: None 2024-05-25T01:40:02.336452071Z [2024-05-25 01:40:02,336: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:40:02.339731691Z [2024-05-25 01:40:02,339: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:40:02.371260864Z [2024-05-25 01:40:02,371: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:40:02.374845107Z [2024-05-25 01:40:02,374: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:40:02.375229527Z [2024-05-25 01:40:02,374: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:40:02.375779105Z [2024-05-25 01:40:02,375: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:40:02.376160303Z [2024-05-25 01:40:02,375: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:40:02.377450796Z [2024-05-25 01:40:02,376: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:40:02.377713163Z [2024-05-25 01:40:02,377: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:40:02.473975211Z [2024-05-25 01:40:02,473: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:40:02.507921513Z [2024-05-25 01:40:02,507: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:40:02.510778360Z [2024-05-25 01:40:02,510: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:40:02.511192086Z [2024-05-25 01:40:02,510: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:40:02.514129609Z [2024-05-25 01:40:02,513: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:40:02.528961061Z [2024-05-25 01:40:02,528: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:40:02.530289092Z [2024-05-25 01:40:02,530: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:40:02.530305664Z [2024-05-25 01:40:02,530: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:40:02.530408923Z [2024-05-25 01:40:02,530: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:40:02.530423993Z [2024-05-25 01:40:02,530: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:40:02.530741908Z [2024-05-25 01:40:02,530: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:40:02.530780270Z [2024-05-25 01:40:02,530: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:40:02.544613909Z [2024-05-25 01:40:02,543: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:40:02.545101529Z [2024-05-25 01:40:02,544: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:40:02.545117298Z [2024-05-25 01:40:02,544: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:40:02.545293742Z [2024-05-25 01:40:02,545: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:40:02.545305606Z [2024-05-25 01:40:02,545: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:40:02.545559517Z [2024-05-25 01:40:02,545: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:40:02.545618720Z [2024-05-25 01:40:02,545: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:40:02.625000731Z [2024-05-25 01:40:02,624: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:40:02.637154882Z [2024-05-25 01:40:02,636: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:40:03.171319928Z [2024-05-25 01:40:03,170: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bd9150de-0513-45e2-99d9-9b1ce5e41489] succeeded in 2.7155410340001254s: None 2024-05-25T01:40:03.981983635Z [2024-05-25 01:40:03,981: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1a1df366-7e05-48c1-89b1-ee365ce6ecc4] succeeded in 3.5219036450016574s: None 2024-05-25T01:40:04.223667678Z [2024-05-25 01:40:04,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26fbb5bc-c3a9-4d29-8adb-a403d6bb6592] received 2024-05-25T01:40:04.229412344Z [2024-05-25 01:40:04,229: INFO/ForkPoolWorker-15] [26fbb5bc-c3a9-4d29-8adb-a403d6bb6592] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:40:04.551441214Z [2024-05-25 01:40:04,550: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d109e635-9783-4bb3-a78b-b221666531e9] succeeded in 4.094700970999838s: None 2024-05-25T01:40:04.610648695Z [2024-05-25 01:40:04,607: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:40:05.661641318Z [2024-05-25 01:40:05,661: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:40:05.664751579Z [2024-05-25 01:40:05,664: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:40:05.686643812Z [2024-05-25 01:40:05,686: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:40:05.688334422Z [2024-05-25 01:40:05,688: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:40:05.688493506Z [2024-05-25 01:40:05,688: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:40:05.688799844Z [2024-05-25 01:40:05,688: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:40:05.688834525Z [2024-05-25 01:40:05,688: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:40:05.689152030Z [2024-05-25 01:40:05,688: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:40:05.689165289Z [2024-05-25 01:40:05,688: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:40:05.799274088Z [2024-05-25 01:40:05,798: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:40:06.449421956Z [2024-05-25 01:40:06,448: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[26fbb5bc-c3a9-4d29-8adb-a403d6bb6592] succeeded in 2.2237902029992256s: None 2024-05-25T01:40:07.266248681Z [2024-05-25 01:40:07,265: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[111ea150-1119-4426-be13-7408cfe5c123] received 2024-05-25T01:40:07.277196450Z [2024-05-25 01:40:07,276: INFO/ForkPoolWorker-15] [111ea150-1119-4426-be13-7408cfe5c123] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:40:07.547287456Z [2024-05-25 01:40:07,533: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:40:08.578556840Z [2024-05-25 01:40:08,578: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:40:08.581657067Z [2024-05-25 01:40:08,581: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:40:08.608396451Z [2024-05-25 01:40:08,608: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:40:08.609860607Z [2024-05-25 01:40:08,609: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:40:08.609912414Z [2024-05-25 01:40:08,609: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:40:08.610137298Z [2024-05-25 01:40:08,609: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:40:08.610204249Z [2024-05-25 01:40:08,610: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:40:08.610617673Z [2024-05-25 01:40:08,610: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:40:08.610685981Z [2024-05-25 01:40:08,610: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:40:08.704937496Z [2024-05-25 01:40:08,704: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:40:09.309249695Z [2024-05-25 01:40:09,308: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[111ea150-1119-4426-be13-7408cfe5c123] succeeded in 2.0388302020000992s: None 2024-05-25T01:40:09.325626065Z [2024-05-25 01:40:09,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7622c4eb-108f-4462-ac0d-4ba6f0f40d16] received 2024-05-25T01:40:09.332432313Z [2024-05-25 01:40:09,332: INFO/ForkPoolWorker-15] [7622c4eb-108f-4462-ac0d-4ba6f0f40d16] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:40:09.598675812Z [2024-05-25 01:40:09,595: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:40:10.678885857Z [2024-05-25 01:40:10,678: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:40:10.681881092Z [2024-05-25 01:40:10,681: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:40:10.707847751Z [2024-05-25 01:40:10,707: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:40:10.709449833Z [2024-05-25 01:40:10,709: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:40:10.709476045Z [2024-05-25 01:40:10,709: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:40:10.709610544Z [2024-05-25 01:40:10,709: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:40:10.709710776Z [2024-05-25 01:40:10,709: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:40:10.710117262Z [2024-05-25 01:40:10,709: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:40:10.710266064Z [2024-05-25 01:40:10,709: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:40:10.818986057Z [2024-05-25 01:40:10,818: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:40:11.510295904Z [2024-05-25 01:40:11,509: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7622c4eb-108f-4462-ac0d-4ba6f0f40d16] succeeded in 2.1828050399999483s: None 2024-05-25T01:40:38.400897696Z [2024-05-25 01:40:38,400: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96cc24d7-8f29-4a3d-ad13-6723b2a8ac58] received 2024-05-25T01:40:38.416097287Z [2024-05-25 01:40:38,415: INFO/ForkPoolWorker-15] [96cc24d7-8f29-4a3d-ad13-6723b2a8ac58] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240525014037_583623', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-05-25T01:40:38.709570708Z [2024-05-25 01:40:38,706: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-05-25T01:40:39.029934341Z [2024-05-25 01:40:39,029: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:40:39.679826643Z [2024-05-25 01:40:39,678: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[96cc24d7-8f29-4a3d-ad13-6723b2a8ac58] succeeded in 1.2742516090002027s: None 2024-05-25T01:41:00.954011744Z [2024-05-25 01:41:00,953: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0bd8a67c-a863-4784-bb03-d6901480bb77] received 2024-05-25T01:41:00.955893577Z [2024-05-25 01:41:00,955: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df6e03c6-f425-475a-8471-d9ee29cf3600] received 2024-05-25T01:41:00.959978517Z [2024-05-25 01:41:00,959: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a40ff48b-8b0c-4698-9ad5-cee92fbc2f25] received 2024-05-25T01:41:00.961762255Z [2024-05-25 01:41:00,961: INFO/ForkPoolWorker-15] [0bd8a67c-a863-4784-bb03-d6901480bb77] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:41:00.969282305Z [2024-05-25 01:41:00,968: INFO/ForkPoolWorker-16] [df6e03c6-f425-475a-8471-d9ee29cf3600] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:41:00.981267455Z [2024-05-25 01:41:00,980: INFO/ForkPoolWorker-1] [a40ff48b-8b0c-4698-9ad5-cee92fbc2f25] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:41:01.267354278Z [2024-05-25 01:41:01,263: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:41:01.272776812Z [2024-05-25 01:41:01,269: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:41:01.326751310Z [2024-05-25 01:41:01,323: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:41:01.442980286Z [2024-05-25 01:41:01,442: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T01:41:01.449056551Z [2024-05-25 01:41:01,448: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:41:01.470975169Z [2024-05-25 01:41:01,470: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:41:01.472773269Z [2024-05-25 01:41:01,472: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:41:01.473259434Z [2024-05-25 01:41:01,473: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:41:01.473425947Z [2024-05-25 01:41:01,473: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T01:41:01.473714441Z [2024-05-25 01:41:01,473: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:41:01.582094220Z [2024-05-25 01:41:01,581: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:41:02.244528522Z [2024-05-25 01:41:02,242: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[df6e03c6-f425-475a-8471-d9ee29cf3600] succeeded in 1.2847851940005057s: None 2024-05-25T01:41:02.575413267Z [2024-05-25 01:41:02,574: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:41:02.579321256Z [2024-05-25 01:41:02,578: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:41:02.602503424Z [2024-05-25 01:41:02,602: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:41:02.604179251Z [2024-05-25 01:41:02,603: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:41:02.604206747Z [2024-05-25 01:41:02,604: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:41:02.604370929Z [2024-05-25 01:41:02,604: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:41:02.605085843Z [2024-05-25 01:41:02,604: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:41:02.605601591Z [2024-05-25 01:41:02,605: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:41:02.605624007Z [2024-05-25 01:41:02,605: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:41:02.712441895Z [2024-05-25 01:41:02,712: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:41:02.753589750Z [2024-05-25 01:41:02,753: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:41:02.760964799Z [2024-05-25 01:41:02,759: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:41:02.802861654Z [2024-05-25 01:41:02,802: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:41:02.803828813Z [2024-05-25 01:41:02,803: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:41:02.803842717Z [2024-05-25 01:41:02,803: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:41:02.803971909Z [2024-05-25 01:41:02,803: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:41:02.804027421Z [2024-05-25 01:41:02,803: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:41:02.804252351Z [2024-05-25 01:41:02,804: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:41:02.804326596Z [2024-05-25 01:41:02,804: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:41:02.890636088Z [2024-05-25 01:41:02,890: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:41:04.754158365Z [2024-05-25 01:41:04,753: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0bd8a67c-a863-4784-bb03-d6901480bb77] succeeded in 3.797506553000858s: None 2024-05-25T01:41:05.190569643Z [2024-05-25 01:41:05,190: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a40ff48b-8b0c-4698-9ad5-cee92fbc2f25] succeeded in 4.22646967899891s: None 2024-05-25T01:42:00.347237834Z [2024-05-25 01:42:00,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[acd3eaea-9d74-4b32-9f96-a06697727e5e] received 2024-05-25T01:42:00.350917780Z [2024-05-25 01:42:00,350: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2189311-8e3c-4a3e-9f2a-247aaf681fc6] received 2024-05-25T01:42:00.353710997Z [2024-05-25 01:42:00,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd6b8fef-cd3b-4257-b313-193fa761aeee] received 2024-05-25T01:42:00.355931610Z [2024-05-25 01:42:00,355: INFO/ForkPoolWorker-15] [acd3eaea-9d74-4b32-9f96-a06697727e5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:42:00.368850365Z [2024-05-25 01:42:00,368: INFO/ForkPoolWorker-1] [dd6b8fef-cd3b-4257-b313-193fa761aeee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:42:00.368876052Z [2024-05-25 01:42:00,368: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f218ede-f367-4863-993b-2d2510c45b66] received 2024-05-25T01:42:00.369761123Z [2024-05-25 01:42:00,369: INFO/ForkPoolWorker-16] [f2189311-8e3c-4a3e-9f2a-247aaf681fc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:42:00.383007657Z [2024-05-25 01:42:00,382: INFO/ForkPoolWorker-2] [7f218ede-f367-4863-993b-2d2510c45b66] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:42:00.692817746Z [2024-05-25 01:42:00,689: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:42:00.749138313Z [2024-05-25 01:42:00,745: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:42:00.845783495Z [2024-05-25 01:42:00,845: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T01:42:00.849857536Z [2024-05-25 01:42:00,849: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:42:00.869661557Z [2024-05-25 01:42:00,865: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:42:00.892589823Z [2024-05-25 01:42:00,892: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:42:00.895620922Z [2024-05-25 01:42:00,895: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:42:00.895710141Z [2024-05-25 01:42:00,895: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:42:00.895716830Z [2024-05-25 01:42:00,895: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T01:42:00.895894540Z [2024-05-25 01:42:00,895: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:42:00.908642566Z [2024-05-25 01:42:00,904: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:42:01.067726501Z [2024-05-25 01:42:01,065: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:42:01.251182204Z [2024-05-25 01:42:01,250: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:42:01.849571337Z [2024-05-25 01:42:01,849: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7f218ede-f367-4863-993b-2d2510c45b66] succeeded in 1.4751431929998944s: None 2024-05-25T01:42:01.964130235Z [2024-05-25 01:42:01,963: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[acd3eaea-9d74-4b32-9f96-a06697727e5e] succeeded in 1.6136522169999807s: None 2024-05-25T01:42:02.361820096Z [2024-05-25 01:42:02,361: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:42:02.365422070Z [2024-05-25 01:42:02,364: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:42:02.389948413Z [2024-05-25 01:42:02,389: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:42:02.392159250Z [2024-05-25 01:42:02,391: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:42:02.392281492Z [2024-05-25 01:42:02,392: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:42:02.392291757Z [2024-05-25 01:42:02,392: INFO/ForkPoolWorker-16] Read VIM 94ce7c26-be35-4dbf-b2fc-1f33b361005a (basic01_261140) 2024-05-25T01:42:02.392596597Z [2024-05-25 01:42:02,392: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'name': 'basic01_261140', 'vim_type': 'openstack'}] 2024-05-25T01:42:02.392729124Z [2024-05-25 01:42:02,392: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:42:02.393479862Z [2024-05-25 01:42:02,392: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:42:02.393652618Z [2024-05-25 01:42:02,393: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:42:02.398100109Z [2024-05-25 01:42:02,397: INFO/ForkPoolWorker-16] Creating DAG vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a 2024-05-25T01:42:02.420731349Z [2024-05-25 01:42:02,420: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:42:02.425267234Z [2024-05-25 01:42:02,424: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:42:02.444666650Z [2024-05-25 01:42:02,444: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:42:02.453413451Z [2024-05-25 01:42:02,453: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:42:02.453640277Z [2024-05-25 01:42:02,453: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:42:02.455081315Z [2024-05-25 01:42:02,453: INFO/ForkPoolWorker-1] Read VIM 94ce7c26-be35-4dbf-b2fc-1f33b361005a (basic01_261140) 2024-05-25T01:42:02.455931534Z [2024-05-25 01:42:02,455: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'name': 'basic01_261140', 'vim_type': 'openstack'}] 2024-05-25T01:42:02.456155767Z [2024-05-25 01:42:02,455: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:42:02.456609706Z [2024-05-25 01:42:02,456: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:42:02.456822790Z [2024-05-25 01:42:02,456: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:42:02.462143517Z [2024-05-25 01:42:02,461: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a 2024-05-25T01:42:02.475111067Z [2024-05-25 01:42:02,474: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:42:02.547784937Z [2024-05-25 01:42:02,547: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:42:03.951032953Z [2024-05-25 01:42:03,950: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f2189311-8e3c-4a3e-9f2a-247aaf681fc6] succeeded in 3.5949493030002486s: None 2024-05-25T01:42:04.298694117Z [2024-05-25 01:42:04,298: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dd6b8fef-cd3b-4257-b313-193fa761aeee] succeeded in 3.9371901890008303s: None 2024-05-25T01:42:17.635659133Z [2024-05-25 01:42:17,634: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87a0ffb0-6788-4253-adef-915e1bab0687] received 2024-05-25T01:42:17.652898888Z [2024-05-25 01:42:17,652: INFO/ForkPoolWorker-15] [87a0ffb0-6788-4253-adef-915e1bab0687] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:42:17.926201337Z [2024-05-25 01:42:17,922: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:42:19.042936307Z [2024-05-25 01:42:19,042: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:42:19.046655058Z [2024-05-25 01:42:19,046: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:42:19.069530140Z [2024-05-25 01:42:19,069: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:42:19.070902218Z [2024-05-25 01:42:19,070: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:42:19.070949273Z [2024-05-25 01:42:19,070: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:42:19.070968948Z [2024-05-25 01:42:19,070: INFO/ForkPoolWorker-15] Read VIM 94ce7c26-be35-4dbf-b2fc-1f33b361005a (basic01_261140) 2024-05-25T01:42:19.071121936Z [2024-05-25 01:42:19,070: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'name': 'basic01_261140', 'vim_type': 'openstack'}] 2024-05-25T01:42:19.071195112Z [2024-05-25 01:42:19,071: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:42:19.071389608Z [2024-05-25 01:42:19,071: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:42:19.071402027Z [2024-05-25 01:42:19,071: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:42:19.077317675Z [2024-05-25 01:42:19,077: INFO/ForkPoolWorker-15] Creating DAG vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a 2024-05-25T01:42:19.168097790Z [2024-05-25 01:42:19,167: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:42:20.664484122Z [2024-05-25 01:42:20,664: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[87a0ffb0-6788-4253-adef-915e1bab0687] succeeded in 3.0266518120006367s: None 2024-05-25T01:42:26.671220870Z [2024-05-25 01:42:26,670: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2da3a3f4-720a-4d85-8158-1eaff0967761] received 2024-05-25T01:42:26.684385244Z [2024-05-25 01:42:26,684: INFO/ForkPoolWorker-15] [2da3a3f4-720a-4d85-8158-1eaff0967761] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:42:26.974836175Z [2024-05-25 01:42:26,972: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:42:28.121119273Z [2024-05-25 01:42:28,120: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:42:28.125827018Z [2024-05-25 01:42:28,125: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:42:28.147614132Z [2024-05-25 01:42:28,147: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:42:28.149360495Z [2024-05-25 01:42:28,149: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:42:28.149383697Z [2024-05-25 01:42:28,149: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:42:28.149466370Z [2024-05-25 01:42:28,149: INFO/ForkPoolWorker-15] Read VIM 94ce7c26-be35-4dbf-b2fc-1f33b361005a (basic01_261140) 2024-05-25T01:42:28.149607274Z [2024-05-25 01:42:28,149: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'name': 'basic01_261140', 'vim_type': 'openstack'}] 2024-05-25T01:42:28.149682759Z [2024-05-25 01:42:28,149: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:42:28.149956258Z [2024-05-25 01:42:28,149: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:42:28.150196054Z [2024-05-25 01:42:28,150: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:42:28.154186723Z [2024-05-25 01:42:28,154: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a 2024-05-25T01:42:28.248255729Z [2024-05-25 01:42:28,247: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:42:30.090098234Z [2024-05-25 01:42:30,089: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2da3a3f4-720a-4d85-8158-1eaff0967761] succeeded in 3.4169603520003875s: None 2024-05-25T01:42:34.979028233Z [2024-05-25 01:42:34,978: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c359e650-07bd-48be-bb71-1dba2d72fde9] received 2024-05-25T01:42:34.986540539Z [2024-05-25 01:42:34,986: INFO/ForkPoolWorker-15] [c359e650-07bd-48be-bb71-1dba2d72fde9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:42:35.311618252Z [2024-05-25 01:42:35,308: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:42:36.369985564Z [2024-05-25 01:42:36,369: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:42:36.373410140Z [2024-05-25 01:42:36,372: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:42:36.404084760Z [2024-05-25 01:42:36,403: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:42:36.407231989Z [2024-05-25 01:42:36,406: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:42:36.407481794Z [2024-05-25 01:42:36,407: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:42:36.407814551Z [2024-05-25 01:42:36,407: INFO/ForkPoolWorker-15] Read VIM 94ce7c26-be35-4dbf-b2fc-1f33b361005a (basic01_261140) 2024-05-25T01:42:36.408488831Z [2024-05-25 01:42:36,407: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'name': 'basic01_261140', 'vim_type': 'openstack'}] 2024-05-25T01:42:36.408863748Z [2024-05-25 01:42:36,408: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:42:36.410055627Z [2024-05-25 01:42:36,409: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:42:36.410096127Z [2024-05-25 01:42:36,409: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:42:36.424622692Z [2024-05-25 01:42:36,424: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a 2024-05-25T01:42:36.534022213Z [2024-05-25 01:42:36,529: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:42:37.158354667Z [2024-05-25 01:42:37,157: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c359e650-07bd-48be-bb71-1dba2d72fde9] succeeded in 2.1774927629994636s: None 2024-05-25T01:42:37.346270097Z [2024-05-25 01:42:37,345: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00cabccd-87c5-4ea7-b627-f9af9d3e2696] received 2024-05-25T01:42:37.356636229Z [2024-05-25 01:42:37,356: INFO/ForkPoolWorker-15] [00cabccd-87c5-4ea7-b627-f9af9d3e2696] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'split_metrics', 'scheduled__2024-05-25T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:42:37.628058791Z [2024-05-25 01:42:37,624: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:42:38.696793860Z [2024-05-25 01:42:38,696: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:42:38.700082653Z [2024-05-25 01:42:38,699: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:42:38.722335983Z [2024-05-25 01:42:38,722: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:42:38.723766380Z [2024-05-25 01:42:38,723: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:42:38.723936593Z [2024-05-25 01:42:38,723: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:42:38.724046642Z [2024-05-25 01:42:38,723: INFO/ForkPoolWorker-15] Read VIM 94ce7c26-be35-4dbf-b2fc-1f33b361005a (basic01_261140) 2024-05-25T01:42:38.724248140Z [2024-05-25 01:42:38,724: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'name': 'basic01_261140', 'vim_type': 'openstack'}] 2024-05-25T01:42:38.724346378Z [2024-05-25 01:42:38,724: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:42:38.724714099Z [2024-05-25 01:42:38,724: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:42:38.725112033Z [2024-05-25 01:42:38,724: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:42:38.731730539Z [2024-05-25 01:42:38,731: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a 2024-05-25T01:42:38.818876790Z [2024-05-25 01:42:38,818: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:42:39.461148788Z [2024-05-25 01:42:39,460: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3caa19d-f47b-41e9-8ef6-348467878145] received 2024-05-25T01:42:39.478590643Z [2024-05-25 01:42:39,478: INFO/ForkPoolWorker-16] [b3caa19d-f47b-41e9-8ef6-348467878145] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'collect_metrics', 'scheduled__2024-05-25T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:42:39.506171215Z [2024-05-25 01:42:39,505: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[00cabccd-87c5-4ea7-b627-f9af9d3e2696] succeeded in 2.157453005998832s: None 2024-05-25T01:42:39.742570248Z [2024-05-25 01:42:39,739: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:42:40.764199125Z [2024-05-25 01:42:40,763: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:42:40.767404697Z [2024-05-25 01:42:40,766: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:42:40.787816086Z [2024-05-25 01:42:40,787: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:42:40.789297307Z [2024-05-25 01:42:40,789: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:42:40.789320393Z [2024-05-25 01:42:40,789: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:42:40.789392133Z [2024-05-25 01:42:40,789: INFO/ForkPoolWorker-16] Read VIM 94ce7c26-be35-4dbf-b2fc-1f33b361005a (basic01_261140) 2024-05-25T01:42:40.789613305Z [2024-05-25 01:42:40,789: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'name': 'basic01_261140', 'vim_type': 'openstack'}] 2024-05-25T01:42:40.789636849Z [2024-05-25 01:42:40,789: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:42:40.790000710Z [2024-05-25 01:42:40,789: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:42:40.790072961Z [2024-05-25 01:42:40,789: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:42:40.796379586Z [2024-05-25 01:42:40,796: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a 2024-05-25T01:42:40.920437831Z [2024-05-25 01:42:40,920: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:42:41.497838076Z [2024-05-25 01:42:41,497: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b3caa19d-f47b-41e9-8ef6-348467878145] succeeded in 2.0333950929998537s: None 2024-05-25T01:42:41.788518984Z [2024-05-25 01:42:41,787: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24f26896-5811-4a1a-b41a-11fe466cc915] received 2024-05-25T01:42:41.802836599Z [2024-05-25 01:42:41,802: INFO/ForkPoolWorker-15] [24f26896-5811-4a1a-b41a-11fe466cc915] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'send_prometheus', 'scheduled__2024-05-25T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:42:42.082973973Z [2024-05-25 01:42:42,079: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:42:43.198588922Z [2024-05-25 01:42:43,198: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:42:43.201790755Z [2024-05-25 01:42:43,201: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:42:43.230915022Z [2024-05-25 01:42:43,230: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:42:43.232399588Z [2024-05-25 01:42:43,232: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:42:43.232502198Z [2024-05-25 01:42:43,232: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:42:43.232643457Z [2024-05-25 01:42:43,232: INFO/ForkPoolWorker-15] Read VIM 94ce7c26-be35-4dbf-b2fc-1f33b361005a (basic01_261140) 2024-05-25T01:42:43.232844505Z [2024-05-25 01:42:43,232: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'name': 'basic01_261140', 'vim_type': 'openstack'}] 2024-05-25T01:42:43.232980470Z [2024-05-25 01:42:43,232: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:42:43.233399377Z [2024-05-25 01:42:43,233: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:42:43.233945407Z [2024-05-25 01:42:43,233: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:42:43.240983159Z [2024-05-25 01:42:43,240: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a 2024-05-25T01:42:43.318011761Z [2024-05-25 01:42:43,317: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:42:43.959557576Z [2024-05-25 01:42:43,959: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[24f26896-5811-4a1a-b41a-11fe466cc915] succeeded in 2.1681819160003215s: None 2024-05-25T01:43:00.981149970Z [2024-05-25 01:43:00,980: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f8777e5-9add-4772-a135-b7da807a5ba8] received 2024-05-25T01:43:00.987003256Z [2024-05-25 01:43:00,986: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a246621b-6002-49f0-855d-3ed8f5ff3505] received 2024-05-25T01:43:00.988443948Z [2024-05-25 01:43:00,988: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1e3ab68-2913-48dc-869f-1d27bb024e9d] received 2024-05-25T01:43:00.989692014Z [2024-05-25 01:43:00,989: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[025041ce-1af3-497b-b77b-8af7c6eec6d1] received 2024-05-25T01:43:00.990419337Z [2024-05-25 01:43:00,990: INFO/ForkPoolWorker-15] [1f8777e5-9add-4772-a135-b7da807a5ba8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:43:00.991729841Z [2024-05-25 01:43:00,991: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e10f7f9-df59-49e1-863b-f9a80a44bf4f] received 2024-05-25T01:43:00.998830536Z [2024-05-25 01:43:00,998: INFO/ForkPoolWorker-1] [d1e3ab68-2913-48dc-869f-1d27bb024e9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:43:01.014799471Z [2024-05-25 01:43:01,014: INFO/ForkPoolWorker-16] [a246621b-6002-49f0-855d-3ed8f5ff3505] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:43:01.019788981Z [2024-05-25 01:43:01,019: INFO/ForkPoolWorker-2] [025041ce-1af3-497b-b77b-8af7c6eec6d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:43:01.024060137Z [2024-05-25 01:43:01,023: INFO/ForkPoolWorker-3] [5e10f7f9-df59-49e1-863b-f9a80a44bf4f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:43:01.351802214Z [2024-05-25 01:43:01,348: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:43:01.382072708Z [2024-05-25 01:43:01,372: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:43:01.389285455Z [2024-05-25 01:43:01,384: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:43:01.526589675Z [2024-05-25 01:43:01,522: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:43:01.577680369Z [2024-05-25 01:43:01,569: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:43:01.606550134Z [2024-05-25 01:43:01,606: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T01:43:01.614312688Z [2024-05-25 01:43:01,613: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:43:01.662878525Z [2024-05-25 01:43:01,662: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:43:01.665711053Z [2024-05-25 01:43:01,665: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:43:01.668155800Z [2024-05-25 01:43:01,667: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:43:01.668231405Z [2024-05-25 01:43:01,668: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T01:43:01.668513840Z [2024-05-25 01:43:01,668: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:43:01.841247292Z [2024-05-25 01:43:01,839: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:43:02.635296127Z [2024-05-25 01:43:02,634: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1f8777e5-9add-4772-a135-b7da807a5ba8] succeeded in 1.6525179459986248s: None 2024-05-25T01:43:02.739134500Z [2024-05-25 01:43:02,738: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T01:43:02.742540267Z [2024-05-25 01:43:02,742: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:43:02.778836040Z [2024-05-25 01:43:02,778: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:43:02.784042995Z [2024-05-25 01:43:02,783: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:43:02.784892695Z [2024-05-25 01:43:02,783: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:43:02.785070442Z [2024-05-25 01:43:02,784: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:43:02.786002967Z [2024-05-25 01:43:02,785: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T01:43:02.786488270Z [2024-05-25 01:43:02,786: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:43:02.787478324Z [2024-05-25 01:43:02,787: INFO/ForkPoolWorker-2] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:43:02.887288751Z [2024-05-25 01:43:02,887: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:43:02.967439474Z [2024-05-25 01:43:02,967: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:43:02.970761511Z [2024-05-25 01:43:02,970: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:43:02.992478445Z [2024-05-25 01:43:02,992: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:43:02.993633585Z [2024-05-25 01:43:02,993: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:43:02.993672030Z [2024-05-25 01:43:02,993: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:43:02.993822584Z [2024-05-25 01:43:02,993: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:43:02.993873026Z [2024-05-25 01:43:02,993: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:43:02.994801773Z [2024-05-25 01:43:02,994: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:43:02.994856237Z [2024-05-25 01:43:02,994: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:43:03.005749461Z [2024-05-25 01:43:03,005: WARNING/ForkPoolWorker-1] Dag 'vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:43:03.006638584Z [2024-05-25 01:43:03,005: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:43:03.007549905Z [2024-05-25 01:43:03,007: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:43:03.011991428Z [2024-05-25 01:43:03,011: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:43:03.052138406Z [2024-05-25 01:43:03,051: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:43:03.065982848Z [2024-05-25 01:43:03,065: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:43:03.066061669Z [2024-05-25 01:43:03,065: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:43:03.066206839Z [2024-05-25 01:43:03,066: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:43:03.066245166Z [2024-05-25 01:43:03,066: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:43:03.066514258Z [2024-05-25 01:43:03,066: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:43:03.066587623Z [2024-05-25 01:43:03,066: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:43:03.069851111Z [2024-05-25 01:43:03,069: ERROR/ForkPoolWorker-1] [d1e3ab68-2913-48dc-869f-1d27bb024e9d] Failed to execute task Dag 'vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a' could not be found; either it does not exist or it failed to parse.. 2024-05-25T01:43:03.069867275Z Traceback (most recent call last): 2024-05-25T01:43:03.069886382Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-25T01:43:03.069890625Z args.func(args) 2024-05-25T01:43:03.069894310Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-25T01:43:03.069898273Z return func(*args, **kwargs) 2024-05-25T01:43:03.069901604Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-25T01:43:03.069904610Z return f(*args, **kwargs) 2024-05-25T01:43:03.069907708Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-25T01:43:03.069910887Z dag = get_dag(args.subdir, args.dag_id) 2024-05-25T01:43:03.069913984Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-25T01:43:03.069916971Z raise AirflowException( 2024-05-25T01:43:03.069920589Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a' could not be found; either it does not exist or it failed to parse. 2024-05-25T01:43:03.073337241Z [2024-05-25 01:43:03,072: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:43:03.078471336Z [2024-05-25 01:43:03,076: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:43:03.087142659Z [2024-05-25 01:43:03,086: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-25T01:43:03.094345481Z [2024-05-25 01:43:03,093: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:43:03.102227290Z [2024-05-25 01:43:03,101: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d1e3ab68-2913-48dc-869f-1d27bb024e9d] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d1e3ab68-2913-48dc-869f-1d27bb024e9d') 2024-05-25T01:43:03.102256916Z Traceback (most recent call last): 2024-05-25T01:43:03.102260880Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-25T01:43:03.102264406Z R = retval = fun(*args, **kwargs) 2024-05-25T01:43:03.102267502Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-25T01:43:03.102270579Z return self.run(*args, **kwargs) 2024-05-25T01:43:03.102308947Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-25T01:43:03.102313818Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-25T01:43:03.102316945Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-25T01:43:03.102320600Z raise AirflowException(msg) 2024-05-25T01:43:03.102324522Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d1e3ab68-2913-48dc-869f-1d27bb024e9d 2024-05-25T01:43:03.103272990Z [2024-05-25 01:43:03,103: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:43:03.106410676Z [2024-05-25 01:43:03,106: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:43:03.106493698Z [2024-05-25 01:43:03,106: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:43:03.106640283Z [2024-05-25 01:43:03,106: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:43:03.106702191Z [2024-05-25 01:43:03,106: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:43:03.106925923Z [2024-05-25 01:43:03,106: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:43:03.107054020Z [2024-05-25 01:43:03,106: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:43:03.129019172Z [2024-05-25 01:43:03,128: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T01:43:03.134270559Z [2024-05-25 01:43:03,134: INFO/ForkPoolWorker-3] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:43:03.134292091Z [2024-05-25 01:43:03,134: INFO/ForkPoolWorker-3] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:43:03.134576434Z [2024-05-25 01:43:03,134: INFO/ForkPoolWorker-3] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:43:03.134641683Z [2024-05-25 01:43:03,134: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-25T01:43:03.135020874Z [2024-05-25 01:43:03,134: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:43:03.135052956Z [2024-05-25 01:43:03,134: INFO/ForkPoolWorker-3] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:43:03.140662320Z [2024-05-25 01:43:03,140: WARNING/ForkPoolWorker-3] Dag 'vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:43:03.142264687Z [2024-05-25 01:43:03,141: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:43:03.143078647Z [2024-05-25 01:43:03,142: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-25T01:43:03.145793530Z [2024-05-25 01:43:03,145: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:43:03.160914151Z [2024-05-25 01:43:03,160: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T01:43:03.162378871Z [2024-05-25 01:43:03,162: INFO/ForkPoolWorker-3] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:43:03.162494206Z [2024-05-25 01:43:03,162: INFO/ForkPoolWorker-3] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:43:03.162750997Z [2024-05-25 01:43:03,162: INFO/ForkPoolWorker-3] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:43:03.162849049Z [2024-05-25 01:43:03,162: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-25T01:43:03.163142978Z [2024-05-25 01:43:03,163: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:43:03.163753867Z [2024-05-25 01:43:03,163: INFO/ForkPoolWorker-3] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:43:03.167910687Z [2024-05-25 01:43:03,167: ERROR/ForkPoolWorker-3] [5e10f7f9-df59-49e1-863b-f9a80a44bf4f] Failed to execute task Dag 'vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a' could not be found; either it does not exist or it failed to parse.. 2024-05-25T01:43:03.167927349Z Traceback (most recent call last): 2024-05-25T01:43:03.167931460Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-25T01:43:03.167962762Z args.func(args) 2024-05-25T01:43:03.167968078Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-25T01:43:03.167972186Z return func(*args, **kwargs) 2024-05-25T01:43:03.167975282Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-25T01:43:03.167978363Z return f(*args, **kwargs) 2024-05-25T01:43:03.167981498Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-25T01:43:03.167984988Z dag = get_dag(args.subdir, args.dag_id) 2024-05-25T01:43:03.167987995Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-25T01:43:03.167990944Z raise AirflowException( 2024-05-25T01:43:03.167994598Z airflow.exceptions.AirflowException: Dag 'vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a' could not be found; either it does not exist or it failed to parse. 2024-05-25T01:43:03.196348303Z [2024-05-25 01:43:03,196: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:43:03.202259524Z [2024-05-25 01:43:03,201: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[5e10f7f9-df59-49e1-863b-f9a80a44bf4f] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 5e10f7f9-df59-49e1-863b-f9a80a44bf4f') 2024-05-25T01:43:03.202275452Z Traceback (most recent call last): 2024-05-25T01:43:03.202294425Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-25T01:43:03.202298062Z R = retval = fun(*args, **kwargs) 2024-05-25T01:43:03.202301072Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-25T01:43:03.202304265Z return self.run(*args, **kwargs) 2024-05-25T01:43:03.202307810Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-25T01:43:03.202311259Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-25T01:43:03.202314195Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-25T01:43:03.202317631Z raise AirflowException(msg) 2024-05-25T01:43:03.202321174Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 5e10f7f9-df59-49e1-863b-f9a80a44bf4f 2024-05-25T01:43:04.450984136Z [2024-05-25 01:43:04,450: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[025041ce-1af3-497b-b77b-8af7c6eec6d1] succeeded in 3.449749329000042s: None 2024-05-25T01:43:05.227424470Z [2024-05-25 01:43:05,226: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a246621b-6002-49f0-855d-3ed8f5ff3505] succeeded in 4.227730131000499s: None 2024-05-25T01:43:14.200039779Z [2024-05-25 01:43:14,199: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c85f249-9c9a-4933-8855-d6f2058280af] received 2024-05-25T01:43:14.202133832Z [2024-05-25 01:43:14,201: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8464b24-a869-4590-8dde-805c824505ba] received 2024-05-25T01:43:14.211452172Z [2024-05-25 01:43:14,211: INFO/ForkPoolWorker-15] [6c85f249-9c9a-4933-8855-d6f2058280af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:43:14.216126816Z [2024-05-25 01:43:14,215: INFO/ForkPoolWorker-16] [f8464b24-a869-4590-8dde-805c824505ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:43:14.498885859Z [2024-05-25 01:43:14,495: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:43:14.538022011Z [2024-05-25 01:43:14,534: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:43:15.586888351Z [2024-05-25 01:43:15,586: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:43:15.590255632Z [2024-05-25 01:43:15,589: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:43:15.619294679Z [2024-05-25 01:43:15,619: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:43:15.620560011Z [2024-05-25 01:43:15,620: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:43:15.620730155Z [2024-05-25 01:43:15,620: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:43:15.620935601Z [2024-05-25 01:43:15,620: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:43:15.621104902Z [2024-05-25 01:43:15,620: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:43:15.621438196Z [2024-05-25 01:43:15,621: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:43:15.621559342Z [2024-05-25 01:43:15,621: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:43:15.627293361Z [2024-05-25 01:43:15,627: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:43:15.628257621Z [2024-05-25 01:43:15,627: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:43:15.629289819Z [2024-05-25 01:43:15,629: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:43:15.631742518Z [2024-05-25 01:43:15,631: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:43:15.648981617Z [2024-05-25 01:43:15,648: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:43:15.651890461Z [2024-05-25 01:43:15,651: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:43:15.652005260Z [2024-05-25 01:43:15,651: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:43:15.652157152Z [2024-05-25 01:43:15,651: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:43:15.652280174Z [2024-05-25 01:43:15,652: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:43:15.652610276Z [2024-05-25 01:43:15,652: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:43:15.652730095Z [2024-05-25 01:43:15,652: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:43:15.655755599Z [2024-05-25 01:43:15,655: ERROR/ForkPoolWorker-15] [6c85f249-9c9a-4933-8855-d6f2058280af] Failed to execute task Dag 'vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a' could not be found; either it does not exist or it failed to parse.. 2024-05-25T01:43:15.655768694Z Traceback (most recent call last): 2024-05-25T01:43:15.655772751Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-25T01:43:15.655776680Z args.func(args) 2024-05-25T01:43:15.655780090Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-25T01:43:15.655783684Z return func(*args, **kwargs) 2024-05-25T01:43:15.655786750Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-25T01:43:15.655790362Z return f(*args, **kwargs) 2024-05-25T01:43:15.655793659Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-25T01:43:15.655796657Z dag = get_dag(args.subdir, args.dag_id) 2024-05-25T01:43:15.655799643Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-25T01:43:15.655802644Z raise AirflowException( 2024-05-25T01:43:15.655806135Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a' could not be found; either it does not exist or it failed to parse. 2024-05-25T01:43:15.688534773Z [2024-05-25 01:43:15,687: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6c85f249-9c9a-4933-8855-d6f2058280af] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6c85f249-9c9a-4933-8855-d6f2058280af') 2024-05-25T01:43:15.688563201Z Traceback (most recent call last): 2024-05-25T01:43:15.688572473Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-25T01:43:15.688580924Z R = retval = fun(*args, **kwargs) 2024-05-25T01:43:15.688588958Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-25T01:43:15.688596642Z return self.run(*args, **kwargs) 2024-05-25T01:43:15.688604632Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-25T01:43:15.688632771Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-25T01:43:15.688640478Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-25T01:43:15.688648884Z raise AirflowException(msg) 2024-05-25T01:43:15.688657401Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6c85f249-9c9a-4933-8855-d6f2058280af 2024-05-25T01:43:15.785736689Z [2024-05-25 01:43:15,785: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:43:15.789730687Z [2024-05-25 01:43:15,789: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:43:15.818257011Z [2024-05-25 01:43:15,817: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:43:15.820490632Z [2024-05-25 01:43:15,820: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:43:15.820778878Z [2024-05-25 01:43:15,820: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:43:15.821165727Z [2024-05-25 01:43:15,820: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:43:15.821599857Z [2024-05-25 01:43:15,821: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:43:15.822407429Z [2024-05-25 01:43:15,822: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:43:15.822664590Z [2024-05-25 01:43:15,822: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:43:15.830834993Z [2024-05-25 01:43:15,830: WARNING/ForkPoolWorker-16] Dag 'vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:43:15.831816617Z [2024-05-25 01:43:15,831: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:43:15.832795849Z [2024-05-25 01:43:15,832: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:43:15.836027982Z [2024-05-25 01:43:15,835: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:43:15.856902416Z [2024-05-25 01:43:15,856: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:43:15.858846285Z [2024-05-25 01:43:15,858: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:43:15.858867652Z [2024-05-25 01:43:15,858: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:43:15.859707556Z [2024-05-25 01:43:15,858: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:43:15.859948490Z [2024-05-25 01:43:15,859: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:43:15.860639992Z [2024-05-25 01:43:15,860: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:43:15.860866603Z [2024-05-25 01:43:15,860: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:43:15.868268530Z [2024-05-25 01:43:15,867: ERROR/ForkPoolWorker-16] [f8464b24-a869-4590-8dde-805c824505ba] Failed to execute task Dag 'vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a' could not be found; either it does not exist or it failed to parse.. 2024-05-25T01:43:15.868289508Z Traceback (most recent call last): 2024-05-25T01:43:15.868294326Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-25T01:43:15.868298729Z args.func(args) 2024-05-25T01:43:15.868303242Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-25T01:43:15.868308309Z return func(*args, **kwargs) 2024-05-25T01:43:15.868311973Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-25T01:43:15.868315716Z return f(*args, **kwargs) 2024-05-25T01:43:15.868319477Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-25T01:43:15.868323155Z dag = get_dag(args.subdir, args.dag_id) 2024-05-25T01:43:15.868326773Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-25T01:43:15.868330381Z raise AirflowException( 2024-05-25T01:43:15.868334814Z airflow.exceptions.AirflowException: Dag 'vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a' could not be found; either it does not exist or it failed to parse. 2024-05-25T01:43:15.909425018Z [2024-05-25 01:43:15,908: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f8464b24-a869-4590-8dde-805c824505ba] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f8464b24-a869-4590-8dde-805c824505ba') 2024-05-25T01:43:15.909454977Z Traceback (most recent call last): 2024-05-25T01:43:15.909462662Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-25T01:43:15.909468468Z R = retval = fun(*args, **kwargs) 2024-05-25T01:43:15.909474016Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-25T01:43:15.909479644Z return self.run(*args, **kwargs) 2024-05-25T01:43:15.909485489Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-25T01:43:15.909498197Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-25T01:43:15.909503918Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-25T01:43:15.909510246Z raise AirflowException(msg) 2024-05-25T01:43:15.909517381Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f8464b24-a869-4590-8dde-805c824505ba 2024-05-25T01:44:00.307204091Z [2024-05-25 01:44:00,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab636e15-039c-45bc-ae6a-baddfef6bf40] received 2024-05-25T01:44:00.313797149Z [2024-05-25 01:44:00,313: INFO/ForkPoolWorker-15] [ab636e15-039c-45bc-ae6a-baddfef6bf40] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:44:00.319105046Z [2024-05-25 01:44:00,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[104fb7e5-3323-4fa7-adf8-b497bbd784c5] received 2024-05-25T01:44:00.322582397Z [2024-05-25 01:44:00,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0873261-d42c-4642-9506-ac6cbc7275a3] received 2024-05-25T01:44:00.324233943Z [2024-05-25 01:44:00,324: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2868a41c-2283-4174-8529-7e7b41e1f70a] received 2024-05-25T01:44:00.329803346Z [2024-05-25 01:44:00,329: INFO/ForkPoolWorker-1] [c0873261-d42c-4642-9506-ac6cbc7275a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:44:00.330017751Z [2024-05-25 01:44:00,329: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9186e5a-4130-49b0-b57c-e7e99ce4baa4] received 2024-05-25T01:44:00.331967356Z [2024-05-25 01:44:00,331: INFO/ForkPoolWorker-2] [2868a41c-2283-4174-8529-7e7b41e1f70a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:44:00.335437484Z [2024-05-25 01:44:00,335: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83ae85ca-11f8-4d6f-be4b-f47e2333eec5] received 2024-05-25T01:44:00.338100487Z [2024-05-25 01:44:00,337: INFO/ForkPoolWorker-16] [104fb7e5-3323-4fa7-adf8-b497bbd784c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:44:00.345989216Z [2024-05-25 01:44:00,345: INFO/ForkPoolWorker-3] [c9186e5a-4130-49b0-b57c-e7e99ce4baa4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:44:00.348420529Z [2024-05-25 01:44:00,348: INFO/ForkPoolWorker-4] [83ae85ca-11f8-4d6f-be4b-f47e2333eec5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:44:00.694746956Z [2024-05-25 01:44:00,689: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:44:00.827165617Z [2024-05-25 01:44:00,824: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:44:01.136669841Z [2024-05-25 01:44:01,117: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:44:01.193054513Z [2024-05-25 01:44:01,190: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:44:01.345307072Z [2024-05-25 01:44:01,335: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:44:01.658447965Z [2024-05-25 01:44:01,658: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:44:01.720503817Z [2024-05-25 01:44:01,715: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:44:02.195339793Z [2024-05-25 01:44:02,192: INFO/ForkPoolWorker-4] Getting SDNC list 2024-05-25T01:44:02.218626503Z [2024-05-25 01:44:02,217: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:44:02.385871471Z [2024-05-25 01:44:02,385: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-05-25T01:44:02.396907803Z [2024-05-25 01:44:02,396: INFO/ForkPoolWorker-4] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:44:02.396984958Z [2024-05-25 01:44:02,396: INFO/ForkPoolWorker-4] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:44:02.397080011Z [2024-05-25 01:44:02,396: INFO/ForkPoolWorker-4] Getting SDNC list OK 2024-05-25T01:44:02.397347450Z [2024-05-25 01:44:02,397: INFO/ForkPoolWorker-4] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:44:02.662517591Z [2024-05-25 01:44:02,662: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:44:02.679171983Z [2024-05-25 01:44:02,678: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:44:02.682475761Z [2024-05-25 01:44:02,682: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:44:02.728181533Z [2024-05-25 01:44:02,727: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:44:02.735010963Z [2024-05-25 01:44:02,734: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:44:02.735054175Z [2024-05-25 01:44:02,734: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:44:02.735197974Z [2024-05-25 01:44:02,735: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:44:02.735260342Z [2024-05-25 01:44:02,735: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:44:02.735624486Z [2024-05-25 01:44:02,735: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:44:02.736040247Z [2024-05-25 01:44:02,735: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:44:02.742374269Z [2024-05-25 01:44:02,742: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:44:02.745666102Z [2024-05-25 01:44:02,744: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:44:02.746506326Z [2024-05-25 01:44:02,746: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:44:02.763094744Z [2024-05-25 01:44:02,762: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:44:02.808758869Z [2024-05-25 01:44:02,808: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:44:02.814327099Z [2024-05-25 01:44:02,814: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:44:02.814343488Z [2024-05-25 01:44:02,814: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:44:02.814468629Z [2024-05-25 01:44:02,814: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:44:02.814526456Z [2024-05-25 01:44:02,814: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:44:02.814767166Z [2024-05-25 01:44:02,814: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:44:02.814819500Z [2024-05-25 01:44:02,814: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:44:02.817905261Z [2024-05-25 01:44:02,817: ERROR/ForkPoolWorker-15] [ab636e15-039c-45bc-ae6a-baddfef6bf40] Failed to execute task Dag 'vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a' could not be found; either it does not exist or it failed to parse.. 2024-05-25T01:44:02.817917902Z Traceback (most recent call last): 2024-05-25T01:44:02.817921630Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-25T01:44:02.817925161Z args.func(args) 2024-05-25T01:44:02.817928965Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-25T01:44:02.817932418Z return func(*args, **kwargs) 2024-05-25T01:44:02.817935485Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-25T01:44:02.817938565Z return f(*args, **kwargs) 2024-05-25T01:44:02.817941471Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-25T01:44:02.817944540Z dag = get_dag(args.subdir, args.dag_id) 2024-05-25T01:44:02.817947432Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-25T01:44:02.817950368Z raise AirflowException( 2024-05-25T01:44:02.817954096Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a' could not be found; either it does not exist or it failed to parse. 2024-05-25T01:44:02.857467348Z [2024-05-25 01:44:02,856: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ab636e15-039c-45bc-ae6a-baddfef6bf40] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id ab636e15-039c-45bc-ae6a-baddfef6bf40') 2024-05-25T01:44:02.857485086Z Traceback (most recent call last): 2024-05-25T01:44:02.857489273Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-25T01:44:02.857492670Z R = retval = fun(*args, **kwargs) 2024-05-25T01:44:02.857495901Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-25T01:44:02.857498929Z return self.run(*args, **kwargs) 2024-05-25T01:44:02.857502429Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-25T01:44:02.857505976Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-25T01:44:02.857520755Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-25T01:44:02.857524749Z raise AirflowException(msg) 2024-05-25T01:44:02.857528385Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id ab636e15-039c-45bc-ae6a-baddfef6bf40 2024-05-25T01:44:02.892836030Z [2024-05-25 01:44:02,892: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c0873261-d42c-4642-9506-ac6cbc7275a3] succeeded in 2.569001001000288s: None 2024-05-25T01:44:02.989693413Z [2024-05-25 01:44:02,989: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T01:44:02.993387833Z [2024-05-25 01:44:02,992: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:44:03.035461110Z [2024-05-25 01:44:03,035: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:44:03.038225740Z [2024-05-25 01:44:03,038: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:44:03.038341100Z [2024-05-25 01:44:03,038: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:44:03.038514205Z [2024-05-25 01:44:03,038: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:44:03.038613862Z [2024-05-25 01:44:03,038: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T01:44:03.038882817Z [2024-05-25 01:44:03,038: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:44:03.039005083Z [2024-05-25 01:44:03,038: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:44:03.056678723Z [2024-05-25 01:44:03,056: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-25T01:44:03.060039096Z [2024-05-25 01:44:03,059: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:44:03.084688447Z [2024-05-25 01:44:03,084: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T01:44:03.086066601Z [2024-05-25 01:44:03,085: INFO/ForkPoolWorker-3] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:44:03.086081895Z [2024-05-25 01:44:03,086: INFO/ForkPoolWorker-3] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:44:03.086185342Z [2024-05-25 01:44:03,086: INFO/ForkPoolWorker-3] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:44:03.086212046Z [2024-05-25 01:44:03,086: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-25T01:44:03.086472521Z [2024-05-25 01:44:03,086: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:44:03.086517403Z [2024-05-25 01:44:03,086: INFO/ForkPoolWorker-3] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:44:03.092089884Z [2024-05-25 01:44:03,091: WARNING/ForkPoolWorker-3] Dag 'vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:44:03.092803172Z [2024-05-25 01:44:03,092: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:44:03.093639868Z [2024-05-25 01:44:03,093: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-25T01:44:03.096160890Z [2024-05-25 01:44:03,095: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:44:03.121236051Z [2024-05-25 01:44:03,121: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T01:44:03.123796385Z [2024-05-25 01:44:03,123: INFO/ForkPoolWorker-3] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:44:03.123815488Z [2024-05-25 01:44:03,123: INFO/ForkPoolWorker-3] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:44:03.123911757Z [2024-05-25 01:44:03,123: INFO/ForkPoolWorker-3] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:44:03.123935137Z [2024-05-25 01:44:03,123: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-25T01:44:03.124146557Z [2024-05-25 01:44:03,124: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:44:03.124158886Z [2024-05-25 01:44:03,124: INFO/ForkPoolWorker-3] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:44:03.125530192Z [2024-05-25 01:44:03,125: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:44:03.127374415Z [2024-05-25 01:44:03,126: ERROR/ForkPoolWorker-3] [c9186e5a-4130-49b0-b57c-e7e99ce4baa4] Failed to execute task Dag 'vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a' could not be found; either it does not exist or it failed to parse.. 2024-05-25T01:44:03.127381279Z Traceback (most recent call last): 2024-05-25T01:44:03.127385147Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-25T01:44:03.127388827Z args.func(args) 2024-05-25T01:44:03.127392462Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-25T01:44:03.127396328Z return func(*args, **kwargs) 2024-05-25T01:44:03.127400009Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-25T01:44:03.127403125Z return f(*args, **kwargs) 2024-05-25T01:44:03.127406109Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-25T01:44:03.127409337Z dag = get_dag(args.subdir, args.dag_id) 2024-05-25T01:44:03.127412269Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-25T01:44:03.127415351Z raise AirflowException( 2024-05-25T01:44:03.127433526Z airflow.exceptions.AirflowException: Dag 'vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a' could not be found; either it does not exist or it failed to parse. 2024-05-25T01:44:03.173346442Z [2024-05-25 01:44:03,172: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[c9186e5a-4130-49b0-b57c-e7e99ce4baa4] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c9186e5a-4130-49b0-b57c-e7e99ce4baa4') 2024-05-25T01:44:03.173391696Z Traceback (most recent call last): 2024-05-25T01:44:03.173399993Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-25T01:44:03.173407196Z R = retval = fun(*args, **kwargs) 2024-05-25T01:44:03.173413707Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-25T01:44:03.173420010Z return self.run(*args, **kwargs) 2024-05-25T01:44:03.173427114Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-25T01:44:03.173434202Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-25T01:44:03.173440474Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-25T01:44:03.173447311Z raise AirflowException(msg) 2024-05-25T01:44:03.173455907Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c9186e5a-4130-49b0-b57c-e7e99ce4baa4 2024-05-25T01:44:03.337590029Z [2024-05-25 01:44:03,337: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[83ae85ca-11f8-4d6f-be4b-f47e2333eec5] succeeded in 2.9982655740004702s: None 2024-05-25T01:44:03.376001748Z [2024-05-25 01:44:03,375: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:44:03.379093461Z [2024-05-25 01:44:03,378: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:44:03.395844355Z [2024-05-25 01:44:03,395: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:44:03.396865802Z [2024-05-25 01:44:03,396: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:44:03.396872499Z [2024-05-25 01:44:03,396: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:44:03.397014280Z [2024-05-25 01:44:03,396: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:44:03.397019801Z [2024-05-25 01:44:03,396: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:44:03.397196287Z [2024-05-25 01:44:03,397: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:44:03.397308293Z [2024-05-25 01:44:03,397: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:44:03.490326347Z [2024-05-25 01:44:03,490: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:44:05.154350976Z [2024-05-25 01:44:05,153: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[104fb7e5-3323-4fa7-adf8-b497bbd784c5] succeeded in 4.833173130000432s: None 2024-05-25T01:44:05.208275472Z [2024-05-25 01:44:05,207: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2868a41c-2283-4174-8529-7e7b41e1f70a] succeeded in 4.882095944001776s: None 2024-05-25T01:44:14.450213349Z [2024-05-25 01:44:14,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7bd5b587-9473-44d7-8aea-092a2b3b1aa2] received 2024-05-25T01:44:14.460248804Z [2024-05-25 01:44:14,459: INFO/ForkPoolWorker-15] [7bd5b587-9473-44d7-8aea-092a2b3b1aa2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:44:14.460323173Z [2024-05-25 01:44:14,459: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cae6aef4-9bfa-4c0e-ace5-d7800d2c365c] received 2024-05-25T01:44:14.475481426Z [2024-05-25 01:44:14,475: INFO/ForkPoolWorker-16] [cae6aef4-9bfa-4c0e-ace5-d7800d2c365c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:44:14.763593715Z [2024-05-25 01:44:14,760: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:44:14.773714979Z [2024-05-25 01:44:14,770: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:44:15.830379018Z [2024-05-25 01:44:15,829: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:44:15.833587838Z [2024-05-25 01:44:15,833: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:44:15.839842099Z [2024-05-25 01:44:15,839: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:44:15.842924183Z [2024-05-25 01:44:15,842: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:44:15.859232361Z [2024-05-25 01:44:15,858: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:44:15.861021653Z [2024-05-25 01:44:15,860: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:44:15.861060833Z [2024-05-25 01:44:15,860: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:44:15.861070205Z [2024-05-25 01:44:15,860: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:44:15.861091165Z [2024-05-25 01:44:15,860: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:44:15.861397990Z [2024-05-25 01:44:15,861: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:44:15.861424990Z [2024-05-25 01:44:15,861: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:44:15.864885923Z [2024-05-25 01:44:15,864: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:44:15.866370350Z [2024-05-25 01:44:15,866: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:44:15.866408712Z [2024-05-25 01:44:15,866: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:44:15.866591269Z [2024-05-25 01:44:15,866: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:44:15.866628412Z [2024-05-25 01:44:15,866: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:44:15.866956267Z [2024-05-25 01:44:15,866: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:44:15.866988583Z [2024-05-25 01:44:15,866: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:44:15.869105436Z [2024-05-25 01:44:15,868: WARNING/ForkPoolWorker-16] Dag 'vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:44:15.869871919Z [2024-05-25 01:44:15,869: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:44:15.870689407Z [2024-05-25 01:44:15,870: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:44:15.873431306Z [2024-05-25 01:44:15,873: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:44:15.874161433Z [2024-05-25 01:44:15,873: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:44:15.874840844Z [2024-05-25 01:44:15,874: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:44:15.875661001Z [2024-05-25 01:44:15,875: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:44:15.878570532Z [2024-05-25 01:44:15,878: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:44:15.885928010Z [2024-05-25 01:44:15,885: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:44:15.888008909Z [2024-05-25 01:44:15,887: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:44:15.888359372Z [2024-05-25 01:44:15,888: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:44:15.888586534Z [2024-05-25 01:44:15,888: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:44:15.888606031Z [2024-05-25 01:44:15,888: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:44:15.888941564Z [2024-05-25 01:44:15,888: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:44:15.888973760Z [2024-05-25 01:44:15,888: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:44:15.892725469Z [2024-05-25 01:44:15,892: ERROR/ForkPoolWorker-16] [cae6aef4-9bfa-4c0e-ace5-d7800d2c365c] Failed to execute task Dag 'vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a' could not be found; either it does not exist or it failed to parse.. 2024-05-25T01:44:15.892753914Z Traceback (most recent call last): 2024-05-25T01:44:15.892763844Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-25T01:44:15.892772352Z args.func(args) 2024-05-25T01:44:15.892807974Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-25T01:44:15.892817011Z return func(*args, **kwargs) 2024-05-25T01:44:15.892825006Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-25T01:44:15.892832682Z return f(*args, **kwargs) 2024-05-25T01:44:15.892840744Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-25T01:44:15.892848553Z dag = get_dag(args.subdir, args.dag_id) 2024-05-25T01:44:15.892856112Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-25T01:44:15.892863721Z raise AirflowException( 2024-05-25T01:44:15.892889234Z airflow.exceptions.AirflowException: Dag 'vim_status_94ce7c26-be35-4dbf-b2fc-1f33b361005a' could not be found; either it does not exist or it failed to parse. 2024-05-25T01:44:15.900785305Z [2024-05-25 01:44:15,899: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:44:15.901987354Z [2024-05-25 01:44:15,901: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:44:15.902133732Z [2024-05-25 01:44:15,901: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:44:15.902352342Z [2024-05-25 01:44:15,902: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:44:15.902549820Z [2024-05-25 01:44:15,902: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:44:15.902823445Z [2024-05-25 01:44:15,902: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:44:15.902947887Z [2024-05-25 01:44:15,902: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:44:15.907992865Z [2024-05-25 01:44:15,906: ERROR/ForkPoolWorker-15] [7bd5b587-9473-44d7-8aea-092a2b3b1aa2] Failed to execute task Dag 'vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a' could not be found; either it does not exist or it failed to parse.. 2024-05-25T01:44:15.908007089Z Traceback (most recent call last): 2024-05-25T01:44:15.908012891Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-05-25T01:44:15.908018107Z args.func(args) 2024-05-25T01:44:15.908023697Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-05-25T01:44:15.908028963Z return func(*args, **kwargs) 2024-05-25T01:44:15.908033602Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-05-25T01:44:15.908038444Z return f(*args, **kwargs) 2024-05-25T01:44:15.908043177Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-05-25T01:44:15.908048012Z dag = get_dag(args.subdir, args.dag_id) 2024-05-25T01:44:15.908052529Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-05-25T01:44:15.908057090Z raise AirflowException( 2024-05-25T01:44:15.908074082Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_94ce7c26-be35-4dbf-b2fc-1f33b361005a' could not be found; either it does not exist or it failed to parse. 2024-05-25T01:44:15.940536048Z [2024-05-25 01:44:15,939: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cae6aef4-9bfa-4c0e-ace5-d7800d2c365c] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id cae6aef4-9bfa-4c0e-ace5-d7800d2c365c') 2024-05-25T01:44:15.940608617Z Traceback (most recent call last): 2024-05-25T01:44:15.940620906Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-25T01:44:15.940629052Z R = retval = fun(*args, **kwargs) 2024-05-25T01:44:15.940636499Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-25T01:44:15.940644268Z return self.run(*args, **kwargs) 2024-05-25T01:44:15.940652531Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-25T01:44:15.940660731Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-25T01:44:15.940668171Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-25T01:44:15.940676622Z raise AirflowException(msg) 2024-05-25T01:44:15.940685163Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id cae6aef4-9bfa-4c0e-ace5-d7800d2c365c 2024-05-25T01:44:15.943309847Z [2024-05-25 01:44:15,942: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7bd5b587-9473-44d7-8aea-092a2b3b1aa2] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7bd5b587-9473-44d7-8aea-092a2b3b1aa2') 2024-05-25T01:44:15.943327132Z Traceback (most recent call last): 2024-05-25T01:44:15.943331087Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-05-25T01:44:15.943356146Z R = retval = fun(*args, **kwargs) 2024-05-25T01:44:15.943360159Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-05-25T01:44:15.943363243Z return self.run(*args, **kwargs) 2024-05-25T01:44:15.943366405Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-05-25T01:44:15.943369818Z _execute_in_fork(command_to_exec, celery_task_id) 2024-05-25T01:44:15.943373049Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-05-25T01:44:15.943376369Z raise AirflowException(msg) 2024-05-25T01:44:15.943379995Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7bd5b587-9473-44d7-8aea-092a2b3b1aa2 2024-05-25T01:44:38.723525093Z [2024-05-25 01:44:38,721: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b547731-4b72-4931-83eb-fd33d7c9a13d] received 2024-05-25T01:44:38.737627867Z [2024-05-25 01:44:38,737: INFO/ForkPoolWorker-15] [9b547731-4b72-4931-83eb-fd33d7c9a13d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240525014437_760006', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-05-25T01:44:39.036565839Z [2024-05-25 01:44:39,033: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-05-25T01:44:39.369512538Z [2024-05-25 01:44:39,369: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:44:39.971202820Z [2024-05-25 01:44:39,970: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9b547731-4b72-4931-83eb-fd33d7c9a13d] succeeded in 1.2451729320000595s: None 2024-05-25T01:45:00.319169523Z [2024-05-25 01:45:00,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1673afea-b2b4-484e-bdaf-4de1b8000593] received 2024-05-25T01:45:00.321123798Z [2024-05-25 01:45:00,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d32cfd42-7c64-4208-8481-6df47f783f7c] received 2024-05-25T01:45:00.327184530Z [2024-05-25 01:45:00,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dea3d27a-fcb7-4ab1-aef8-bdcc7541793d] received 2024-05-25T01:45:00.327793091Z [2024-05-25 01:45:00,327: INFO/ForkPoolWorker-15] [1673afea-b2b4-484e-bdaf-4de1b8000593] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:45:00.328811926Z [2024-05-25 01:45:00,328: INFO/ForkPoolWorker-16] [d32cfd42-7c64-4208-8481-6df47f783f7c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:45:00.340999915Z [2024-05-25 01:45:00,340: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d42c8857-28c3-4d72-a5c4-9dea88a4d931] received 2024-05-25T01:45:00.341874517Z [2024-05-25 01:45:00,341: INFO/ForkPoolWorker-1] [dea3d27a-fcb7-4ab1-aef8-bdcc7541793d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:45:00.358009790Z [2024-05-25 01:45:00,357: INFO/ForkPoolWorker-2] [d42c8857-28c3-4d72-a5c4-9dea88a4d931] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:45:00.757890954Z [2024-05-25 01:45:00,754: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:45:00.822896184Z [2024-05-25 01:45:00,819: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:45:00.845639344Z [2024-05-25 01:45:00,831: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:45:00.915283035Z [2024-05-25 01:45:00,912: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:45:01.080678719Z [2024-05-25 01:45:01,080: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T01:45:01.084876598Z [2024-05-25 01:45:01,084: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:45:01.146504969Z [2024-05-25 01:45:01,146: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:45:01.147469057Z [2024-05-25 01:45:01,147: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:45:01.147606191Z [2024-05-25 01:45:01,147: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:45:01.147718655Z [2024-05-25 01:45:01,147: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T01:45:01.147951801Z [2024-05-25 01:45:01,147: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:45:01.277040279Z [2024-05-25 01:45:01,276: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:45:01.994691647Z [2024-05-25 01:45:01,994: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dea3d27a-fcb7-4ab1-aef8-bdcc7541793d] succeeded in 1.6607297459995607s: None 2024-05-25T01:45:02.426020424Z [2024-05-25 01:45:02,425: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:45:02.429519218Z [2024-05-25 01:45:02,429: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:45:02.450366007Z [2024-05-25 01:45:02,450: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:45:02.451797735Z [2024-05-25 01:45:02,451: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:45:02.451909380Z [2024-05-25 01:45:02,451: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:45:02.452099019Z [2024-05-25 01:45:02,451: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:45:02.452205779Z [2024-05-25 01:45:02,452: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:45:02.452522692Z [2024-05-25 01:45:02,452: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:45:02.452600921Z [2024-05-25 01:45:02,452: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:45:02.457128859Z [2024-05-25 01:45:02,456: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:45:02.460676220Z [2024-05-25 01:45:02,460: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:45:02.500453333Z [2024-05-25 01:45:02,497: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:45:02.506576299Z [2024-05-25 01:45:02,506: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:45:02.506811880Z [2024-05-25 01:45:02,506: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:45:02.507022178Z [2024-05-25 01:45:02,506: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:45:02.507178935Z [2024-05-25 01:45:02,507: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:45:02.507513779Z [2024-05-25 01:45:02,507: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:45:02.507700418Z [2024-05-25 01:45:02,507: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:45:02.576095720Z [2024-05-25 01:45:02,575: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:45:02.615642691Z [2024-05-25 01:45:02,615: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T01:45:02.620833223Z [2024-05-25 01:45:02,620: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:45:02.641383205Z [2024-05-25 01:45:02,641: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:45:02.655768519Z [2024-05-25 01:45:02,655: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:45:02.656832006Z [2024-05-25 01:45:02,656: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:45:02.656911287Z [2024-05-25 01:45:02,656: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:45:02.657059824Z [2024-05-25 01:45:02,656: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:45:02.657130029Z [2024-05-25 01:45:02,657: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T01:45:02.657467234Z [2024-05-25 01:45:02,657: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:45:02.657556285Z [2024-05-25 01:45:02,657: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:45:02.739681961Z [2024-05-25 01:45:02,739: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:45:03.254440325Z [2024-05-25 01:45:03,253: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d32cfd42-7c64-4208-8481-6df47f783f7c] succeeded in 2.9316536520000227s: None 2024-05-25T01:45:04.020219335Z [2024-05-25 01:45:04,019: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1673afea-b2b4-484e-bdaf-4de1b8000593] succeeded in 3.698904765999032s: None 2024-05-25T01:45:04.310805790Z [2024-05-25 01:45:04,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f0dfee6-1dac-452f-be77-62f04c66815f] received 2024-05-25T01:45:04.323856041Z [2024-05-25 01:45:04,323: INFO/ForkPoolWorker-15] [5f0dfee6-1dac-452f-be77-62f04c66815f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:45:04.615203417Z [2024-05-25 01:45:04,614: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d42c8857-28c3-4d72-a5c4-9dea88a4d931] succeeded in 4.269091013000434s: None 2024-05-25T01:45:04.656886077Z [2024-05-25 01:45:04,654: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:45:05.698377356Z [2024-05-25 01:45:05,697: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:45:05.701458367Z [2024-05-25 01:45:05,700: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:45:05.728323853Z [2024-05-25 01:45:05,728: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:45:05.729991594Z [2024-05-25 01:45:05,729: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:45:05.730019899Z [2024-05-25 01:45:05,729: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:45:05.730182444Z [2024-05-25 01:45:05,729: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:45:05.730219424Z [2024-05-25 01:45:05,730: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:45:05.730742773Z [2024-05-25 01:45:05,730: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:45:05.730798561Z [2024-05-25 01:45:05,730: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:45:05.817469260Z [2024-05-25 01:45:05,817: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:45:06.453940964Z [2024-05-25 01:45:06,453: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5f0dfee6-1dac-452f-be77-62f04c66815f] succeeded in 2.1414736460010317s: None 2024-05-25T01:45:06.930194994Z [2024-05-25 01:45:06,929: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7672d910-be82-43ba-9319-206e2c579720] received 2024-05-25T01:45:06.941457961Z [2024-05-25 01:45:06,940: INFO/ForkPoolWorker-15] [7672d910-be82-43ba-9319-206e2c579720] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:45:07.241559840Z [2024-05-25 01:45:07,238: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:45:08.267993154Z [2024-05-25 01:45:08,267: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:45:08.271103201Z [2024-05-25 01:45:08,270: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:45:08.293437559Z [2024-05-25 01:45:08,293: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:45:08.294936634Z [2024-05-25 01:45:08,294: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:45:08.295032445Z [2024-05-25 01:45:08,294: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:45:08.295324514Z [2024-05-25 01:45:08,295: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:45:08.295451364Z [2024-05-25 01:45:08,295: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:45:08.295754774Z [2024-05-25 01:45:08,295: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:45:08.295938355Z [2024-05-25 01:45:08,295: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:45:08.378033208Z [2024-05-25 01:45:08,377: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:45:09.009688650Z [2024-05-25 01:45:09,009: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7672d910-be82-43ba-9319-206e2c579720] succeeded in 2.0773106630003895s: None 2024-05-25T01:45:09.326870164Z [2024-05-25 01:45:09,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f7281a2-3e38-45c5-a776-6e8e0575747c] received 2024-05-25T01:45:09.336072883Z [2024-05-25 01:45:09,335: INFO/ForkPoolWorker-15] [3f7281a2-3e38-45c5-a776-6e8e0575747c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:45:09.610322847Z [2024-05-25 01:45:09,607: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:45:10.700858056Z [2024-05-25 01:45:10,700: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:45:10.703965127Z [2024-05-25 01:45:10,703: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:45:10.727733028Z [2024-05-25 01:45:10,727: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:45:10.729338109Z [2024-05-25 01:45:10,729: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:45:10.729522820Z [2024-05-25 01:45:10,729: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:45:10.729775665Z [2024-05-25 01:45:10,729: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:45:10.729890005Z [2024-05-25 01:45:10,729: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:45:10.730339911Z [2024-05-25 01:45:10,730: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:45:10.730434488Z [2024-05-25 01:45:10,730: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:45:10.811070869Z [2024-05-25 01:45:10,810: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:45:11.377797210Z [2024-05-25 01:45:11,377: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3f7281a2-3e38-45c5-a776-6e8e0575747c] succeeded in 2.0480922630013083s: None 2024-05-25T01:46:01.264921623Z [2024-05-25 01:46:01,264: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6d62771-0cec-4dfe-8cec-b40db0a5a384] received 2024-05-25T01:46:01.267784121Z [2024-05-25 01:46:01,267: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17c3bd83-82df-4d20-8309-f0f3bf9e3187] received 2024-05-25T01:46:01.273113524Z [2024-05-25 01:46:01,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4034cf78-972c-4016-9e84-d162b0654e5f] received 2024-05-25T01:46:01.283367897Z [2024-05-25 01:46:01,283: INFO/ForkPoolWorker-15] [a6d62771-0cec-4dfe-8cec-b40db0a5a384] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:46:01.283786718Z [2024-05-25 01:46:01,282: INFO/ForkPoolWorker-16] [17c3bd83-82df-4d20-8309-f0f3bf9e3187] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:46:01.284679081Z [2024-05-25 01:46:01,284: INFO/ForkPoolWorker-1] [4034cf78-972c-4016-9e84-d162b0654e5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:46:01.288136576Z [2024-05-25 01:46:01,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fdfc9622-de31-446c-b27a-b334b7d622b0] received 2024-05-25T01:46:01.294125174Z [2024-05-25 01:46:01,293: INFO/ForkPoolWorker-2] [fdfc9622-de31-446c-b27a-b334b7d622b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:46:01.617743685Z [2024-05-25 01:46:01,614: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:46:01.709744825Z [2024-05-25 01:46:01,706: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:46:01.712847587Z [2024-05-25 01:46:01,708: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:46:01.840373230Z [2024-05-25 01:46:01,833: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:46:01.996154856Z [2024-05-25 01:46:01,995: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:46:02.371066798Z [2024-05-25 01:46:02,370: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T01:46:02.376434034Z [2024-05-25 01:46:02,375: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:46:02.443019454Z [2024-05-25 01:46:02,442: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:46:02.452759756Z [2024-05-25 01:46:02,452: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:46:02.453343024Z [2024-05-25 01:46:02,452: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:46:02.453731238Z [2024-05-25 01:46:02,453: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T01:46:02.454487958Z [2024-05-25 01:46:02,454: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:46:02.608030101Z [2024-05-25 01:46:02,607: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:46:03.091975344Z [2024-05-25 01:46:03,091: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4034cf78-972c-4016-9e84-d162b0654e5f] succeeded in 1.8163152219985932s: None 2024-05-25T01:46:03.281629216Z [2024-05-25 01:46:03,281: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:46:03.284801997Z [2024-05-25 01:46:03,284: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:46:03.296292924Z [2024-05-25 01:46:03,295: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[17c3bd83-82df-4d20-8309-f0f3bf9e3187] succeeded in 2.0267993850011408s: None 2024-05-25T01:46:03.302400290Z [2024-05-25 01:46:03,301: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:46:03.303180759Z [2024-05-25 01:46:03,303: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:46:03.303237347Z [2024-05-25 01:46:03,303: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:46:03.303305262Z [2024-05-25 01:46:03,303: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:46:03.303362437Z [2024-05-25 01:46:03,303: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:46:03.303646666Z [2024-05-25 01:46:03,303: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:46:03.303662453Z [2024-05-25 01:46:03,303: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:46:03.380830750Z [2024-05-25 01:46:03,380: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:46:03.509409313Z [2024-05-25 01:46:03,508: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T01:46:03.512786152Z [2024-05-25 01:46:03,512: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:46:03.547671625Z [2024-05-25 01:46:03,545: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:46:03.549261766Z [2024-05-25 01:46:03,548: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:46:03.549396674Z [2024-05-25 01:46:03,549: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:46:03.549620788Z [2024-05-25 01:46:03,549: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:46:03.549818655Z [2024-05-25 01:46:03,549: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T01:46:03.550305270Z [2024-05-25 01:46:03,550: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:46:03.550473630Z [2024-05-25 01:46:03,550: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:46:03.622637881Z [2024-05-25 01:46:03,622: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:46:05.103876443Z [2024-05-25 01:46:05,103: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a6d62771-0cec-4dfe-8cec-b40db0a5a384] succeeded in 3.8368236719998094s: None 2024-05-25T01:46:05.442605896Z [2024-05-25 01:46:05,442: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fdfc9622-de31-446c-b27a-b334b7d622b0] succeeded in 4.1526363819994s: None 2024-05-25T01:47:01.130576526Z [2024-05-25 01:47:01,130: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abc32d2f-5211-46d3-af01-350a54f9083b] received 2024-05-25T01:47:01.138987317Z [2024-05-25 01:47:01,138: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a707651-8f91-4e30-9a97-c2150e101ae5] received 2024-05-25T01:47:01.139388973Z [2024-05-25 01:47:01,139: INFO/ForkPoolWorker-15] [abc32d2f-5211-46d3-af01-350a54f9083b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:47:01.144779577Z [2024-05-25 01:47:01,144: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8c9ee33-59de-48d1-b7d9-25804be71272] received 2024-05-25T01:47:01.152720015Z [2024-05-25 01:47:01,152: INFO/ForkPoolWorker-16] [0a707651-8f91-4e30-9a97-c2150e101ae5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:47:01.153176647Z [2024-05-25 01:47:01,152: INFO/ForkPoolWorker-1] [e8c9ee33-59de-48d1-b7d9-25804be71272] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:47:01.456388503Z [2024-05-25 01:47:01,452: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:47:01.492348927Z [2024-05-25 01:47:01,488: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:47:01.588508883Z [2024-05-25 01:47:01,585: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:47:01.614156774Z [2024-05-25 01:47:01,613: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T01:47:01.618454111Z [2024-05-25 01:47:01,618: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:47:01.637827568Z [2024-05-25 01:47:01,637: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:47:01.642361742Z [2024-05-25 01:47:01,642: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:47:01.642547593Z [2024-05-25 01:47:01,642: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:47:01.642698798Z [2024-05-25 01:47:01,642: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T01:47:01.642954899Z [2024-05-25 01:47:01,642: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:47:01.730756694Z [2024-05-25 01:47:01,730: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:47:02.370152792Z [2024-05-25 01:47:02,369: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e8c9ee33-59de-48d1-b7d9-25804be71272] succeeded in 1.2236971689999336s: None 2024-05-25T01:47:02.815655724Z [2024-05-25 01:47:02,815: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:47:02.819749554Z [2024-05-25 01:47:02,818: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:47:02.854865423Z [2024-05-25 01:47:02,854: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:47:02.856192728Z [2024-05-25 01:47:02,856: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:47:02.856383755Z [2024-05-25 01:47:02,856: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:47:02.856602022Z [2024-05-25 01:47:02,856: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:47:02.856756301Z [2024-05-25 01:47:02,856: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:47:02.857070076Z [2024-05-25 01:47:02,856: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:47:02.857248937Z [2024-05-25 01:47:02,857: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:47:02.901162027Z [2024-05-25 01:47:02,900: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:47:02.904902595Z [2024-05-25 01:47:02,904: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:47:02.923011763Z [2024-05-25 01:47:02,922: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:47:02.924052951Z [2024-05-25 01:47:02,923: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:47:02.924068516Z [2024-05-25 01:47:02,923: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:47:02.924159995Z [2024-05-25 01:47:02,924: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:47:02.924196736Z [2024-05-25 01:47:02,924: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:47:02.924428635Z [2024-05-25 01:47:02,924: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:47:02.924433798Z [2024-05-25 01:47:02,924: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:47:02.939989749Z [2024-05-25 01:47:02,939: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:47:03.020036291Z [2024-05-25 01:47:03,019: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:47:05.047415065Z [2024-05-25 01:47:05,047: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[abc32d2f-5211-46d3-af01-350a54f9083b] succeeded in 3.914983823999137s: None 2024-05-25T01:47:05.810414685Z [2024-05-25 01:47:05,809: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0a707651-8f91-4e30-9a97-c2150e101ae5] succeeded in 4.669274697000219s: None 2024-05-25T01:48:00.978667589Z [2024-05-25 01:48:00,978: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c433fa2-d70c-432a-bb68-5dde17ef43a0] received 2024-05-25T01:48:00.982810620Z [2024-05-25 01:48:00,982: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[afef72ea-4cfc-4532-82d9-65516ad85d7b] received 2024-05-25T01:48:00.991376000Z [2024-05-25 01:48:00,991: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51608f2d-6f36-414b-be7b-e367dfb530e2] received 2024-05-25T01:48:00.992448781Z [2024-05-25 01:48:00,992: INFO/ForkPoolWorker-16] [afef72ea-4cfc-4532-82d9-65516ad85d7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:48:00.996964141Z [2024-05-25 01:48:00,996: INFO/ForkPoolWorker-15] [9c433fa2-d70c-432a-bb68-5dde17ef43a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:48:01.000420081Z [2024-05-25 01:48:01,000: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b6ca594-d486-4c51-ac5a-641e369d3de1] received 2024-05-25T01:48:01.018370866Z [2024-05-25 01:48:01,017: INFO/ForkPoolWorker-1] [51608f2d-6f36-414b-be7b-e367dfb530e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:48:01.026335136Z [2024-05-25 01:48:01,026: INFO/ForkPoolWorker-2] [3b6ca594-d486-4c51-ac5a-641e369d3de1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:48:01.361375661Z [2024-05-25 01:48:01,354: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:48:01.373396117Z [2024-05-25 01:48:01,368: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:48:01.414960097Z [2024-05-25 01:48:01,411: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:48:01.457690623Z [2024-05-25 01:48:01,454: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:48:01.644955001Z [2024-05-25 01:48:01,644: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T01:48:01.655290070Z [2024-05-25 01:48:01,654: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:48:01.699709461Z [2024-05-25 01:48:01,699: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:48:01.703253007Z [2024-05-25 01:48:01,702: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:48:01.703483200Z [2024-05-25 01:48:01,703: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:48:01.703624415Z [2024-05-25 01:48:01,703: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T01:48:01.703896128Z [2024-05-25 01:48:01,703: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:48:01.751199702Z [2024-05-25 01:48:01,750: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:48:01.801634069Z [2024-05-25 01:48:01,801: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:48:02.368706130Z [2024-05-25 01:48:02,367: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9c433fa2-d70c-432a-bb68-5dde17ef43a0] succeeded in 1.3836528200008615s: None 2024-05-25T01:48:02.505162512Z [2024-05-25 01:48:02,504: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3b6ca594-d486-4c51-ac5a-641e369d3de1] succeeded in 1.4905072629990173s: None 2024-05-25T01:48:02.727683813Z [2024-05-25 01:48:02,727: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:48:02.730893056Z [2024-05-25 01:48:02,730: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:48:02.757786606Z [2024-05-25 01:48:02,757: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:48:02.760621117Z [2024-05-25 01:48:02,760: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:48:02.760643499Z [2024-05-25 01:48:02,760: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:48:02.761041073Z [2024-05-25 01:48:02,760: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:48:02.761052772Z [2024-05-25 01:48:02,760: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:48:02.761378318Z [2024-05-25 01:48:02,761: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:48:02.761511330Z [2024-05-25 01:48:02,761: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:48:02.781832788Z [2024-05-25 01:48:02,781: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:48:02.785057294Z [2024-05-25 01:48:02,784: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:48:02.803956647Z [2024-05-25 01:48:02,803: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:48:02.805185755Z [2024-05-25 01:48:02,804: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:48:02.805287365Z [2024-05-25 01:48:02,804: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:48:02.805552865Z [2024-05-25 01:48:02,805: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:48:02.805618066Z [2024-05-25 01:48:02,805: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:48:02.806054597Z [2024-05-25 01:48:02,805: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:48:02.806235834Z [2024-05-25 01:48:02,805: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:48:02.861199785Z [2024-05-25 01:48:02,860: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:48:02.906492810Z [2024-05-25 01:48:02,906: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:48:04.875932752Z [2024-05-25 01:48:04,875: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[51608f2d-6f36-414b-be7b-e367dfb530e2] succeeded in 3.873752774999957s: None 2024-05-25T01:48:05.252262495Z [2024-05-25 01:48:05,251: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[afef72ea-4cfc-4532-82d9-65516ad85d7b] succeeded in 4.266650030000164s: None 2024-05-25T01:49:00.896589369Z [2024-05-25 01:49:00,896: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[339ae252-d447-4ea7-97a6-95b441e5b7f0] received 2024-05-25T01:49:00.903342623Z [2024-05-25 01:49:00,903: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed60f4fe-b7fa-44c3-84c4-6836ae383731] received 2024-05-25T01:49:00.911394791Z [2024-05-25 01:49:00,911: INFO/ForkPoolWorker-16] [ed60f4fe-b7fa-44c3-84c4-6836ae383731] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:49:00.912191325Z [2024-05-25 01:49:00,911: INFO/ForkPoolWorker-15] [339ae252-d447-4ea7-97a6-95b441e5b7f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:49:00.915695130Z [2024-05-25 01:49:00,915: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72d612de-67c2-45af-af08-7bcfdf5a88ed] received 2024-05-25T01:49:00.926783632Z [2024-05-25 01:49:00,926: INFO/ForkPoolWorker-1] [72d612de-67c2-45af-af08-7bcfdf5a88ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:49:01.235127122Z [2024-05-25 01:49:01,232: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:49:01.342610768Z [2024-05-25 01:49:01,337: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:49:01.387800017Z [2024-05-25 01:49:01,383: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:49:01.507880644Z [2024-05-25 01:49:01,507: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T01:49:01.511908557Z [2024-05-25 01:49:01,511: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:49:01.547926917Z [2024-05-25 01:49:01,547: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:49:01.548809989Z [2024-05-25 01:49:01,548: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:49:01.548925053Z [2024-05-25 01:49:01,548: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:49:01.548978997Z [2024-05-25 01:49:01,548: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T01:49:01.549124597Z [2024-05-25 01:49:01,549: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:49:01.642734520Z [2024-05-25 01:49:01,642: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:49:02.305273902Z [2024-05-25 01:49:02,304: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[72d612de-67c2-45af-af08-7bcfdf5a88ed] succeeded in 1.3876910359995236s: None 2024-05-25T01:49:02.441118708Z [2024-05-25 01:49:02,440: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:49:02.444436631Z [2024-05-25 01:49:02,444: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:49:02.462475405Z [2024-05-25 01:49:02,462: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:49:02.463750546Z [2024-05-25 01:49:02,463: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:49:02.463900509Z [2024-05-25 01:49:02,463: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:49:02.464074347Z [2024-05-25 01:49:02,463: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:49:02.464190369Z [2024-05-25 01:49:02,464: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:49:02.464464024Z [2024-05-25 01:49:02,464: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:49:02.464586612Z [2024-05-25 01:49:02,464: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:49:02.577845811Z [2024-05-25 01:49:02,577: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:49:02.586346573Z [2024-05-25 01:49:02,585: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:49:02.589361583Z [2024-05-25 01:49:02,588: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:49:02.615744135Z [2024-05-25 01:49:02,614: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:49:02.616915590Z [2024-05-25 01:49:02,616: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:49:02.616923862Z [2024-05-25 01:49:02,616: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:49:02.617155802Z [2024-05-25 01:49:02,616: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:49:02.617197386Z [2024-05-25 01:49:02,616: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:49:02.617374937Z [2024-05-25 01:49:02,617: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:49:02.617521234Z [2024-05-25 01:49:02,617: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:49:02.729197734Z [2024-05-25 01:49:02,728: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:49:05.071997212Z [2024-05-25 01:49:05,071: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[339ae252-d447-4ea7-97a6-95b441e5b7f0] succeeded in 4.172021303000292s: None 2024-05-25T01:49:05.857456982Z [2024-05-25 01:49:05,856: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ed60f4fe-b7fa-44c3-84c4-6836ae383731] succeeded in 4.951611956001216s: None 2024-05-25T01:50:00.354309883Z [2024-05-25 01:50:00,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a61cd61-8e4e-458f-8bce-074ce0543a6e] received 2024-05-25T01:50:00.356173535Z [2024-05-25 01:50:00,356: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa4a4773-6fa0-494f-9752-b776132956d5] received 2024-05-25T01:50:00.370452755Z [2024-05-25 01:50:00,369: INFO/ForkPoolWorker-15] [3a61cd61-8e4e-458f-8bce-074ce0543a6e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:50:00.381766283Z [2024-05-25 01:50:00,381: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc80499f-3204-46fb-abfe-aa11419c0956] received 2024-05-25T01:50:00.382205080Z [2024-05-25 01:50:00,381: INFO/ForkPoolWorker-16] [aa4a4773-6fa0-494f-9752-b776132956d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:50:00.383851956Z [2024-05-25 01:50:00,383: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d79a9dcb-99ee-4fc7-8845-001cb5bca989] received 2024-05-25T01:50:00.395170806Z [2024-05-25 01:50:00,394: INFO/ForkPoolWorker-2] [d79a9dcb-99ee-4fc7-8845-001cb5bca989] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:50:00.438316034Z [2024-05-25 01:50:00,438: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d343c32a-a809-4f44-8060-b2b6ced50739] received 2024-05-25T01:50:00.439961599Z [2024-05-25 01:50:00,439: INFO/ForkPoolWorker-1] [cc80499f-3204-46fb-abfe-aa11419c0956] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:50:00.468985959Z [2024-05-25 01:50:00,468: INFO/ForkPoolWorker-3] [d343c32a-a809-4f44-8060-b2b6ced50739] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:50:00.835688452Z [2024-05-25 01:50:00,831: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:50:00.920944656Z [2024-05-25 01:50:00,917: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:50:01.110199716Z [2024-05-25 01:50:01,093: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:50:01.178398572Z [2024-05-25 01:50:01,177: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-25T01:50:01.191679368Z [2024-05-25 01:50:01,191: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:50:01.278812156Z [2024-05-25 01:50:01,278: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T01:50:01.289774649Z [2024-05-25 01:50:01,289: INFO/ForkPoolWorker-3] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:50:01.289990800Z [2024-05-25 01:50:01,289: INFO/ForkPoolWorker-3] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:50:01.292228933Z [2024-05-25 01:50:01,289: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-25T01:50:01.292613318Z [2024-05-25 01:50:01,292: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:50:01.318199050Z [2024-05-25 01:50:01,314: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:50:01.425082020Z [2024-05-25 01:50:01,410: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:50:01.654505144Z [2024-05-25 01:50:01,654: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:50:01.680368144Z [2024-05-25 01:50:01,680: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:50:02.768426426Z [2024-05-25 01:50:02,768: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[d343c32a-a809-4f44-8060-b2b6ced50739] succeeded in 2.322496841999964s: None 2024-05-25T01:50:02.782283776Z [2024-05-25 01:50:02,781: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aa4a4773-6fa0-494f-9752-b776132956d5] succeeded in 2.421670446999997s: None 2024-05-25T01:50:03.690898099Z [2024-05-25 01:50:03,690: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:50:03.695265226Z [2024-05-25 01:50:03,694: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:50:03.768832224Z [2024-05-25 01:50:03,768: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:50:03.776522343Z [2024-05-25 01:50:03,776: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:50:03.776690198Z [2024-05-25 01:50:03,776: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:50:03.776927843Z [2024-05-25 01:50:03,776: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:50:03.779027955Z [2024-05-25 01:50:03,776: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:50:03.779442854Z [2024-05-25 01:50:03,779: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:50:03.781265980Z [2024-05-25 01:50:03,781: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:50:03.994044669Z [2024-05-25 01:50:03,993: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T01:50:03.997365998Z [2024-05-25 01:50:03,996: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:50:04.002196448Z [2024-05-25 01:50:04,001: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:50:04.005770513Z [2024-05-25 01:50:04,005: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:50:04.027542627Z [2024-05-25 01:50:04,027: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:50:04.029110480Z [2024-05-25 01:50:04,028: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:50:04.029625404Z [2024-05-25 01:50:04,029: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:50:04.029834656Z [2024-05-25 01:50:04,029: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:50:04.029959924Z [2024-05-25 01:50:04,029: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T01:50:04.030349990Z [2024-05-25 01:50:04,030: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:50:04.030463960Z [2024-05-25 01:50:04,030: INFO/ForkPoolWorker-2] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:50:04.033955569Z [2024-05-25 01:50:04,033: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:50:04.052930860Z [2024-05-25 01:50:04,052: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:50:04.054966781Z [2024-05-25 01:50:04,054: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:50:04.054990535Z [2024-05-25 01:50:04,054: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:50:04.055074423Z [2024-05-25 01:50:04,054: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:50:04.055100418Z [2024-05-25 01:50:04,055: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:50:04.055367161Z [2024-05-25 01:50:04,055: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:50:04.055425225Z [2024-05-25 01:50:04,055: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:50:04.134552739Z [2024-05-25 01:50:04,134: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:50:04.323407741Z [2024-05-25 01:50:04,323: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:50:05.219867267Z [2024-05-25 01:50:05,219: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3a61cd61-8e4e-458f-8bce-074ce0543a6e] succeeded in 4.861662991999765s: None 2024-05-25T01:50:05.516385328Z [2024-05-25 01:50:05,516: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3aeebaad-a4a8-4028-81b6-b3bc25cd8d58] received 2024-05-25T01:50:05.541538010Z [2024-05-25 01:50:05,538: INFO/ForkPoolWorker-15] [3aeebaad-a4a8-4028-81b6-b3bc25cd8d58] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:50:05.963333228Z [2024-05-25 01:50:05,962: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cc80499f-3204-46fb-abfe-aa11419c0956] succeeded in 5.576164890000655s: None 2024-05-25T01:50:05.979334820Z [2024-05-25 01:50:05,978: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d79a9dcb-99ee-4fc7-8845-001cb5bca989] succeeded in 5.593189799001266s: None 2024-05-25T01:50:06.032281110Z [2024-05-25 01:50:06,029: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:50:07.501441937Z [2024-05-25 01:50:07,501: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:50:07.504801302Z [2024-05-25 01:50:07,504: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:50:07.532177530Z [2024-05-25 01:50:07,531: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:50:07.533966914Z [2024-05-25 01:50:07,533: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:50:07.534067795Z [2024-05-25 01:50:07,533: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:50:07.534279816Z [2024-05-25 01:50:07,534: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:50:07.534376345Z [2024-05-25 01:50:07,534: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:50:07.534710677Z [2024-05-25 01:50:07,534: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:50:07.534746463Z [2024-05-25 01:50:07,534: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:50:07.648164285Z [2024-05-25 01:50:07,647: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:50:08.598464781Z [2024-05-25 01:50:08,598: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2bb963f-fad3-40de-bd11-4eeea076dd98] received 2024-05-25T01:50:08.607477241Z [2024-05-25 01:50:08,607: INFO/ForkPoolWorker-16] [a2bb963f-fad3-40de-bd11-4eeea076dd98] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:50:08.646874578Z [2024-05-25 01:50:08,646: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3aeebaad-a4a8-4028-81b6-b3bc25cd8d58] succeeded in 3.1242992440002126s: None 2024-05-25T01:50:08.898446262Z [2024-05-25 01:50:08,895: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:50:10.459874665Z [2024-05-25 01:50:10,459: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:50:10.463135175Z [2024-05-25 01:50:10,462: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:50:10.489333115Z [2024-05-25 01:50:10,489: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:50:10.494260817Z [2024-05-25 01:50:10,494: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:50:10.494381170Z [2024-05-25 01:50:10,494: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:50:10.494589509Z [2024-05-25 01:50:10,494: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:50:10.494723571Z [2024-05-25 01:50:10,494: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:50:10.495027995Z [2024-05-25 01:50:10,494: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:50:10.495218626Z [2024-05-25 01:50:10,495: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:50:10.573433650Z [2024-05-25 01:50:10,573: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:50:11.137656896Z [2024-05-25 01:50:11,135: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a2bb963f-fad3-40de-bd11-4eeea076dd98] succeeded in 2.5360962400009157s: None 2024-05-25T01:50:12.024616280Z [2024-05-25 01:50:12,024: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff6ea538-2133-472a-81e1-bb0f04d38ad9] received 2024-05-25T01:50:12.043662625Z [2024-05-25 01:50:12,043: INFO/ForkPoolWorker-15] [ff6ea538-2133-472a-81e1-bb0f04d38ad9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:50:12.665887675Z [2024-05-25 01:50:12,660: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:50:14.051722633Z [2024-05-25 01:50:14,051: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:50:14.055141767Z [2024-05-25 01:50:14,054: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:50:14.076528111Z [2024-05-25 01:50:14,076: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:50:14.081586587Z [2024-05-25 01:50:14,081: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:50:14.081670555Z [2024-05-25 01:50:14,081: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:50:14.081925035Z [2024-05-25 01:50:14,081: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:50:14.082027669Z [2024-05-25 01:50:14,081: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:50:14.082302298Z [2024-05-25 01:50:14,082: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:50:14.082377372Z [2024-05-25 01:50:14,082: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:50:14.172691155Z [2024-05-25 01:50:14,172: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:50:14.742290774Z [2024-05-25 01:50:14,741: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ff6ea538-2133-472a-81e1-bb0f04d38ad9] succeeded in 2.713433996999811s: None 2024-05-25T01:51:00.642624473Z [2024-05-25 01:51:00,642: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d93999e-6f0d-4cd2-b339-26c74809303b] received 2024-05-25T01:51:00.646638535Z [2024-05-25 01:51:00,646: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec59da92-493c-49b7-80a5-66f00eef64bf] received 2024-05-25T01:51:00.660316122Z [2024-05-25 01:51:00,659: INFO/ForkPoolWorker-16] [ec59da92-493c-49b7-80a5-66f00eef64bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:51:00.666272662Z [2024-05-25 01:51:00,665: INFO/ForkPoolWorker-15] [9d93999e-6f0d-4cd2-b339-26c74809303b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:51:00.669913214Z [2024-05-25 01:51:00,669: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5365fd2d-4c0f-4d4b-b557-a999bc99d72e] received 2024-05-25T01:51:00.681793365Z [2024-05-25 01:51:00,681: INFO/ForkPoolWorker-1] [5365fd2d-4c0f-4d4b-b557-a999bc99d72e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:51:01.000760301Z [2024-05-25 01:51:00,997: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:51:01.010064351Z [2024-05-25 01:51:01,006: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:51:01.072320686Z [2024-05-25 01:51:01,068: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:51:01.181097986Z [2024-05-25 01:51:01,180: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T01:51:01.185776121Z [2024-05-25 01:51:01,185: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:51:01.235435644Z [2024-05-25 01:51:01,235: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:51:01.238658792Z [2024-05-25 01:51:01,238: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:51:01.239141778Z [2024-05-25 01:51:01,238: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:51:01.242483074Z [2024-05-25 01:51:01,239: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T01:51:01.243267665Z [2024-05-25 01:51:01,242: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:51:01.349270012Z [2024-05-25 01:51:01,348: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:51:01.928863155Z [2024-05-25 01:51:01,928: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ec59da92-493c-49b7-80a5-66f00eef64bf] succeeded in 1.2799062349986343s: None 2024-05-25T01:51:02.257801535Z [2024-05-25 01:51:02,257: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:51:02.265261154Z [2024-05-25 01:51:02,260: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:51:02.353064528Z [2024-05-25 01:51:02,352: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:51:02.362514579Z [2024-05-25 01:51:02,362: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:51:02.362591311Z [2024-05-25 01:51:02,362: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:51:02.362721714Z [2024-05-25 01:51:02,362: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:51:02.362843841Z [2024-05-25 01:51:02,362: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:51:02.363324401Z [2024-05-25 01:51:02,362: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:51:02.363539639Z [2024-05-25 01:51:02,363: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:51:02.465113345Z [2024-05-25 01:51:02,464: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:51:02.468278157Z [2024-05-25 01:51:02,467: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:51:02.476031571Z [2024-05-25 01:51:02,475: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:51:02.484512277Z [2024-05-25 01:51:02,484: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:51:02.485927033Z [2024-05-25 01:51:02,485: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:51:02.485982912Z [2024-05-25 01:51:02,485: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:51:02.486083258Z [2024-05-25 01:51:02,485: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:51:02.486121849Z [2024-05-25 01:51:02,486: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:51:02.486378026Z [2024-05-25 01:51:02,486: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:51:02.486440872Z [2024-05-25 01:51:02,486: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:51:02.561366042Z [2024-05-25 01:51:02,561: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:51:04.239551296Z [2024-05-25 01:51:04,237: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5365fd2d-4c0f-4d4b-b557-a999bc99d72e] succeeded in 3.566466047999711s: None 2024-05-25T01:51:04.400247082Z [2024-05-25 01:51:04,399: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9d93999e-6f0d-4cd2-b339-26c74809303b] succeeded in 3.7551514349997888s: None 2024-05-25T01:52:00.720717314Z [2024-05-25 01:52:00,720: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd12aad3-c517-4ba2-819f-e6c66fe6e807] received 2024-05-25T01:52:00.724144145Z [2024-05-25 01:52:00,723: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7c09928-0239-4466-9638-c81a927acc0c] received 2024-05-25T01:52:00.732670550Z [2024-05-25 01:52:00,732: INFO/ForkPoolWorker-15] [bd12aad3-c517-4ba2-819f-e6c66fe6e807] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:52:00.734968216Z [2024-05-25 01:52:00,734: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32a90b74-fc6e-47b9-96c8-f89e20a76c98] received 2024-05-25T01:52:00.743125616Z [2024-05-25 01:52:00,742: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9aa62d1-1494-4348-aaa3-a5f9077a7b9f] received 2024-05-25T01:52:00.750937266Z [2024-05-25 01:52:00,750: INFO/ForkPoolWorker-16] [b7c09928-0239-4466-9638-c81a927acc0c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:52:00.751558897Z [2024-05-25 01:52:00,751: INFO/ForkPoolWorker-1] [32a90b74-fc6e-47b9-96c8-f89e20a76c98] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:52:00.760788159Z [2024-05-25 01:52:00,760: INFO/ForkPoolWorker-2] [e9aa62d1-1494-4348-aaa3-a5f9077a7b9f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:52:01.045521417Z [2024-05-25 01:52:01,042: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:52:01.129115990Z [2024-05-25 01:52:01,126: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:52:01.230889875Z [2024-05-25 01:52:01,222: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:52:01.239359460Z [2024-05-25 01:52:01,235: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:52:01.357926674Z [2024-05-25 01:52:01,357: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:52:01.405612382Z [2024-05-25 01:52:01,399: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T01:52:01.405626059Z [2024-05-25 01:52:01,404: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:52:01.451930435Z [2024-05-25 01:52:01,451: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:52:01.453554157Z [2024-05-25 01:52:01,453: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:52:01.453765716Z [2024-05-25 01:52:01,453: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:52:01.453924318Z [2024-05-25 01:52:01,453: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T01:52:01.454204719Z [2024-05-25 01:52:01,454: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:52:01.573669747Z [2024-05-25 01:52:01,573: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:52:01.993711473Z [2024-05-25 01:52:01,993: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[32a90b74-fc6e-47b9-96c8-f89e20a76c98] succeeded in 1.2566878230009024s: None 2024-05-25T01:52:02.135563230Z [2024-05-25 01:52:02,134: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b7c09928-0239-4466-9638-c81a927acc0c] succeeded in 1.4085822390006797s: None 2024-05-25T01:52:02.670299196Z [2024-05-25 01:52:02,669: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T01:52:02.673652008Z [2024-05-25 01:52:02,673: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:52:02.702767377Z [2024-05-25 01:52:02,702: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:52:02.706207622Z [2024-05-25 01:52:02,705: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:52:02.706291944Z [2024-05-25 01:52:02,706: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:52:02.706491687Z [2024-05-25 01:52:02,706: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:52:02.706534656Z [2024-05-25 01:52:02,706: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T01:52:02.706728390Z [2024-05-25 01:52:02,706: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:52:02.706797070Z [2024-05-25 01:52:02,706: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:52:02.815469185Z [2024-05-25 01:52:02,815: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:52:02.860776231Z [2024-05-25 01:52:02,860: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:52:02.864101904Z [2024-05-25 01:52:02,863: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:52:02.889372389Z [2024-05-25 01:52:02,889: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:52:02.890837612Z [2024-05-25 01:52:02,890: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:52:02.891130333Z [2024-05-25 01:52:02,890: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:52:02.891359177Z [2024-05-25 01:52:02,891: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:52:02.891506857Z [2024-05-25 01:52:02,891: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:52:02.891802633Z [2024-05-25 01:52:02,891: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:52:02.892253285Z [2024-05-25 01:52:02,892: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:52:02.989859028Z [2024-05-25 01:52:02,989: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:52:04.576509927Z [2024-05-25 01:52:04,575: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bd12aad3-c517-4ba2-819f-e6c66fe6e807] succeeded in 3.8527246880003077s: None 2024-05-25T01:52:04.767744798Z [2024-05-25 01:52:04,767: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e9aa62d1-1494-4348-aaa3-a5f9077a7b9f] succeeded in 4.022601713999393s: None 2024-05-25T01:53:00.457559579Z [2024-05-25 01:53:00,456: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b47e5a9d-84da-4b9b-9353-a97dadfc904d] received 2024-05-25T01:53:00.465034205Z [2024-05-25 01:53:00,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b148c80d-babf-4882-886e-b47917a7ebb3] received 2024-05-25T01:53:00.480504764Z [2024-05-25 01:53:00,480: INFO/ForkPoolWorker-16] [b148c80d-babf-4882-886e-b47917a7ebb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:53:00.484918871Z [2024-05-25 01:53:00,484: INFO/ForkPoolWorker-15] [b47e5a9d-84da-4b9b-9353-a97dadfc904d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:53:00.485527542Z [2024-05-25 01:53:00,485: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2817f76-3490-4b86-ba02-acb6603e08da] received 2024-05-25T01:53:00.501663624Z [2024-05-25 01:53:00,501: INFO/ForkPoolWorker-1] [e2817f76-3490-4b86-ba02-acb6603e08da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:53:00.878037768Z [2024-05-25 01:53:00,873: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:53:00.911294771Z [2024-05-25 01:53:00,901: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:53:00.953886883Z [2024-05-25 01:53:00,950: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:53:01.121887180Z [2024-05-25 01:53:01,121: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T01:53:01.125897841Z [2024-05-25 01:53:01,125: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:53:01.158364699Z [2024-05-25 01:53:01,158: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:53:01.159459201Z [2024-05-25 01:53:01,159: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:53:01.159817946Z [2024-05-25 01:53:01,159: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:53:01.160096214Z [2024-05-25 01:53:01,159: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T01:53:01.160357432Z [2024-05-25 01:53:01,160: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:53:01.239791245Z [2024-05-25 01:53:01,239: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:53:01.832161054Z [2024-05-25 01:53:01,831: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b148c80d-babf-4882-886e-b47917a7ebb3] succeeded in 1.3608574570007477s: None 2024-05-25T01:53:02.311167439Z [2024-05-25 01:53:02,310: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:53:02.325479690Z [2024-05-25 01:53:02,324: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:53:02.374945650Z [2024-05-25 01:53:02,374: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:53:02.376800684Z [2024-05-25 01:53:02,376: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:53:02.376853277Z [2024-05-25 01:53:02,376: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:53:02.377033438Z [2024-05-25 01:53:02,376: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:53:02.377085809Z [2024-05-25 01:53:02,377: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:53:02.378186910Z [2024-05-25 01:53:02,377: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:53:02.378281297Z [2024-05-25 01:53:02,378: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:53:02.475328877Z [2024-05-25 01:53:02,474: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:53:02.496952900Z [2024-05-25 01:53:02,496: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:53:02.500913075Z [2024-05-25 01:53:02,500: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:53:02.532634489Z [2024-05-25 01:53:02,532: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:53:02.534867896Z [2024-05-25 01:53:02,534: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:53:02.535093262Z [2024-05-25 01:53:02,534: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:53:02.535956635Z [2024-05-25 01:53:02,535: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:53:02.536160606Z [2024-05-25 01:53:02,535: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:53:02.536626842Z [2024-05-25 01:53:02,536: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:53:02.536842702Z [2024-05-25 01:53:02,536: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:53:02.635813750Z [2024-05-25 01:53:02,635: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:53:04.564376698Z [2024-05-25 01:53:04,563: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e2817f76-3490-4b86-ba02-acb6603e08da] succeeded in 4.076594232999923s: None 2024-05-25T01:53:05.361242777Z [2024-05-25 01:53:05,360: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b47e5a9d-84da-4b9b-9353-a97dadfc904d] succeeded in 4.893105154000295s: None 2024-05-25T01:54:01.248994404Z [2024-05-25 01:54:01,248: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8786eb46-bdad-428e-96a6-adb3f416bdc7] received 2024-05-25T01:54:01.254170412Z [2024-05-25 01:54:01,253: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6cdd609-cc4e-4432-954a-46e950796f5f] received 2024-05-25T01:54:01.265767420Z [2024-05-25 01:54:01,265: INFO/ForkPoolWorker-15] [8786eb46-bdad-428e-96a6-adb3f416bdc7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:54:01.269780899Z [2024-05-25 01:54:01,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd95887c-0ebe-4dc5-99e4-292755d04347] received 2024-05-25T01:54:01.272143951Z [2024-05-25 01:54:01,271: INFO/ForkPoolWorker-16] [d6cdd609-cc4e-4432-954a-46e950796f5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:54:01.276115488Z [2024-05-25 01:54:01,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31798c8f-9829-4eb5-9862-5d31933b2cb8] received 2024-05-25T01:54:01.277831987Z [2024-05-25 01:54:01,277: INFO/ForkPoolWorker-1] [cd95887c-0ebe-4dc5-99e4-292755d04347] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:54:01.292944524Z [2024-05-25 01:54:01,292: INFO/ForkPoolWorker-2] [31798c8f-9829-4eb5-9862-5d31933b2cb8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:54:01.605285833Z [2024-05-25 01:54:01,601: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:54:01.636776013Z [2024-05-25 01:54:01,633: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:54:01.752164044Z [2024-05-25 01:54:01,749: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:54:01.767947575Z [2024-05-25 01:54:01,764: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:54:01.916263566Z [2024-05-25 01:54:01,916: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:54:02.033087412Z [2024-05-25 01:54:02,031: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T01:54:02.040737325Z [2024-05-25 01:54:02,037: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:54:02.078881287Z [2024-05-25 01:54:02,078: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:54:02.082560647Z [2024-05-25 01:54:02,081: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:54:02.082744892Z [2024-05-25 01:54:02,082: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:54:02.082807254Z [2024-05-25 01:54:02,082: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T01:54:02.083163587Z [2024-05-25 01:54:02,083: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:54:02.223460291Z [2024-05-25 01:54:02,216: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:54:02.576942094Z [2024-05-25 01:54:02,576: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8786eb46-bdad-428e-96a6-adb3f416bdc7] succeeded in 1.3253467550002824s: None 2024-05-25T01:54:03.015260237Z [2024-05-25 01:54:03,014: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[31798c8f-9829-4eb5-9862-5d31933b2cb8] succeeded in 1.734615401001065s: None 2024-05-25T01:54:03.176391665Z [2024-05-25 01:54:03,175: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:54:03.179413502Z [2024-05-25 01:54:03,178: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:54:03.199881627Z [2024-05-25 01:54:03,199: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:54:03.201340879Z [2024-05-25 01:54:03,201: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:54:03.201354140Z [2024-05-25 01:54:03,201: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:54:03.201417553Z [2024-05-25 01:54:03,201: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:54:03.201426912Z [2024-05-25 01:54:03,201: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:54:03.201682615Z [2024-05-25 01:54:03,201: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:54:03.201689216Z [2024-05-25 01:54:03,201: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:54:03.212101588Z [2024-05-25 01:54:03,211: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:54:03.215804338Z [2024-05-25 01:54:03,215: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:54:03.251632757Z [2024-05-25 01:54:03,251: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:54:03.253174762Z [2024-05-25 01:54:03,252: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:54:03.253189900Z [2024-05-25 01:54:03,253: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:54:03.253431185Z [2024-05-25 01:54:03,253: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:54:03.253466332Z [2024-05-25 01:54:03,253: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:54:03.253875221Z [2024-05-25 01:54:03,253: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:54:03.254064149Z [2024-05-25 01:54:03,253: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:54:03.310198401Z [2024-05-25 01:54:03,309: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:54:03.330912875Z [2024-05-25 01:54:03,330: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:54:04.754098355Z [2024-05-25 01:54:04,753: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d6cdd609-cc4e-4432-954a-46e950796f5f] succeeded in 3.496103003000826s: None 2024-05-25T01:54:05.296257444Z [2024-05-25 01:54:05,295: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cd95887c-0ebe-4dc5-99e4-292755d04347] succeeded in 4.024592223999207s: None 2024-05-25T01:55:01.299754345Z [2024-05-25 01:55:01,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e24e5b33-4141-4d33-bab7-1eb7ba018aa7] received 2024-05-25T01:55:01.304363173Z [2024-05-25 01:55:01,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6eae1f5-457f-4ddb-883b-8d66102f954f] received 2024-05-25T01:55:01.306359701Z [2024-05-25 01:55:01,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc140e54-776f-4179-b671-52923963e10e] received 2024-05-25T01:55:01.309163035Z [2024-05-25 01:55:01,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[09715636-2afc-49b3-a502-68428a46d700] received 2024-05-25T01:55:01.321142699Z [2024-05-25 01:55:01,320: INFO/ForkPoolWorker-15] [e24e5b33-4141-4d33-bab7-1eb7ba018aa7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:55:01.324171473Z [2024-05-25 01:55:01,323: INFO/ForkPoolWorker-2] [09715636-2afc-49b3-a502-68428a46d700] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:55:01.328282022Z [2024-05-25 01:55:01,327: INFO/ForkPoolWorker-16] [c6eae1f5-457f-4ddb-883b-8d66102f954f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:55:01.341155273Z [2024-05-25 01:55:01,337: INFO/ForkPoolWorker-1] [cc140e54-776f-4179-b671-52923963e10e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:55:01.760090622Z [2024-05-25 01:55:01,756: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:55:01.776077787Z [2024-05-25 01:55:01,771: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:55:01.787418926Z [2024-05-25 01:55:01,781: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:55:01.955638021Z [2024-05-25 01:55:01,955: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T01:55:01.959880895Z [2024-05-25 01:55:01,959: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:55:01.992665429Z [2024-05-25 01:55:01,992: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:55:01.994974598Z [2024-05-25 01:55:01,994: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:55:01.995032844Z [2024-05-25 01:55:01,994: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:55:01.995159651Z [2024-05-25 01:55:01,995: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T01:55:01.995336131Z [2024-05-25 01:55:01,995: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:55:02.021009939Z [2024-05-25 01:55:02,017: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:55:02.233594586Z [2024-05-25 01:55:02,232: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:55:03.109173246Z [2024-05-25 01:55:03,108: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c6eae1f5-457f-4ddb-883b-8d66102f954f] succeeded in 1.8019122240002616s: None 2024-05-25T01:55:03.600004406Z [2024-05-25 01:55:03,599: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T01:55:03.603290598Z [2024-05-25 01:55:03,602: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:55:03.618798847Z [2024-05-25 01:55:03,618: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:55:03.619873964Z [2024-05-25 01:55:03,619: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:55:03.619907412Z [2024-05-25 01:55:03,619: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:55:03.620031003Z [2024-05-25 01:55:03,619: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:55:03.620337229Z [2024-05-25 01:55:03,620: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T01:55:03.620358910Z [2024-05-25 01:55:03,620: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:55:03.620379920Z [2024-05-25 01:55:03,620: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:55:03.725982357Z [2024-05-25 01:55:03,725: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:55:04.065529404Z [2024-05-25 01:55:04,055: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:55:04.073061928Z [2024-05-25 01:55:04,072: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:55:04.080258682Z [2024-05-25 01:55:04,079: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:55:04.084296480Z [2024-05-25 01:55:04,083: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:55:04.132910353Z [2024-05-25 01:55:04,132: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:55:04.135036195Z [2024-05-25 01:55:04,134: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:55:04.135256210Z [2024-05-25 01:55:04,135: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:55:04.135491719Z [2024-05-25 01:55:04,135: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:55:04.136041187Z [2024-05-25 01:55:04,135: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:55:04.136408861Z [2024-05-25 01:55:04,136: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:55:04.136682944Z [2024-05-25 01:55:04,136: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:55:04.199402080Z [2024-05-25 01:55:04,199: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:55:04.204835319Z [2024-05-25 01:55:04,204: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:55:04.205283963Z [2024-05-25 01:55:04,204: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:55:04.205649972Z [2024-05-25 01:55:04,205: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:55:04.205941320Z [2024-05-25 01:55:04,205: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:55:04.206359683Z [2024-05-25 01:55:04,206: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:55:04.206517789Z [2024-05-25 01:55:04,206: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:55:04.324635094Z [2024-05-25 01:55:04,324: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:55:04.376624703Z [2024-05-25 01:55:04,376: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:55:05.250241026Z [2024-05-25 01:55:05,249: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cc140e54-776f-4179-b671-52923963e10e] succeeded in 3.9392236190014955s: None 2024-05-25T01:55:05.457096106Z [2024-05-25 01:55:05,455: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fbd21e3-622d-435c-8ddd-0efa5c5476f7] received 2024-05-25T01:55:05.474069259Z [2024-05-25 01:55:05,473: INFO/ForkPoolWorker-16] [9fbd21e3-622d-435c-8ddd-0efa5c5476f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:55:05.776966949Z [2024-05-25 01:55:05,773: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:55:06.102553494Z [2024-05-25 01:55:06,102: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e24e5b33-4141-4d33-bab7-1eb7ba018aa7] succeeded in 4.800159020998763s: None 2024-05-25T01:55:07.148276637Z [2024-05-25 01:55:07,147: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:55:07.151762375Z [2024-05-25 01:55:07,151: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:55:07.186303607Z [2024-05-25 01:55:07,186: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:55:07.187623155Z [2024-05-25 01:55:07,187: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:55:07.187662899Z [2024-05-25 01:55:07,187: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:55:07.187828213Z [2024-05-25 01:55:07,187: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:55:07.189381551Z [2024-05-25 01:55:07,187: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:55:07.189992661Z [2024-05-25 01:55:07,189: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:55:07.190168419Z [2024-05-25 01:55:07,190: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:55:07.273386897Z [2024-05-25 01:55:07,273: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:55:07.669049182Z [2024-05-25 01:55:07,668: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[09715636-2afc-49b3-a502-68428a46d700] succeeded in 6.357553736001137s: None 2024-05-25T01:55:08.477563045Z [2024-05-25 01:55:08,477: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9fbd21e3-622d-435c-8ddd-0efa5c5476f7] succeeded in 3.01631658199949s: None 2024-05-25T01:55:09.250117711Z [2024-05-25 01:55:09,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbed53e6-f67f-42a8-8745-4bff1ace6a8e] received 2024-05-25T01:55:09.270037399Z [2024-05-25 01:55:09,269: INFO/ForkPoolWorker-15] [dbed53e6-f67f-42a8-8745-4bff1ace6a8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T01:55:09.584145463Z [2024-05-25 01:55:09,581: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:55:10.739719430Z [2024-05-25 01:55:10,739: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:55:10.742970921Z [2024-05-25 01:55:10,742: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:55:10.766653994Z [2024-05-25 01:55:10,766: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:55:10.767822133Z [2024-05-25 01:55:10,767: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:55:10.767835002Z [2024-05-25 01:55:10,767: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:55:10.768156352Z [2024-05-25 01:55:10,767: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:55:10.768199653Z [2024-05-25 01:55:10,768: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:55:10.768531780Z [2024-05-25 01:55:10,768: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:55:10.768577813Z [2024-05-25 01:55:10,768: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:55:10.854915244Z [2024-05-25 01:55:10,854: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:55:11.413067502Z [2024-05-25 01:55:11,412: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dbed53e6-f67f-42a8-8745-4bff1ace6a8e] succeeded in 2.1567654560003575s: None 2024-05-25T01:55:11.570158229Z [2024-05-25 01:55:11,569: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5bce79a3-3edb-456d-8cf7-17575ac95024] received 2024-05-25T01:55:11.582939179Z [2024-05-25 01:55:11,582: INFO/ForkPoolWorker-15] [5bce79a3-3edb-456d-8cf7-17575ac95024] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T01:55:11.846797960Z [2024-05-25 01:55:11,843: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T01:55:13.036808164Z [2024-05-25 01:55:13,036: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:55:13.040301101Z [2024-05-25 01:55:13,039: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:55:13.065675856Z [2024-05-25 01:55:13,065: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:55:13.068311799Z [2024-05-25 01:55:13,067: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:55:13.068662147Z [2024-05-25 01:55:13,068: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:55:13.069095327Z [2024-05-25 01:55:13,068: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:55:13.069452443Z [2024-05-25 01:55:13,069: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:55:13.070075832Z [2024-05-25 01:55:13,069: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T01:55:13.070384247Z [2024-05-25 01:55:13,070: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:55:13.184926151Z [2024-05-25 01:55:13,184: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:55:13.801149565Z [2024-05-25 01:55:13,800: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5bce79a3-3edb-456d-8cf7-17575ac95024] succeeded in 2.2279280920010933s: None 2024-05-25T01:56:00.274724035Z [2024-05-25 01:56:00,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9a1f90f-93c8-4354-94ab-55067cfe4dd6] received 2024-05-25T01:56:00.280362178Z [2024-05-25 01:56:00,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8ff066d-9457-45a0-975b-9d3a597c0ad2] received 2024-05-25T01:56:00.284072623Z [2024-05-25 01:56:00,283: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99844316-e572-495c-a0e7-e22d56d635be] received 2024-05-25T01:56:00.287492824Z [2024-05-25 01:56:00,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cdd5d95f-88a2-44f6-aae0-ce307a5deca0] received 2024-05-25T01:56:00.291433156Z [2024-05-25 01:56:00,290: INFO/ForkPoolWorker-15] [a9a1f90f-93c8-4354-94ab-55067cfe4dd6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:56:00.296514181Z [2024-05-25 01:56:00,296: INFO/ForkPoolWorker-1] [99844316-e572-495c-a0e7-e22d56d635be] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:56:00.299900615Z [2024-05-25 01:56:00,299: INFO/ForkPoolWorker-16] [f8ff066d-9457-45a0-975b-9d3a597c0ad2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:56:00.302279260Z [2024-05-25 01:56:00,302: INFO/ForkPoolWorker-2] [cdd5d95f-88a2-44f6-aae0-ce307a5deca0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:56:00.596631653Z [2024-05-25 01:56:00,593: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:56:00.614953873Z [2024-05-25 01:56:00,610: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:56:00.692176724Z [2024-05-25 01:56:00,688: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:56:00.706026352Z [2024-05-25 01:56:00,702: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:56:00.927134201Z [2024-05-25 01:56:00,926: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T01:56:00.932848886Z [2024-05-25 01:56:00,932: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:56:00.974278629Z [2024-05-25 01:56:00,973: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:56:00.982693199Z [2024-05-25 01:56:00,982: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:56:00.983866064Z [2024-05-25 01:56:00,983: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:56:00.984080210Z [2024-05-25 01:56:00,983: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:56:00.984252146Z [2024-05-25 01:56:00,984: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T01:56:00.984552815Z [2024-05-25 01:56:00,984: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:56:01.149692035Z [2024-05-25 01:56:01,149: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:56:01.946678158Z [2024-05-25 01:56:01,946: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[99844316-e572-495c-a0e7-e22d56d635be] succeeded in 1.6596103270003368s: None 2024-05-25T01:56:02.079885384Z [2024-05-25 01:56:02,079: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f8ff066d-9457-45a0-975b-9d3a597c0ad2] succeeded in 1.793642301001455s: None 2024-05-25T01:56:02.169038357Z [2024-05-25 01:56:02,168: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:56:02.172540544Z [2024-05-25 01:56:02,172: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:56:02.288555159Z [2024-05-25 01:56:02,288: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T01:56:02.289434395Z [2024-05-25 01:56:02,289: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:56:02.291405951Z [2024-05-25 01:56:02,291: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:56:02.291648311Z [2024-05-25 01:56:02,291: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:56:02.292003856Z [2024-05-25 01:56:02,291: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:56:02.292328551Z [2024-05-25 01:56:02,292: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:56:02.292620253Z [2024-05-25 01:56:02,292: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:56:02.293263877Z [2024-05-25 01:56:02,293: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:56:02.293466483Z [2024-05-25 01:56:02,293: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:56:02.354444167Z [2024-05-25 01:56:02,354: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:56:02.355806907Z [2024-05-25 01:56:02,355: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:56:02.355900715Z [2024-05-25 01:56:02,355: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:56:02.358571351Z [2024-05-25 01:56:02,355: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:56:02.361989614Z [2024-05-25 01:56:02,358: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T01:56:02.362223981Z [2024-05-25 01:56:02,362: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:56:02.362277737Z [2024-05-25 01:56:02,362: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:56:02.438694731Z [2024-05-25 01:56:02,433: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:56:02.469097989Z [2024-05-25 01:56:02,468: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:56:04.623801459Z [2024-05-25 01:56:04,623: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a9a1f90f-93c8-4354-94ab-55067cfe4dd6] succeeded in 4.3455431219990714s: None 2024-05-25T01:56:05.257417643Z [2024-05-25 01:56:05,257: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cdd5d95f-88a2-44f6-aae0-ce307a5deca0] succeeded in 4.964610689999972s: None 2024-05-25T01:57:00.214046544Z [2024-05-25 01:57:00,213: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c12232a-40e7-4534-a8f4-ba2887aa8676] received 2024-05-25T01:57:00.218371265Z [2024-05-25 01:57:00,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f511393-e5c1-4e4b-ab28-0fc455a678a6] received 2024-05-25T01:57:00.222228286Z [2024-05-25 01:57:00,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9296e9a-b2c5-4f8a-a05e-279265996fd4] received 2024-05-25T01:57:00.229386712Z [2024-05-25 01:57:00,229: INFO/ForkPoolWorker-1] [a9296e9a-b2c5-4f8a-a05e-279265996fd4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:57:00.237695005Z [2024-05-25 01:57:00,237: INFO/ForkPoolWorker-15] [6c12232a-40e7-4534-a8f4-ba2887aa8676] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:57:00.244195499Z [2024-05-25 01:57:00,243: INFO/ForkPoolWorker-16] [8f511393-e5c1-4e4b-ab28-0fc455a678a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:57:00.572899405Z [2024-05-25 01:57:00,568: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:57:00.582629091Z [2024-05-25 01:57:00,579: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:57:00.626042056Z [2024-05-25 01:57:00,622: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:57:00.730094836Z [2024-05-25 01:57:00,729: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T01:57:00.733888344Z [2024-05-25 01:57:00,733: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:57:00.754679568Z [2024-05-25 01:57:00,754: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:57:00.755614414Z [2024-05-25 01:57:00,755: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:57:00.755860363Z [2024-05-25 01:57:00,755: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:57:00.756019731Z [2024-05-25 01:57:00,755: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T01:57:00.756279925Z [2024-05-25 01:57:00,756: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:57:00.855491185Z [2024-05-25 01:57:00,855: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:57:01.467670519Z [2024-05-25 01:57:01,467: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8f511393-e5c1-4e4b-ab28-0fc455a678a6] succeeded in 1.246490236999307s: None 2024-05-25T01:57:01.872315561Z [2024-05-25 01:57:01,871: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:57:01.875676644Z [2024-05-25 01:57:01,875: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:57:01.895957020Z [2024-05-25 01:57:01,895: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:57:01.897292425Z [2024-05-25 01:57:01,897: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:57:01.897426724Z [2024-05-25 01:57:01,897: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:57:01.897586056Z [2024-05-25 01:57:01,897: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:57:01.897690300Z [2024-05-25 01:57:01,897: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:57:01.897937700Z [2024-05-25 01:57:01,897: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:57:01.898045314Z [2024-05-25 01:57:01,897: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:57:01.902099636Z [2024-05-25 01:57:01,901: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:57:01.905277885Z [2024-05-25 01:57:01,904: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:57:01.928305554Z [2024-05-25 01:57:01,928: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:57:01.929453493Z [2024-05-25 01:57:01,929: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:57:01.929468604Z [2024-05-25 01:57:01,929: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:57:01.929592396Z [2024-05-25 01:57:01,929: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:57:01.929629284Z [2024-05-25 01:57:01,929: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:57:01.929945420Z [2024-05-25 01:57:01,929: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:57:01.929991536Z [2024-05-25 01:57:01,929: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:57:01.968149935Z [2024-05-25 01:57:01,967: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:57:02.002605952Z [2024-05-25 01:57:02,002: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:57:03.414739884Z [2024-05-25 01:57:03,413: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a9296e9a-b2c5-4f8a-a05e-279265996fd4] succeeded in 3.1902925230006076s: None 2024-05-25T01:57:03.776328771Z [2024-05-25 01:57:03,775: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6c12232a-40e7-4534-a8f4-ba2887aa8676] succeeded in 3.5595904080000764s: None 2024-05-25T01:58:01.211462977Z [2024-05-25 01:58:01,210: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a93055b1-b42f-4f9e-8cb5-9394cbe013c1] received 2024-05-25T01:58:01.217940606Z [2024-05-25 01:58:01,217: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83f931d2-4f85-4636-a199-ecae8014c88b] received 2024-05-25T01:58:01.228511409Z [2024-05-25 01:58:01,228: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[549461c5-bf9d-4ddf-a578-d6f1b7989595] received 2024-05-25T01:58:01.231918386Z [2024-05-25 01:58:01,231: INFO/ForkPoolWorker-16] [83f931d2-4f85-4636-a199-ecae8014c88b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:58:01.232620561Z [2024-05-25 01:58:01,232: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f5f946b-0d05-4a96-901d-7fb9ed480596] received 2024-05-25T01:58:01.235476934Z [2024-05-25 01:58:01,235: INFO/ForkPoolWorker-15] [a93055b1-b42f-4f9e-8cb5-9394cbe013c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T01:58:01.255152407Z [2024-05-25 01:58:01,254: INFO/ForkPoolWorker-1] [549461c5-bf9d-4ddf-a578-d6f1b7989595] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:58:01.260206309Z [2024-05-25 01:58:01,259: INFO/ForkPoolWorker-2] [4f5f946b-0d05-4a96-901d-7fb9ed480596] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:58:01.652406851Z [2024-05-25 01:58:01,648: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:58:01.706681805Z [2024-05-25 01:58:01,702: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T01:58:01.711439227Z [2024-05-25 01:58:01,707: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:58:01.775943963Z [2024-05-25 01:58:01,773: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:58:01.844730471Z [2024-05-25 01:58:01,844: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T01:58:01.848955156Z [2024-05-25 01:58:01,848: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:58:01.886064378Z [2024-05-25 01:58:01,885: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T01:58:01.890180643Z [2024-05-25 01:58:01,889: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:58:01.890368552Z [2024-05-25 01:58:01,890: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:58:01.890452309Z [2024-05-25 01:58:01,890: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T01:58:01.890774154Z [2024-05-25 01:58:01,890: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:58:01.996676077Z [2024-05-25 01:58:01,996: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:58:02.010728652Z [2024-05-25 01:58:02,010: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:58:02.657550015Z [2024-05-25 01:58:02,657: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a93055b1-b42f-4f9e-8cb5-9394cbe013c1] succeeded in 1.4374005500012572s: None 2024-05-25T01:58:02.745189130Z [2024-05-25 01:58:02,744: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4f5f946b-0d05-4a96-901d-7fb9ed480596] succeeded in 1.492936884998926s: None 2024-05-25T01:58:03.133166830Z [2024-05-25 01:58:03,132: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T01:58:03.136518760Z [2024-05-25 01:58:03,136: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:58:03.143627520Z [2024-05-25 01:58:03,143: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:58:03.146753065Z [2024-05-25 01:58:03,146: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:58:03.158294843Z [2024-05-25 01:58:03,157: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:58:03.159506899Z [2024-05-25 01:58:03,159: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:58:03.159523046Z [2024-05-25 01:58:03,159: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:58:03.159625207Z [2024-05-25 01:58:03,159: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:58:03.159780765Z [2024-05-25 01:58:03,159: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T01:58:03.160010405Z [2024-05-25 01:58:03,159: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:58:03.160035115Z [2024-05-25 01:58:03,159: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:58:03.166795716Z [2024-05-25 01:58:03,166: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:58:03.168007480Z [2024-05-25 01:58:03,167: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:58:03.168028746Z [2024-05-25 01:58:03,167: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:58:03.168172256Z [2024-05-25 01:58:03,168: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:58:03.168221468Z [2024-05-25 01:58:03,168: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:58:03.168449405Z [2024-05-25 01:58:03,168: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:58:03.168463872Z [2024-05-25 01:58:03,168: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:58:03.239709447Z [2024-05-25 01:58:03,239: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:58:03.240167885Z [2024-05-25 01:58:03,239: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:58:04.864242639Z [2024-05-25 01:58:04,863: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[549461c5-bf9d-4ddf-a578-d6f1b7989595] succeeded in 3.6285810039989883s: None 2024-05-25T01:58:05.367646855Z [2024-05-25 01:58:05,366: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[83f931d2-4f85-4636-a199-ecae8014c88b] succeeded in 4.147198124999704s: None 2024-05-25T01:59:00.610391873Z [2024-05-25 01:59:00,609: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb7985b4-3113-4447-8a16-c3d8cf1a72b7] received 2024-05-25T01:59:00.615828256Z [2024-05-25 01:59:00,615: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ba5acac-905f-4d64-88bd-7f8076f0693a] received 2024-05-25T01:59:00.619379902Z [2024-05-25 01:59:00,619: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[49ab3095-2258-4181-8ff0-d5ab40f95f56] received 2024-05-25T01:59:00.630537601Z [2024-05-25 01:59:00,629: INFO/ForkPoolWorker-16] [3ba5acac-905f-4d64-88bd-7f8076f0693a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T01:59:00.631479355Z [2024-05-25 01:59:00,630: INFO/ForkPoolWorker-1] [49ab3095-2258-4181-8ff0-d5ab40f95f56] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T01:59:00.632028576Z [2024-05-25 01:59:00,631: INFO/ForkPoolWorker-15] [fb7985b4-3113-4447-8a16-c3d8cf1a72b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T01:59:00.922821681Z [2024-05-25 01:59:00,918: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T01:59:00.934945572Z [2024-05-25 01:59:00,931: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T01:59:00.965329032Z [2024-05-25 01:59:00,958: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T01:59:01.116018412Z [2024-05-25 01:59:01,115: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T01:59:01.120017991Z [2024-05-25 01:59:01,119: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:59:01.154611431Z [2024-05-25 01:59:01,154: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T01:59:01.156325468Z [2024-05-25 01:59:01,155: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T01:59:01.156516156Z [2024-05-25 01:59:01,156: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T01:59:01.156768775Z [2024-05-25 01:59:01,156: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T01:59:01.157287009Z [2024-05-25 01:59:01,156: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T01:59:01.279800162Z [2024-05-25 01:59:01,279: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:59:01.889432640Z [2024-05-25 01:59:01,888: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3ba5acac-905f-4d64-88bd-7f8076f0693a] succeeded in 1.270361768998555s: None 2024-05-25T01:59:02.220154163Z [2024-05-25 01:59:02,218: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T01:59:02.223378607Z [2024-05-25 01:59:02,222: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:59:02.245382519Z [2024-05-25 01:59:02,235: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T01:59:02.245505173Z [2024-05-25 01:59:02,239: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T01:59:02.291848760Z [2024-05-25 01:59:02,291: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T01:59:02.293406628Z [2024-05-25 01:59:02,293: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:59:02.293476769Z [2024-05-25 01:59:02,293: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:59:02.293618845Z [2024-05-25 01:59:02,293: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:59:02.293698189Z [2024-05-25 01:59:02,293: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T01:59:02.293940802Z [2024-05-25 01:59:02,293: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T01:59:02.294016731Z [2024-05-25 01:59:02,293: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:59:02.319726548Z [2024-05-25 01:59:02,319: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T01:59:02.321342595Z [2024-05-25 01:59:02,321: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T01:59:02.321445605Z [2024-05-25 01:59:02,321: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T01:59:02.321689745Z [2024-05-25 01:59:02,321: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T01:59:02.321779431Z [2024-05-25 01:59:02,321: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T01:59:02.322151003Z [2024-05-25 01:59:02,322: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T01:59:02.322262724Z [2024-05-25 01:59:02,322: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T01:59:02.410156951Z [2024-05-25 01:59:02,409: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:59:02.416047140Z [2024-05-25 01:59:02,415: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T01:59:03.994714281Z [2024-05-25 01:59:03,994: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[49ab3095-2258-4181-8ff0-d5ab40f95f56] succeeded in 3.3736559789995226s: None 2024-05-25T01:59:04.977001728Z [2024-05-25 01:59:04,976: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fb7985b4-3113-4447-8a16-c3d8cf1a72b7] succeeded in 4.358560280999882s: None 2024-05-25T02:00:01.130170388Z [2024-05-25 02:00:01,129: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cee472dd-39c1-4807-b742-84f79cb77465] received 2024-05-25T02:00:01.131681225Z [2024-05-25 02:00:01,131: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0a63bfe-1391-4917-b7cf-141a4ff4502b] received 2024-05-25T02:00:01.135906717Z [2024-05-25 02:00:01,135: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2232aeb9-7c70-4405-8913-8e598cc92095] received 2024-05-25T02:00:01.140024562Z [2024-05-25 02:00:01,139: INFO/ForkPoolWorker-15] [cee472dd-39c1-4807-b742-84f79cb77465] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:00:01.146053441Z [2024-05-25 02:00:01,145: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7af13175-0d82-469c-a311-c20a5b680f3f] received 2024-05-25T02:00:01.149992740Z [2024-05-25 02:00:01,149: INFO/ForkPoolWorker-16] [c0a63bfe-1391-4917-b7cf-141a4ff4502b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:00:01.151530807Z [2024-05-25 02:00:01,151: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae61086a-8187-49c1-b805-d95aaca280d9] received 2024-05-25T02:00:01.158131178Z [2024-05-25 02:00:01,157: INFO/ForkPoolWorker-1] [2232aeb9-7c70-4405-8913-8e598cc92095] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:00:01.162486411Z [2024-05-25 02:00:01,162: INFO/ForkPoolWorker-2] [7af13175-0d82-469c-a311-c20a5b680f3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:00:01.165994325Z [2024-05-25 02:00:01,165: INFO/ForkPoolWorker-3] [ae61086a-8187-49c1-b805-d95aaca280d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:00:01.524226810Z [2024-05-25 02:00:01,516: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:00:01.559167518Z [2024-05-25 02:00:01,555: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:00:01.592873501Z [2024-05-25 02:00:01,589: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:00:01.777235389Z [2024-05-25 02:00:01,776: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:00:01.849759438Z [2024-05-25 02:00:01,842: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:00:01.888295933Z [2024-05-25 02:00:01,882: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:00:01.891145211Z [2024-05-25 02:00:01,890: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-25T02:00:01.895073884Z [2024-05-25 02:00:01,894: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:00:01.926403602Z [2024-05-25 02:00:01,926: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T02:00:01.928560710Z [2024-05-25 02:00:01,928: INFO/ForkPoolWorker-3] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:00:01.928712064Z [2024-05-25 02:00:01,928: INFO/ForkPoolWorker-3] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:00:01.928721333Z [2024-05-25 02:00:01,928: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-25T02:00:01.929018568Z [2024-05-25 02:00:01,928: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:00:02.019704347Z [2024-05-25 02:00:02,019: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:00:02.485754574Z [2024-05-25 02:00:02,485: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c0a63bfe-1391-4917-b7cf-141a4ff4502b] succeeded in 1.3496250250009325s: None 2024-05-25T02:00:02.766502084Z [2024-05-25 02:00:02,766: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[ae61086a-8187-49c1-b805-d95aaca280d9] succeeded in 1.6107005230005598s: None 2024-05-25T02:00:03.108490234Z [2024-05-25 02:00:03,105: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:00:03.110523563Z [2024-05-25 02:00:03,109: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:00:03.153512274Z [2024-05-25 02:00:03,149: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:00:03.154169976Z [2024-05-25 02:00:03,153: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:00:03.154181780Z [2024-05-25 02:00:03,154: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:00:03.154257915Z [2024-05-25 02:00:03,154: INFO/ForkPoolWorker-15] Read VIM fac06b48-1435-40df-aba0-b1cd5eb94cd0 (k8s07_dummy) 2024-05-25T02:00:03.154337721Z [2024-05-25 02:00:03,154: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fac06b48-1435-40df-aba0-b1cd5eb94cd0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-05-25T02:00:03.154380006Z [2024-05-25 02:00:03,154: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:00:03.154601592Z [2024-05-25 02:00:03,154: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:00:03.154649795Z [2024-05-25 02:00:03,154: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:00:03.164144418Z [2024-05-25 02:00:03,163: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:00:03.273846590Z [2024-05-25 02:00:03,273: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:00:03.465268718Z [2024-05-25 02:00:03,464: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T02:00:03.468872093Z [2024-05-25 02:00:03,468: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:00:03.521885349Z [2024-05-25 02:00:03,521: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:00:03.523442179Z [2024-05-25 02:00:03,523: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:00:03.523522337Z [2024-05-25 02:00:03,523: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:00:03.523679173Z [2024-05-25 02:00:03,523: INFO/ForkPoolWorker-2] Read VIM fac06b48-1435-40df-aba0-b1cd5eb94cd0 (k8s07_dummy) 2024-05-25T02:00:03.523881555Z [2024-05-25 02:00:03,523: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fac06b48-1435-40df-aba0-b1cd5eb94cd0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-05-25T02:00:03.523941568Z [2024-05-25 02:00:03,523: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T02:00:03.524429117Z [2024-05-25 02:00:03,524: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:00:03.524520576Z [2024-05-25 02:00:03,524: INFO/ForkPoolWorker-2] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:00:03.529005022Z [2024-05-25 02:00:03,528: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:00:03.596770126Z [2024-05-25 02:00:03,596: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:00:03.600657095Z [2024-05-25 02:00:03,600: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:00:03.636473159Z [2024-05-25 02:00:03,636: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:00:03.643312387Z [2024-05-25 02:00:03,643: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:00:03.649269151Z [2024-05-25 02:00:03,646: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:00:03.649491274Z [2024-05-25 02:00:03,649: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:00:03.649640695Z [2024-05-25 02:00:03,649: INFO/ForkPoolWorker-1] Read VIM fac06b48-1435-40df-aba0-b1cd5eb94cd0 (k8s07_dummy) 2024-05-25T02:00:03.649854567Z [2024-05-25 02:00:03,649: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fac06b48-1435-40df-aba0-b1cd5eb94cd0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-05-25T02:00:03.649997685Z [2024-05-25 02:00:03,649: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:00:03.650642098Z [2024-05-25 02:00:03,650: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:00:03.650795191Z [2024-05-25 02:00:03,650: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:00:03.655815214Z [2024-05-25 02:00:03,655: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:00:03.770390862Z [2024-05-25 02:00:03,770: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:00:04.066846557Z [2024-05-25 02:00:04,066: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cee472dd-39c1-4807-b742-84f79cb77465] succeeded in 2.9339343850006117s: None 2024-05-25T02:00:04.718186354Z [2024-05-25 02:00:04,717: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af4e0448-a008-425b-9bc0-bbf9e654f1b7] received 2024-05-25T02:00:04.738952559Z [2024-05-25 02:00:04,732: INFO/ForkPoolWorker-15] [af4e0448-a008-425b-9bc0-bbf9e654f1b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:00:05.009623068Z [2024-05-25 02:00:05,006: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:00:05.432596555Z [2024-05-25 02:00:05,432: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7af13175-0d82-469c-a311-c20a5b680f3f] succeeded in 4.28398695100077s: None 2024-05-25T02:00:05.743243351Z [2024-05-25 02:00:05,742: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2232aeb9-7c70-4405-8913-8e598cc92095] succeeded in 4.604488670998762s: None 2024-05-25T02:00:06.241411774Z [2024-05-25 02:00:06,241: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:00:06.244616287Z [2024-05-25 02:00:06,244: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:00:06.268941564Z [2024-05-25 02:00:06,268: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:00:06.274521534Z [2024-05-25 02:00:06,274: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:00:06.274905722Z [2024-05-25 02:00:06,274: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:00:06.275384899Z [2024-05-25 02:00:06,275: INFO/ForkPoolWorker-15] Read VIM fac06b48-1435-40df-aba0-b1cd5eb94cd0 (k8s07_dummy) 2024-05-25T02:00:06.275683959Z [2024-05-25 02:00:06,275: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fac06b48-1435-40df-aba0-b1cd5eb94cd0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-05-25T02:00:06.275890690Z [2024-05-25 02:00:06,275: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:00:06.276272516Z [2024-05-25 02:00:06,276: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:00:06.276479679Z [2024-05-25 02:00:06,276: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:00:06.282958258Z [2024-05-25 02:00:06,282: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:00:06.363542906Z [2024-05-25 02:00:06,363: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:00:06.998429518Z [2024-05-25 02:00:06,998: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[af4e0448-a008-425b-9bc0-bbf9e654f1b7] succeeded in 2.2762558159993205s: None 2024-05-25T02:00:07.268813588Z [2024-05-25 02:00:07,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c59101d1-a4ee-4a2a-9e5f-9563b08d9386] received 2024-05-25T02:00:07.279847419Z [2024-05-25 02:00:07,279: INFO/ForkPoolWorker-15] [c59101d1-a4ee-4a2a-9e5f-9563b08d9386] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T02:00:07.589759272Z [2024-05-25 02:00:07,586: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:00:08.743889512Z [2024-05-25 02:00:08,743: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:00:08.747276199Z [2024-05-25 02:00:08,746: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:00:08.790012052Z [2024-05-25 02:00:08,789: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:00:08.792724352Z [2024-05-25 02:00:08,792: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:00:08.792753725Z [2024-05-25 02:00:08,792: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:00:08.792763906Z [2024-05-25 02:00:08,792: INFO/ForkPoolWorker-15] Read VIM fac06b48-1435-40df-aba0-b1cd5eb94cd0 (k8s07_dummy) 2024-05-25T02:00:08.792904718Z [2024-05-25 02:00:08,792: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fac06b48-1435-40df-aba0-b1cd5eb94cd0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-05-25T02:00:08.792923271Z [2024-05-25 02:00:08,792: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:00:08.793432362Z [2024-05-25 02:00:08,793: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:00:08.793459983Z [2024-05-25 02:00:08,793: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:00:08.800282329Z [2024-05-25 02:00:08,800: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:00:08.894765290Z [2024-05-25 02:00:08,894: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:00:09.384040643Z [2024-05-25 02:00:09,383: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78b812c4-a612-46a0-91b3-cd85864eead0] received 2024-05-25T02:00:09.404866679Z [2024-05-25 02:00:09,404: INFO/ForkPoolWorker-16] [78b812c4-a612-46a0-91b3-cd85864eead0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:00:09.488213527Z [2024-05-25 02:00:09,487: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c59101d1-a4ee-4a2a-9e5f-9563b08d9386] succeeded in 2.2139652609985205s: None 2024-05-25T02:00:09.688030121Z [2024-05-25 02:00:09,684: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:00:10.762177493Z [2024-05-25 02:00:10,761: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:00:10.765405753Z [2024-05-25 02:00:10,764: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:00:10.782625644Z [2024-05-25 02:00:10,782: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:00:10.783750729Z [2024-05-25 02:00:10,783: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:00:10.783771608Z [2024-05-25 02:00:10,783: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:00:10.783814561Z [2024-05-25 02:00:10,783: INFO/ForkPoolWorker-16] Read VIM fac06b48-1435-40df-aba0-b1cd5eb94cd0 (k8s07_dummy) 2024-05-25T02:00:10.783964331Z [2024-05-25 02:00:10,783: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fac06b48-1435-40df-aba0-b1cd5eb94cd0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-05-25T02:00:10.783976880Z [2024-05-25 02:00:10,783: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:00:10.784193253Z [2024-05-25 02:00:10,784: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:00:10.784222381Z [2024-05-25 02:00:10,784: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:00:10.790026180Z [2024-05-25 02:00:10,789: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:00:10.882093197Z [2024-05-25 02:00:10,881: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:00:11.403917762Z [2024-05-25 02:00:11,403: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[78b812c4-a612-46a0-91b3-cd85864eead0] succeeded in 2.01482276599927s: None 2024-05-25T02:01:00.600202651Z [2024-05-25 02:01:00,599: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f383bf3-4b63-4265-bc32-87d8749f3881] received 2024-05-25T02:01:00.612124489Z [2024-05-25 02:01:00,611: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c52775d-27b7-42ca-ae82-880435c508c6] received 2024-05-25T02:01:00.614689906Z [2024-05-25 02:01:00,614: INFO/ForkPoolWorker-15] [4f383bf3-4b63-4265-bc32-87d8749f3881] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:01:00.623007456Z [2024-05-25 02:01:00,622: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb4ec367-0343-432f-8a0e-92c197a5e9d5] received 2024-05-25T02:01:00.626487961Z [2024-05-25 02:01:00,625: INFO/ForkPoolWorker-16] [8c52775d-27b7-42ca-ae82-880435c508c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:01:00.645250064Z [2024-05-25 02:01:00,643: INFO/ForkPoolWorker-1] [eb4ec367-0343-432f-8a0e-92c197a5e9d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:01:00.936048712Z [2024-05-25 02:01:00,932: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:01:00.987098345Z [2024-05-25 02:01:00,982: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:01:01.011687712Z [2024-05-25 02:01:00,999: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:01:01.131794606Z [2024-05-25 02:01:01,131: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T02:01:01.136298766Z [2024-05-25 02:01:01,135: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:01:01.163191615Z [2024-05-25 02:01:01,162: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:01:01.165692196Z [2024-05-25 02:01:01,165: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:01:01.165848839Z [2024-05-25 02:01:01,165: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:01:01.165967265Z [2024-05-25 02:01:01,165: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T02:01:01.166296529Z [2024-05-25 02:01:01,166: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:01:01.294752461Z [2024-05-25 02:01:01,294: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:01:02.058157833Z [2024-05-25 02:01:02,057: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eb4ec367-0343-432f-8a0e-92c197a5e9d5] succeeded in 1.4333202509988041s: None 2024-05-25T02:01:02.210311459Z [2024-05-25 02:01:02,206: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:01:02.210454412Z [2024-05-25 02:01:02,209: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:01:02.346205291Z [2024-05-25 02:01:02,345: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:01:02.348198091Z [2024-05-25 02:01:02,347: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:01:02.348230664Z [2024-05-25 02:01:02,348: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:01:02.348249387Z [2024-05-25 02:01:02,348: INFO/ForkPoolWorker-16] Read VIM fac06b48-1435-40df-aba0-b1cd5eb94cd0 (k8s07_dummy) 2024-05-25T02:01:02.348955790Z [2024-05-25 02:01:02,348: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fac06b48-1435-40df-aba0-b1cd5eb94cd0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-05-25T02:01:02.349256624Z [2024-05-25 02:01:02,349: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:01:02.350229681Z [2024-05-25 02:01:02,350: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:01:02.350496469Z [2024-05-25 02:01:02,350: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:01:02.356782308Z [2024-05-25 02:01:02,356: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:01:02.463883008Z [2024-05-25 02:01:02,463: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:01:02.569173720Z [2024-05-25 02:01:02,568: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:01:02.572658096Z [2024-05-25 02:01:02,572: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:01:02.606919070Z [2024-05-25 02:01:02,606: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:01:02.608780523Z [2024-05-25 02:01:02,608: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:01:02.608798128Z [2024-05-25 02:01:02,608: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:01:02.608886291Z [2024-05-25 02:01:02,608: INFO/ForkPoolWorker-15] Read VIM fac06b48-1435-40df-aba0-b1cd5eb94cd0 (k8s07_dummy) 2024-05-25T02:01:02.609067763Z [2024-05-25 02:01:02,608: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'fac06b48-1435-40df-aba0-b1cd5eb94cd0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-05-25T02:01:02.609111583Z [2024-05-25 02:01:02,609: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:01:02.609433210Z [2024-05-25 02:01:02,609: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:01:02.609514455Z [2024-05-25 02:01:02,609: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:01:02.616056772Z [2024-05-25 02:01:02,615: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:01:02.739493013Z [2024-05-25 02:01:02,739: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:01:04.290119415Z [2024-05-25 02:01:04,289: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8c52775d-27b7-42ca-ae82-880435c508c6] succeeded in 3.675396737999108s: None 2024-05-25T02:01:05.064892556Z [2024-05-25 02:01:05,064: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4f383bf3-4b63-4265-bc32-87d8749f3881] succeeded in 4.460377958999743s: None 2024-05-25T02:02:00.560785064Z [2024-05-25 02:02:00,560: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[258062a1-89e8-4c3e-b566-7a1d864cd296] received 2024-05-25T02:02:00.562738030Z [2024-05-25 02:02:00,562: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04a1950d-8135-49a0-af99-ed8faeb83b10] received 2024-05-25T02:02:00.566978786Z [2024-05-25 02:02:00,566: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6373236c-3c64-4912-a8e7-d68cd4ec3ab5] received 2024-05-25T02:02:00.569672483Z [2024-05-25 02:02:00,569: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[422fdd51-ad4e-488a-9963-ba3955c43015] received 2024-05-25T02:02:00.580357549Z [2024-05-25 02:02:00,580: INFO/ForkPoolWorker-15] [258062a1-89e8-4c3e-b566-7a1d864cd296] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:02:00.581963606Z [2024-05-25 02:02:00,581: INFO/ForkPoolWorker-1] [6373236c-3c64-4912-a8e7-d68cd4ec3ab5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:02:00.585314606Z [2024-05-25 02:02:00,584: INFO/ForkPoolWorker-16] [04a1950d-8135-49a0-af99-ed8faeb83b10] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:02:00.588840122Z [2024-05-25 02:02:00,588: INFO/ForkPoolWorker-2] [422fdd51-ad4e-488a-9963-ba3955c43015] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:02:00.898972545Z [2024-05-25 02:02:00,895: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:02:00.922080275Z [2024-05-25 02:02:00,918: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:02:01.045796256Z [2024-05-25 02:02:01,042: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:02:01.115746302Z [2024-05-25 02:02:01,112: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:02:01.196500246Z [2024-05-25 02:02:01,196: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T02:02:01.200408099Z [2024-05-25 02:02:01,199: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:02:01.240986269Z [2024-05-25 02:02:01,240: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:02:01.242191775Z [2024-05-25 02:02:01,241: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:02:01.242215350Z [2024-05-25 02:02:01,242: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:02:01.242263727Z [2024-05-25 02:02:01,242: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T02:02:01.242685604Z [2024-05-25 02:02:01,242: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:02:01.280228763Z [2024-05-25 02:02:01,279: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:02:01.385318897Z [2024-05-25 02:02:01,384: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:02:02.100499172Z [2024-05-25 02:02:02,100: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[422fdd51-ad4e-488a-9963-ba3955c43015] succeeded in 1.5276390919989353s: None 2024-05-25T02:02:02.114310767Z [2024-05-25 02:02:02,113: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[258062a1-89e8-4c3e-b566-7a1d864cd296] succeeded in 1.545461185000022s: None 2024-05-25T02:02:02.403930925Z [2024-05-25 02:02:02,403: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:02:02.410355962Z [2024-05-25 02:02:02,409: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:02:02.443737701Z [2024-05-25 02:02:02,443: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:02:02.444750607Z [2024-05-25 02:02:02,444: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:02:02.444763019Z [2024-05-25 02:02:02,444: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:02:02.445947088Z [2024-05-25 02:02:02,444: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:02:02.445958298Z [2024-05-25 02:02:02,444: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:02:02.445974788Z [2024-05-25 02:02:02,445: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:02:02.445978085Z [2024-05-25 02:02:02,445: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:02:02.445991414Z [2024-05-25 02:02:02,445: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:02:02.451439801Z [2024-05-25 02:02:02,451: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:02:02.471359541Z [2024-05-25 02:02:02,471: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:02:02.474235453Z [2024-05-25 02:02:02,473: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:02:02.474357346Z [2024-05-25 02:02:02,474: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:02:02.474534183Z [2024-05-25 02:02:02,474: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:02:02.474612466Z [2024-05-25 02:02:02,474: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:02:02.474912134Z [2024-05-25 02:02:02,474: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:02:02.474990792Z [2024-05-25 02:02:02,474: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:02:02.541511738Z [2024-05-25 02:02:02,541: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:02:02.570491766Z [2024-05-25 02:02:02,570: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:02:04.208732582Z [2024-05-25 02:02:04,208: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6373236c-3c64-4912-a8e7-d68cd4ec3ab5] succeeded in 3.6388430800016067s: None 2024-05-25T02:02:05.013657715Z [2024-05-25 02:02:05,013: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[04a1950d-8135-49a0-af99-ed8faeb83b10] succeeded in 4.445125522001035s: None 2024-05-25T02:03:00.270679224Z [2024-05-25 02:03:00,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c83e35fe-d978-4e89-b751-67126b5ca301] received 2024-05-25T02:03:00.278753134Z [2024-05-25 02:03:00,278: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7771a0ac-66ff-4c4d-bdb8-cac07e4768b6] received 2024-05-25T02:03:00.279547938Z [2024-05-25 02:03:00,279: INFO/ForkPoolWorker-15] [c83e35fe-d978-4e89-b751-67126b5ca301] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:03:00.288625920Z [2024-05-25 02:03:00,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08cb6839-ac0a-41b7-99c9-da1221cc10cd] received 2024-05-25T02:03:00.289354735Z [2024-05-25 02:03:00,289: INFO/ForkPoolWorker-16] [7771a0ac-66ff-4c4d-bdb8-cac07e4768b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:03:00.303113781Z [2024-05-25 02:03:00,302: INFO/ForkPoolWorker-1] [08cb6839-ac0a-41b7-99c9-da1221cc10cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:03:00.571911966Z [2024-05-25 02:03:00,568: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:03:00.619915539Z [2024-05-25 02:03:00,616: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:03:00.622112348Z [2024-05-25 02:03:00,618: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:03:00.767339240Z [2024-05-25 02:03:00,766: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T02:03:00.771374951Z [2024-05-25 02:03:00,770: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:03:00.792221966Z [2024-05-25 02:03:00,792: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:03:00.794180199Z [2024-05-25 02:03:00,793: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:03:00.794365413Z [2024-05-25 02:03:00,794: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:03:00.794528162Z [2024-05-25 02:03:00,794: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T02:03:00.794791876Z [2024-05-25 02:03:00,794: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:03:00.877282451Z [2024-05-25 02:03:00,876: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:03:01.464674583Z [2024-05-25 02:03:01,464: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7771a0ac-66ff-4c4d-bdb8-cac07e4768b6] succeeded in 1.18190709999908s: None 2024-05-25T02:03:01.755291459Z [2024-05-25 02:03:01,754: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:03:01.755600125Z [2024-05-25 02:03:01,755: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:03:01.758531976Z [2024-05-25 02:03:01,758: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:03:01.758806885Z [2024-05-25 02:03:01,758: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:03:01.778742204Z [2024-05-25 02:03:01,778: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:03:01.780268893Z [2024-05-25 02:03:01,780: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:03:01.780587471Z [2024-05-25 02:03:01,780: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:03:01.780859701Z [2024-05-25 02:03:01,780: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:03:01.780997170Z [2024-05-25 02:03:01,780: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:03:01.781397820Z [2024-05-25 02:03:01,781: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:03:01.781552104Z [2024-05-25 02:03:01,781: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:03:01.792452512Z [2024-05-25 02:03:01,792: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:03:01.794340083Z [2024-05-25 02:03:01,794: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:03:01.794469238Z [2024-05-25 02:03:01,794: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:03:01.794682298Z [2024-05-25 02:03:01,794: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:03:01.794805945Z [2024-05-25 02:03:01,794: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:03:01.795167539Z [2024-05-25 02:03:01,794: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:03:01.795380263Z [2024-05-25 02:03:01,795: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:03:01.873879470Z [2024-05-25 02:03:01,873: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:03:01.898636723Z [2024-05-25 02:03:01,898: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:03:04.609882660Z [2024-05-25 02:03:04,609: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c83e35fe-d978-4e89-b751-67126b5ca301] succeeded in 4.337047899998652s: None 2024-05-25T02:03:04.796104727Z [2024-05-25 02:03:04,795: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[08cb6839-ac0a-41b7-99c9-da1221cc10cd] succeeded in 4.503500681999867s: None 2024-05-25T02:04:00.912697000Z [2024-05-25 02:04:00,911: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf8e4485-a5ef-462c-8150-b48e148c2a63] received 2024-05-25T02:04:00.917680881Z [2024-05-25 02:04:00,917: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ff3a04e-0d1c-4546-8cda-a9f5f678a1a1] received 2024-05-25T02:04:00.933267520Z [2024-05-25 02:04:00,932: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c5effea-77d9-47cc-98e9-a9205691a55a] received 2024-05-25T02:04:00.934322312Z [2024-05-25 02:04:00,933: INFO/ForkPoolWorker-16] [7ff3a04e-0d1c-4546-8cda-a9f5f678a1a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:04:00.936485983Z [2024-05-25 02:04:00,936: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d490242-6d09-4822-b3c9-b8b009b25a93] received 2024-05-25T02:04:00.937327190Z [2024-05-25 02:04:00,935: INFO/ForkPoolWorker-15] [cf8e4485-a5ef-462c-8150-b48e148c2a63] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:04:00.948525792Z [2024-05-25 02:04:00,948: INFO/ForkPoolWorker-1] [4c5effea-77d9-47cc-98e9-a9205691a55a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:04:00.957367753Z [2024-05-25 02:04:00,956: INFO/ForkPoolWorker-2] [7d490242-6d09-4822-b3c9-b8b009b25a93] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:04:01.260935729Z [2024-05-25 02:04:01,257: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:04:01.271581559Z [2024-05-25 02:04:01,267: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:04:01.300252310Z [2024-05-25 02:04:01,297: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:04:01.344700646Z [2024-05-25 02:04:01,331: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:04:01.572356508Z [2024-05-25 02:04:01,572: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:04:01.607792178Z [2024-05-25 02:04:01,607: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T02:04:01.619010257Z [2024-05-25 02:04:01,618: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:04:01.655049826Z [2024-05-25 02:04:01,654: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:04:01.656586144Z [2024-05-25 02:04:01,656: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:04:01.656720329Z [2024-05-25 02:04:01,656: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:04:01.656819046Z [2024-05-25 02:04:01,656: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T02:04:01.657086395Z [2024-05-25 02:04:01,656: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:04:01.767975385Z [2024-05-25 02:04:01,767: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:04:02.158246954Z [2024-05-25 02:04:02,157: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4c5effea-77d9-47cc-98e9-a9205691a55a] succeeded in 1.2193316289994982s: None 2024-05-25T02:04:02.544115202Z [2024-05-25 02:04:02,543: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7ff3a04e-0d1c-4546-8cda-a9f5f678a1a1] succeeded in 1.6189443319999555s: None 2024-05-25T02:04:02.724051220Z [2024-05-25 02:04:02,723: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:04:02.728533059Z [2024-05-25 02:04:02,727: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:04:02.753724658Z [2024-05-25 02:04:02,753: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:04:02.755153311Z [2024-05-25 02:04:02,754: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:04:02.755172603Z [2024-05-25 02:04:02,755: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:04:02.755316297Z [2024-05-25 02:04:02,755: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:04:02.755371190Z [2024-05-25 02:04:02,755: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:04:02.755605858Z [2024-05-25 02:04:02,755: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:04:02.755719900Z [2024-05-25 02:04:02,755: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:04:02.862941864Z [2024-05-25 02:04:02,862: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:04:02.863517780Z [2024-05-25 02:04:02,863: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T02:04:02.866804507Z [2024-05-25 02:04:02,866: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:04:02.890732348Z [2024-05-25 02:04:02,890: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:04:02.892190403Z [2024-05-25 02:04:02,891: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:04:02.892202541Z [2024-05-25 02:04:02,892: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:04:02.892407308Z [2024-05-25 02:04:02,892: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:04:02.892537014Z [2024-05-25 02:04:02,892: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T02:04:02.892793068Z [2024-05-25 02:04:02,892: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:04:02.892948478Z [2024-05-25 02:04:02,892: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:04:02.994966078Z [2024-05-25 02:04:02,994: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:04:04.771114397Z [2024-05-25 02:04:04,770: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cf8e4485-a5ef-462c-8150-b48e148c2a63] succeeded in 3.849768607999067s: None 2024-05-25T02:04:05.361797565Z [2024-05-25 02:04:05,360: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7d490242-6d09-4822-b3c9-b8b009b25a93] succeeded in 4.419591629999559s: None 2024-05-25T02:05:00.978653939Z [2024-05-25 02:05:00,978: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9345f02b-f110-4514-b38e-a321344abdf8] received 2024-05-25T02:05:00.982977664Z [2024-05-25 02:05:00,982: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc3e8269-fb9c-428d-a80a-5e84401d4f30] received 2024-05-25T02:05:00.994051142Z [2024-05-25 02:05:00,993: INFO/ForkPoolWorker-15] [9345f02b-f110-4514-b38e-a321344abdf8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:05:00.994413036Z [2024-05-25 02:05:00,994: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[414af4e8-a890-474b-acdb-af7ac5f96d8d] received 2024-05-25T02:05:00.998416267Z [2024-05-25 02:05:00,998: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[afbaba83-fdaf-4fb2-ac59-d306bd71e7fb] received 2024-05-25T02:05:01.010665256Z [2024-05-25 02:05:01,010: INFO/ForkPoolWorker-2] [afbaba83-fdaf-4fb2-ac59-d306bd71e7fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:05:01.021071732Z [2024-05-25 02:05:01,019: INFO/ForkPoolWorker-1] [414af4e8-a890-474b-acdb-af7ac5f96d8d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:05:01.025829065Z [2024-05-25 02:05:01,025: INFO/ForkPoolWorker-16] [dc3e8269-fb9c-428d-a80a-5e84401d4f30] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:05:01.356884552Z [2024-05-25 02:05:01,339: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:05:01.489097394Z [2024-05-25 02:05:01,484: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:05:01.547173484Z [2024-05-25 02:05:01,542: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:05:01.595188546Z [2024-05-25 02:05:01,579: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:05:01.776015508Z [2024-05-25 02:05:01,775: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T02:05:01.790521594Z [2024-05-25 02:05:01,790: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:05:01.852704078Z [2024-05-25 02:05:01,852: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:05:01.857768729Z [2024-05-25 02:05:01,857: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:05:01.857947156Z [2024-05-25 02:05:01,857: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:05:01.858044335Z [2024-05-25 02:05:01,857: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T02:05:01.858312655Z [2024-05-25 02:05:01,858: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:05:02.080852843Z [2024-05-25 02:05:02,080: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:05:03.050906534Z [2024-05-25 02:05:03,050: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:05:03.054434397Z [2024-05-25 02:05:03,053: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:05:03.086389597Z [2024-05-25 02:05:03,086: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:05:03.096531089Z [2024-05-25 02:05:03,096: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:05:03.096559932Z [2024-05-25 02:05:03,096: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:05:03.096646123Z [2024-05-25 02:05:03,096: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:05:03.096679723Z [2024-05-25 02:05:03,096: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:05:03.096970519Z [2024-05-25 02:05:03,096: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:05:03.096983515Z [2024-05-25 02:05:03,096: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:05:03.189694296Z [2024-05-25 02:05:03,189: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:05:03.263164472Z [2024-05-25 02:05:03,262: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:05:03.271843336Z [2024-05-25 02:05:03,271: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:05:03.346193840Z [2024-05-25 02:05:03,345: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:05:03.347923451Z [2024-05-25 02:05:03,347: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:05:03.348019467Z [2024-05-25 02:05:03,347: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:05:03.348216886Z [2024-05-25 02:05:03,348: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:05:03.348301623Z [2024-05-25 02:05:03,348: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:05:03.349254046Z [2024-05-25 02:05:03,349: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:05:03.349389613Z [2024-05-25 02:05:03,349: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:05:03.426586608Z [2024-05-25 02:05:03,426: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[afbaba83-fdaf-4fb2-ac59-d306bd71e7fb] succeeded in 2.4254856259994995s: None 2024-05-25T02:05:03.488938828Z [2024-05-25 02:05:03,488: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:05:03.786677656Z [2024-05-25 02:05:03,785: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:05:03.792600610Z [2024-05-25 02:05:03,791: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:05:03.828981764Z [2024-05-25 02:05:03,828: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:05:03.832626037Z [2024-05-25 02:05:03,832: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:05:03.832938111Z [2024-05-25 02:05:03,832: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:05:03.833397250Z [2024-05-25 02:05:03,833: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:05:03.833666530Z [2024-05-25 02:05:03,833: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:05:03.834210630Z [2024-05-25 02:05:03,833: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:05:03.834440961Z [2024-05-25 02:05:03,834: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:05:03.986766214Z [2024-05-25 02:05:03,986: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:05:04.650959035Z [2024-05-25 02:05:04,650: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9345f02b-f110-4514-b38e-a321344abdf8] succeeded in 3.6678179940008704s: None 2024-05-25T02:05:04.857877442Z [2024-05-25 02:05:04,857: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2767032a-0787-4d53-89c5-ecb7f869958d] received 2024-05-25T02:05:04.873062165Z [2024-05-25 02:05:04,872: INFO/ForkPoolWorker-15] [2767032a-0787-4d53-89c5-ecb7f869958d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:05:05.004188489Z [2024-05-25 02:05:05,003: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[414af4e8-a890-474b-acdb-af7ac5f96d8d] succeeded in 4.0066937760002475s: None 2024-05-25T02:05:05.142644924Z [2024-05-25 02:05:05,139: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:05:06.088642821Z [2024-05-25 02:05:06,086: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dc3e8269-fb9c-428d-a80a-5e84401d4f30] succeeded in 5.1012787250001566s: None 2024-05-25T02:05:06.208261096Z [2024-05-25 02:05:06,207: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:05:06.211545003Z [2024-05-25 02:05:06,211: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:05:06.239553234Z [2024-05-25 02:05:06,239: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:05:06.241906069Z [2024-05-25 02:05:06,241: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:05:06.242041625Z [2024-05-25 02:05:06,241: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:05:06.242191938Z [2024-05-25 02:05:06,242: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:05:06.242276377Z [2024-05-25 02:05:06,242: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:05:06.242754159Z [2024-05-25 02:05:06,242: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:05:06.242988763Z [2024-05-25 02:05:06,242: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:05:06.382652402Z [2024-05-25 02:05:06,382: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:05:07.059956431Z [2024-05-25 02:05:07,058: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2767032a-0787-4d53-89c5-ecb7f869958d] succeeded in 2.1966284989994165s: None 2024-05-25T02:05:07.273413836Z [2024-05-25 02:05:07,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37cf379c-baed-48ca-b01d-00f810092857] received 2024-05-25T02:05:07.280110210Z [2024-05-25 02:05:07,279: INFO/ForkPoolWorker-15] [37cf379c-baed-48ca-b01d-00f810092857] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T02:05:07.580622051Z [2024-05-25 02:05:07,577: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:05:08.756318168Z [2024-05-25 02:05:08,755: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:05:08.766709639Z [2024-05-25 02:05:08,766: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:05:08.800463433Z [2024-05-25 02:05:08,800: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:05:08.801928412Z [2024-05-25 02:05:08,801: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:05:08.801980761Z [2024-05-25 02:05:08,801: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:05:08.802099904Z [2024-05-25 02:05:08,801: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:05:08.802153766Z [2024-05-25 02:05:08,802: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:05:08.802386792Z [2024-05-25 02:05:08,802: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:05:08.802437580Z [2024-05-25 02:05:08,802: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:05:08.905548570Z [2024-05-25 02:05:08,904: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:05:09.522680975Z [2024-05-25 02:05:09,522: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[37cf379c-baed-48ca-b01d-00f810092857] succeeded in 2.246541888000138s: None 2024-05-25T02:05:09.966489663Z [2024-05-25 02:05:09,966: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be61e045-ff0e-499c-9a56-f1398d17becf] received 2024-05-25T02:05:09.980783922Z [2024-05-25 02:05:09,980: INFO/ForkPoolWorker-15] [be61e045-ff0e-499c-9a56-f1398d17becf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:05:10.290708817Z [2024-05-25 02:05:10,287: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:05:11.456607703Z [2024-05-25 02:05:11,456: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:05:11.462179016Z [2024-05-25 02:05:11,461: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:05:11.492592522Z [2024-05-25 02:05:11,492: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:05:11.494567252Z [2024-05-25 02:05:11,494: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:05:11.494771426Z [2024-05-25 02:05:11,494: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:05:11.495060059Z [2024-05-25 02:05:11,494: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:05:11.495273467Z [2024-05-25 02:05:11,494: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:05:11.495859567Z [2024-05-25 02:05:11,495: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:05:11.496073362Z [2024-05-25 02:05:11,495: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:05:11.594370401Z [2024-05-25 02:05:11,593: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:05:12.273844899Z [2024-05-25 02:05:12,273: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[be61e045-ff0e-499c-9a56-f1398d17becf] succeeded in 2.305455837000409s: None 2024-05-25T02:06:01.002310385Z [2024-05-25 02:06:01,001: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a13d3c4-9b9e-45db-8154-fa7715314f69] received 2024-05-25T02:06:01.010224440Z [2024-05-25 02:06:01,009: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e805cbb7-af63-4f2e-8ff0-0a4980feae85] received 2024-05-25T02:06:01.021982315Z [2024-05-25 02:06:01,021: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d15c2399-5ae4-4567-a029-77e1a035440a] received 2024-05-25T02:06:01.024111796Z [2024-05-25 02:06:01,023: INFO/ForkPoolWorker-16] [e805cbb7-af63-4f2e-8ff0-0a4980feae85] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:06:01.024367285Z [2024-05-25 02:06:01,023: INFO/ForkPoolWorker-15] [0a13d3c4-9b9e-45db-8154-fa7715314f69] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:06:01.026249056Z [2024-05-25 02:06:01,025: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[544e991d-6753-466f-957c-f10add915388] received 2024-05-25T02:06:01.041636902Z [2024-05-25 02:06:01,041: INFO/ForkPoolWorker-2] [544e991d-6753-466f-957c-f10add915388] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:06:01.041929746Z [2024-05-25 02:06:01,041: INFO/ForkPoolWorker-1] [d15c2399-5ae4-4567-a029-77e1a035440a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:06:01.365401198Z [2024-05-25 02:06:01,359: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:06:01.393593242Z [2024-05-25 02:06:01,389: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:06:01.452085484Z [2024-05-25 02:06:01,448: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:06:01.467902580Z [2024-05-25 02:06:01,463: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:06:01.673535919Z [2024-05-25 02:06:01,673: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T02:06:01.677688478Z [2024-05-25 02:06:01,677: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:06:01.710276705Z [2024-05-25 02:06:01,710: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:06:01.712874992Z [2024-05-25 02:06:01,712: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:06:01.713061098Z [2024-05-25 02:06:01,712: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:06:01.713603366Z [2024-05-25 02:06:01,713: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T02:06:01.714002038Z [2024-05-25 02:06:01,713: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:06:01.719194566Z [2024-05-25 02:06:01,718: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:06:01.825760749Z [2024-05-25 02:06:01,825: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:06:02.412700902Z [2024-05-25 02:06:02,412: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e805cbb7-af63-4f2e-8ff0-0a4980feae85] succeeded in 1.4000579650000873s: None 2024-05-25T02:06:02.614157852Z [2024-05-25 02:06:02,613: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d15c2399-5ae4-4567-a029-77e1a035440a] succeeded in 1.5878609669998696s: None 2024-05-25T02:06:02.748131931Z [2024-05-25 02:06:02,747: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T02:06:02.751424503Z [2024-05-25 02:06:02,751: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:06:02.769867461Z [2024-05-25 02:06:02,769: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:06:02.771026776Z [2024-05-25 02:06:02,770: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:06:02.771040770Z [2024-05-25 02:06:02,770: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:06:02.771194417Z [2024-05-25 02:06:02,770: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:06:02.771229881Z [2024-05-25 02:06:02,771: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T02:06:02.771542356Z [2024-05-25 02:06:02,771: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:06:02.771606109Z [2024-05-25 02:06:02,771: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:06:02.851845442Z [2024-05-25 02:06:02,851: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:06:02.883629873Z [2024-05-25 02:06:02,883: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:06:02.887328960Z [2024-05-25 02:06:02,886: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:06:02.903607041Z [2024-05-25 02:06:02,903: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:06:02.904717145Z [2024-05-25 02:06:02,904: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:06:02.904742189Z [2024-05-25 02:06:02,904: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:06:02.904937175Z [2024-05-25 02:06:02,904: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:06:02.904951070Z [2024-05-25 02:06:02,904: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:06:02.905291906Z [2024-05-25 02:06:02,905: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:06:02.905317262Z [2024-05-25 02:06:02,905: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:06:02.983449315Z [2024-05-25 02:06:02,983: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:06:05.030014663Z [2024-05-25 02:06:05,029: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0a13d3c4-9b9e-45db-8154-fa7715314f69] succeeded in 4.0215341359999s: None 2024-05-25T02:06:05.398094231Z [2024-05-25 02:06:05,397: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[544e991d-6753-466f-957c-f10add915388] succeeded in 4.364626432001387s: None 2024-05-25T02:07:00.749542180Z [2024-05-25 02:07:00,748: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d107520-4dae-4022-a4d5-f138f73d6b79] received 2024-05-25T02:07:00.753824046Z [2024-05-25 02:07:00,753: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86051e94-b6da-4065-b257-882936b2941a] received 2024-05-25T02:07:00.757036811Z [2024-05-25 02:07:00,756: INFO/ForkPoolWorker-15] [5d107520-4dae-4022-a4d5-f138f73d6b79] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:07:00.768695874Z [2024-05-25 02:07:00,768: INFO/ForkPoolWorker-16] [86051e94-b6da-4065-b257-882936b2941a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:07:00.779530510Z [2024-05-25 02:07:00,779: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44b04b49-455d-4861-907d-caf96eb35bc6] received 2024-05-25T02:07:00.785742803Z [2024-05-25 02:07:00,785: INFO/ForkPoolWorker-1] [44b04b49-455d-4861-907d-caf96eb35bc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:07:01.093928818Z [2024-05-25 02:07:01,088: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:07:01.125608809Z [2024-05-25 02:07:01,122: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:07:01.139283819Z [2024-05-25 02:07:01,135: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:07:01.294293605Z [2024-05-25 02:07:01,293: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T02:07:01.297974376Z [2024-05-25 02:07:01,297: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:07:01.322059764Z [2024-05-25 02:07:01,321: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:07:01.324952535Z [2024-05-25 02:07:01,324: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:07:01.325152089Z [2024-05-25 02:07:01,324: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:07:01.325344028Z [2024-05-25 02:07:01,325: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T02:07:01.325786603Z [2024-05-25 02:07:01,325: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:07:01.468588619Z [2024-05-25 02:07:01,468: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:07:02.107840830Z [2024-05-25 02:07:02,107: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[86051e94-b6da-4065-b257-882936b2941a] succeeded in 1.3501995370006625s: None 2024-05-25T02:07:02.553560570Z [2024-05-25 02:07:02,553: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:07:02.557279339Z [2024-05-25 02:07:02,556: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:07:02.576233899Z [2024-05-25 02:07:02,575: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:07:02.580171567Z [2024-05-25 02:07:02,579: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:07:02.588422046Z [2024-05-25 02:07:02,588: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:07:02.592121663Z [2024-05-25 02:07:02,591: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:07:02.592577775Z [2024-05-25 02:07:02,592: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:07:02.593645557Z [2024-05-25 02:07:02,592: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:07:02.593994516Z [2024-05-25 02:07:02,593: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:07:02.594802261Z [2024-05-25 02:07:02,594: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:07:02.595437742Z [2024-05-25 02:07:02,594: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:07:02.599003100Z [2024-05-25 02:07:02,598: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:07:02.600260615Z [2024-05-25 02:07:02,600: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:07:02.600271444Z [2024-05-25 02:07:02,600: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:07:02.600463845Z [2024-05-25 02:07:02,600: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:07:02.600521508Z [2024-05-25 02:07:02,600: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:07:02.600882414Z [2024-05-25 02:07:02,600: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:07:02.600950702Z [2024-05-25 02:07:02,600: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:07:02.688999431Z [2024-05-25 02:07:02,688: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:07:02.705578730Z [2024-05-25 02:07:02,704: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:07:04.204001422Z [2024-05-25 02:07:04,203: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[44b04b49-455d-4861-907d-caf96eb35bc6] succeeded in 3.4230323000010685s: None 2024-05-25T02:07:04.521014496Z [2024-05-25 02:07:04,520: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5d107520-4dae-4022-a4d5-f138f73d6b79] succeeded in 3.7698892209991754s: None 2024-05-25T02:08:01.225889276Z [2024-05-25 02:08:01,224: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2dbaf1e8-5687-4dea-a18f-8269272c84c1] received 2024-05-25T02:08:01.230980431Z [2024-05-25 02:08:01,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc797232-2299-445b-b9a1-1ed351c93e93] received 2024-05-25T02:08:01.237956273Z [2024-05-25 02:08:01,237: INFO/ForkPoolWorker-15] [2dbaf1e8-5687-4dea-a18f-8269272c84c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:08:01.240701629Z [2024-05-25 02:08:01,240: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da5f75fd-0a12-40a8-ac7a-5c386863d65f] received 2024-05-25T02:08:01.244480202Z [2024-05-25 02:08:01,244: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ddd5d24-5dcb-49fb-bebb-8aa240512a42] received 2024-05-25T02:08:01.247883298Z [2024-05-25 02:08:01,247: INFO/ForkPoolWorker-16] [fc797232-2299-445b-b9a1-1ed351c93e93] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:08:01.262351402Z [2024-05-25 02:08:01,261: INFO/ForkPoolWorker-2] [3ddd5d24-5dcb-49fb-bebb-8aa240512a42] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:08:01.262381639Z [2024-05-25 02:08:01,261: INFO/ForkPoolWorker-1] [da5f75fd-0a12-40a8-ac7a-5c386863d65f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:08:01.607391812Z [2024-05-25 02:08:01,590: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:08:01.641131596Z [2024-05-25 02:08:01,638: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:08:01.689349134Z [2024-05-25 02:08:01,685: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:08:01.761551936Z [2024-05-25 02:08:01,757: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:08:01.946780043Z [2024-05-25 02:08:01,946: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T02:08:01.952372372Z [2024-05-25 02:08:01,951: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:08:01.965761923Z [2024-05-25 02:08:01,965: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:08:01.986372634Z [2024-05-25 02:08:01,986: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:08:01.990123077Z [2024-05-25 02:08:01,989: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:08:01.990352991Z [2024-05-25 02:08:01,990: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:08:01.990605100Z [2024-05-25 02:08:01,990: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T02:08:01.990909897Z [2024-05-25 02:08:01,990: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:08:02.077612980Z [2024-05-25 02:08:02,077: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:08:02.727579016Z [2024-05-25 02:08:02,727: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2dbaf1e8-5687-4dea-a18f-8269272c84c1] succeeded in 1.4989931250001973s: None 2024-05-25T02:08:02.862008353Z [2024-05-25 02:08:02,861: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3ddd5d24-5dcb-49fb-bebb-8aa240512a42] succeeded in 1.6143617479992827s: None 2024-05-25T02:08:03.243183492Z [2024-05-25 02:08:03,242: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:08:03.246266557Z [2024-05-25 02:08:03,245: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:08:03.264912706Z [2024-05-25 02:08:03,264: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:08:03.266715714Z [2024-05-25 02:08:03,266: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:08:03.268305772Z [2024-05-25 02:08:03,268: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:08:03.268321107Z [2024-05-25 02:08:03,268: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:08:03.268444583Z [2024-05-25 02:08:03,268: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:08:03.268486599Z [2024-05-25 02:08:03,268: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:08:03.268712507Z [2024-05-25 02:08:03,268: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:08:03.268719910Z [2024-05-25 02:08:03,268: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:08:03.268785345Z [2024-05-25 02:08:03,268: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:08:03.303946051Z [2024-05-25 02:08:03,303: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:08:03.306222385Z [2024-05-25 02:08:03,305: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:08:03.306430343Z [2024-05-25 02:08:03,306: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:08:03.306755602Z [2024-05-25 02:08:03,306: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:08:03.306949717Z [2024-05-25 02:08:03,306: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:08:03.307412382Z [2024-05-25 02:08:03,307: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:08:03.308077615Z [2024-05-25 02:08:03,307: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:08:03.344360625Z [2024-05-25 02:08:03,344: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:08:03.412654750Z [2024-05-25 02:08:03,412: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:08:04.845937512Z [2024-05-25 02:08:04,845: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[da5f75fd-0a12-40a8-ac7a-5c386863d65f] succeeded in 3.6007227310001326s: None 2024-05-25T02:08:06.616021148Z [2024-05-25 02:08:06,615: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fc797232-2299-445b-b9a1-1ed351c93e93] succeeded in 5.380936032999671s: None 2024-05-25T02:09:01.137669935Z [2024-05-25 02:09:01,137: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2cd120bc-02f3-4007-8be4-f39d61e80ecb] received 2024-05-25T02:09:01.141414360Z [2024-05-25 02:09:01,141: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[965e2f8b-b64d-4390-9bca-9f01c279b360] received 2024-05-25T02:09:01.151138759Z [2024-05-25 02:09:01,150: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c79de9b-1955-4ec2-8e23-8b883d51e632] received 2024-05-25T02:09:01.151255468Z [2024-05-25 02:09:01,150: INFO/ForkPoolWorker-16] [965e2f8b-b64d-4390-9bca-9f01c279b360] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:09:01.157827562Z [2024-05-25 02:09:01,157: INFO/ForkPoolWorker-15] [2cd120bc-02f3-4007-8be4-f39d61e80ecb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:09:01.163104718Z [2024-05-25 02:09:01,162: INFO/ForkPoolWorker-1] [9c79de9b-1955-4ec2-8e23-8b883d51e632] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:09:01.480178199Z [2024-05-25 02:09:01,476: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:09:01.500070484Z [2024-05-25 02:09:01,496: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:09:01.513663164Z [2024-05-25 02:09:01,510: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:09:01.649444372Z [2024-05-25 02:09:01,648: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T02:09:01.654561362Z [2024-05-25 02:09:01,654: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:09:01.688481367Z [2024-05-25 02:09:01,688: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:09:01.690812302Z [2024-05-25 02:09:01,690: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:09:01.691053576Z [2024-05-25 02:09:01,690: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:09:01.691196298Z [2024-05-25 02:09:01,691: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T02:09:01.691466307Z [2024-05-25 02:09:01,691: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:09:01.781313262Z [2024-05-25 02:09:01,781: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:09:02.538056680Z [2024-05-25 02:09:02,537: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[965e2f8b-b64d-4390-9bca-9f01c279b360] succeeded in 1.3936056239999743s: None 2024-05-25T02:09:02.700153541Z [2024-05-25 02:09:02,699: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:09:02.703135706Z [2024-05-25 02:09:02,702: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:09:02.722571782Z [2024-05-25 02:09:02,722: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:09:02.724129212Z [2024-05-25 02:09:02,723: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:09:02.724140908Z [2024-05-25 02:09:02,724: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:09:02.724248920Z [2024-05-25 02:09:02,724: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:09:02.724254563Z [2024-05-25 02:09:02,724: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:09:02.725477268Z [2024-05-25 02:09:02,725: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:09:02.725491306Z [2024-05-25 02:09:02,725: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:09:02.803315297Z [2024-05-25 02:09:02,802: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:09:02.815167360Z [2024-05-25 02:09:02,812: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:09:02.852394241Z [2024-05-25 02:09:02,852: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:09:02.857336340Z [2024-05-25 02:09:02,854: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:09:02.857366208Z [2024-05-25 02:09:02,854: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:09:02.857369847Z [2024-05-25 02:09:02,854: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:09:02.857373323Z [2024-05-25 02:09:02,854: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:09:02.857376878Z [2024-05-25 02:09:02,854: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:09:02.857379973Z [2024-05-25 02:09:02,855: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:09:02.857383632Z [2024-05-25 02:09:02,855: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:09:02.950056945Z [2024-05-25 02:09:02,949: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:09:04.603860222Z [2024-05-25 02:09:04,603: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9c79de9b-1955-4ec2-8e23-8b883d51e632] succeeded in 3.449543327000356s: None 2024-05-25T02:09:04.980263558Z [2024-05-25 02:09:04,979: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2cd120bc-02f3-4007-8be4-f39d61e80ecb] succeeded in 3.8353106570011732s: None 2024-05-25T02:10:01.089983931Z [2024-05-25 02:10:01,089: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06c74d79-b93b-4500-8bcc-e045cf403ee5] received 2024-05-25T02:10:01.094703255Z [2024-05-25 02:10:01,094: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9fd50f4-721f-4d8c-a011-0b78ffe18c4d] received 2024-05-25T02:10:01.097741501Z [2024-05-25 02:10:01,097: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a629589-7bc8-4e58-b2cc-23bf6ab0176d] received 2024-05-25T02:10:01.099330021Z [2024-05-25 02:10:01,099: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[575f71a3-f026-4f7c-87f8-dbff144af849] received 2024-05-25T02:10:01.101080310Z [2024-05-25 02:10:01,100: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10b10de3-c246-4283-b04a-334604624638] received 2024-05-25T02:10:01.103710259Z [2024-05-25 02:10:01,103: INFO/ForkPoolWorker-15] [06c74d79-b93b-4500-8bcc-e045cf403ee5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:10:01.106579415Z [2024-05-25 02:10:01,106: INFO/ForkPoolWorker-1] [2a629589-7bc8-4e58-b2cc-23bf6ab0176d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:10:01.113348875Z [2024-05-25 02:10:01,113: INFO/ForkPoolWorker-2] [575f71a3-f026-4f7c-87f8-dbff144af849] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:10:01.148510625Z [2024-05-25 02:10:01,148: INFO/ForkPoolWorker-16] [a9fd50f4-721f-4d8c-a011-0b78ffe18c4d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:10:01.160913698Z [2024-05-25 02:10:01,160: INFO/ForkPoolWorker-3] [10b10de3-c246-4283-b04a-334604624638] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:10:01.528663653Z [2024-05-25 02:10:01,523: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:10:01.674442919Z [2024-05-25 02:10:01,664: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:10:01.713188943Z [2024-05-25 02:10:01,710: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:10:01.717570385Z [2024-05-25 02:10:01,708: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:10:02.011920029Z [2024-05-25 02:10:01,985: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:10:02.264403103Z [2024-05-25 02:10:02,259: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T02:10:02.342850166Z [2024-05-25 02:10:02,342: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:10:02.374630799Z [2024-05-25 02:10:02,374: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:10:02.506648043Z [2024-05-25 02:10:02,506: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:10:02.512196228Z [2024-05-25 02:10:02,511: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:10:02.512328802Z [2024-05-25 02:10:02,512: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:10:02.512404180Z [2024-05-25 02:10:02,512: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T02:10:02.512650383Z [2024-05-25 02:10:02,512: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:10:02.783094063Z [2024-05-25 02:10:02,782: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:10:03.426761844Z [2024-05-25 02:10:03,426: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a9fd50f4-721f-4d8c-a011-0b78ffe18c4d] succeeded in 2.3303164560002187s: None 2024-05-25T02:10:03.937381750Z [2024-05-25 02:10:03,934: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[575f71a3-f026-4f7c-87f8-dbff144af849] succeeded in 2.8339337689994863s: None 2024-05-25T02:10:04.413290809Z [2024-05-25 02:10:04,412: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:10:04.418842557Z [2024-05-25 02:10:04,418: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:10:04.450771602Z [2024-05-25 02:10:04,450: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:10:04.456094121Z [2024-05-25 02:10:04,455: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:10:04.456116482Z [2024-05-25 02:10:04,455: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:10:04.456302343Z [2024-05-25 02:10:04,456: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:10:04.456355452Z [2024-05-25 02:10:04,456: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:10:04.456581010Z [2024-05-25 02:10:04,456: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:10:04.457197277Z [2024-05-25 02:10:04,457: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:10:04.494476742Z [2024-05-25 02:10:04,494: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-25T02:10:04.498710254Z [2024-05-25 02:10:04,498: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:10:04.551559922Z [2024-05-25 02:10:04,551: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T02:10:04.553620361Z [2024-05-25 02:10:04,553: INFO/ForkPoolWorker-3] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:10:04.553820455Z [2024-05-25 02:10:04,553: INFO/ForkPoolWorker-3] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:10:04.564288780Z [2024-05-25 02:10:04,561: INFO/ForkPoolWorker-3] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:10:04.573067234Z [2024-05-25 02:10:04,572: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-25T02:10:04.574794303Z [2024-05-25 02:10:04,574: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:10:04.575758782Z [2024-05-25 02:10:04,575: INFO/ForkPoolWorker-3] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:10:04.635695262Z [2024-05-25 02:10:04,635: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:10:04.814444558Z [2024-05-25 02:10:04,814: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:10:05.138828543Z [2024-05-25 02:10:05,138: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:10:05.151566313Z [2024-05-25 02:10:05,149: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:10:05.243161940Z [2024-05-25 02:10:05,242: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:10:05.254093676Z [2024-05-25 02:10:05,253: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:10:05.254158440Z [2024-05-25 02:10:05,253: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:10:05.254242725Z [2024-05-25 02:10:05,254: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:10:05.254248377Z [2024-05-25 02:10:05,254: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:10:05.254471471Z [2024-05-25 02:10:05,254: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:10:05.254511748Z [2024-05-25 02:10:05,254: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:10:05.412017642Z [2024-05-25 02:10:05,410: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:10:05.851378988Z [2024-05-25 02:10:05,851: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4420b369-9acb-4d51-87d5-3151e6c545bc] received 2024-05-25T02:10:05.865411103Z [2024-05-25 02:10:05,865: INFO/ForkPoolWorker-16] [4420b369-9acb-4d51-87d5-3151e6c545bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:10:05.919867092Z [2024-05-25 02:10:05,919: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[06c74d79-b93b-4500-8bcc-e045cf403ee5] succeeded in 4.825228288998915s: None 2024-05-25T02:10:06.311639151Z [2024-05-25 02:10:06,304: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:10:07.027104320Z [2024-05-25 02:10:07,026: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[10b10de3-c246-4283-b04a-334604624638] succeeded in 5.921815507999781s: None 2024-05-25T02:10:07.897273849Z [2024-05-25 02:10:07,896: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2a629589-7bc8-4e58-b2cc-23bf6ab0176d] succeeded in 6.797816685999351s: None 2024-05-25T02:10:07.927077851Z [2024-05-25 02:10:07,926: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:10:07.932057267Z [2024-05-25 02:10:07,931: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:10:07.979741847Z [2024-05-25 02:10:07,979: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:10:07.983015176Z [2024-05-25 02:10:07,982: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:10:07.983043821Z [2024-05-25 02:10:07,982: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:10:07.983051006Z [2024-05-25 02:10:07,982: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:10:07.983054987Z [2024-05-25 02:10:07,982: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:10:07.983058153Z [2024-05-25 02:10:07,982: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:10:07.985320867Z [2024-05-25 02:10:07,982: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:10:08.097243377Z [2024-05-25 02:10:08,096: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:10:08.958649229Z [2024-05-25 02:10:08,957: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4420b369-9acb-4d51-87d5-3151e6c545bc] succeeded in 3.099176322999483s: None 2024-05-25T02:10:09.065880820Z [2024-05-25 02:10:09,064: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[659cdde7-e41a-4fcf-b8cb-84c9a3f8c08c] received 2024-05-25T02:10:09.079278965Z [2024-05-25 02:10:09,074: INFO/ForkPoolWorker-15] [659cdde7-e41a-4fcf-b8cb-84c9a3f8c08c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T02:10:09.336796468Z [2024-05-25 02:10:09,333: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:10:10.423461695Z [2024-05-25 02:10:10,422: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:10:10.426709039Z [2024-05-25 02:10:10,425: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:10:10.449522852Z [2024-05-25 02:10:10,449: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:10:10.451080622Z [2024-05-25 02:10:10,450: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:10:10.451116761Z [2024-05-25 02:10:10,450: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:10:10.451247197Z [2024-05-25 02:10:10,451: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:10:10.451267651Z [2024-05-25 02:10:10,451: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:10:10.451691287Z [2024-05-25 02:10:10,451: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:10:10.451816761Z [2024-05-25 02:10:10,451: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:10:10.543504718Z [2024-05-25 02:10:10,543: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:10:11.073644194Z [2024-05-25 02:10:11,071: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[659cdde7-e41a-4fcf-b8cb-84c9a3f8c08c] succeeded in 2.0033157279995066s: None 2024-05-25T02:10:11.442351560Z [2024-05-25 02:10:11,442: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92f1a0ca-91bf-4527-9c97-3fd999dd6479] received 2024-05-25T02:10:11.452682443Z [2024-05-25 02:10:11,452: INFO/ForkPoolWorker-15] [92f1a0ca-91bf-4527-9c97-3fd999dd6479] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:10:11.788359801Z [2024-05-25 02:10:11,783: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:10:13.029545393Z [2024-05-25 02:10:13,029: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:10:13.036730401Z [2024-05-25 02:10:13,033: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:10:13.078136544Z [2024-05-25 02:10:13,077: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:10:13.089828889Z [2024-05-25 02:10:13,089: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:10:13.089996181Z [2024-05-25 02:10:13,089: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:10:13.090175110Z [2024-05-25 02:10:13,090: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:10:13.090338597Z [2024-05-25 02:10:13,090: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:10:13.090739549Z [2024-05-25 02:10:13,090: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:10:13.090861783Z [2024-05-25 02:10:13,090: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:10:13.225350761Z [2024-05-25 02:10:13,224: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:10:13.858396562Z [2024-05-25 02:10:13,857: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[92f1a0ca-91bf-4527-9c97-3fd999dd6479] succeeded in 2.4129050009996718s: None 2024-05-25T02:11:01.125928602Z [2024-05-25 02:11:01,125: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7463ab8-711d-40ac-86bd-aaaf6a36fcd6] received 2024-05-25T02:11:01.136183447Z [2024-05-25 02:11:01,135: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ae02df7-8d76-47de-b254-4d1f0973b389] received 2024-05-25T02:11:01.144097275Z [2024-05-25 02:11:01,143: INFO/ForkPoolWorker-15] [e7463ab8-711d-40ac-86bd-aaaf6a36fcd6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:11:01.146044325Z [2024-05-25 02:11:01,145: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eee64c7a-1c1d-47eb-b1e4-baa6e9a3bc6e] received 2024-05-25T02:11:01.150280033Z [2024-05-25 02:11:01,149: INFO/ForkPoolWorker-16] [2ae02df7-8d76-47de-b254-4d1f0973b389] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:11:01.167739713Z [2024-05-25 02:11:01,167: INFO/ForkPoolWorker-1] [eee64c7a-1c1d-47eb-b1e4-baa6e9a3bc6e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:11:01.498506529Z [2024-05-25 02:11:01,494: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:11:01.536674831Z [2024-05-25 02:11:01,532: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:11:01.544163827Z [2024-05-25 02:11:01,540: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:11:01.698940627Z [2024-05-25 02:11:01,698: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T02:11:01.704084695Z [2024-05-25 02:11:01,703: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:11:01.738248590Z [2024-05-25 02:11:01,738: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:11:01.739457914Z [2024-05-25 02:11:01,739: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:11:01.739630487Z [2024-05-25 02:11:01,739: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:11:01.739699221Z [2024-05-25 02:11:01,739: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T02:11:01.739964302Z [2024-05-25 02:11:01,739: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:11:01.857394979Z [2024-05-25 02:11:01,857: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:11:02.650339278Z [2024-05-25 02:11:02,649: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eee64c7a-1c1d-47eb-b1e4-baa6e9a3bc6e] succeeded in 1.500217184999201s: None 2024-05-25T02:11:02.779566812Z [2024-05-25 02:11:02,779: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:11:02.782635864Z [2024-05-25 02:11:02,782: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:11:02.812261871Z [2024-05-25 02:11:02,811: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:11:02.813872272Z [2024-05-25 02:11:02,813: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:11:02.813900418Z [2024-05-25 02:11:02,813: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:11:02.814061876Z [2024-05-25 02:11:02,813: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:11:02.814151844Z [2024-05-25 02:11:02,814: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:11:02.814375817Z [2024-05-25 02:11:02,814: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:11:02.814400681Z [2024-05-25 02:11:02,814: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:11:02.822080782Z [2024-05-25 02:11:02,821: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:11:02.827341152Z [2024-05-25 02:11:02,826: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:11:02.851114496Z [2024-05-25 02:11:02,850: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:11:02.852457594Z [2024-05-25 02:11:02,852: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:11:02.852536888Z [2024-05-25 02:11:02,852: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:11:02.852665291Z [2024-05-25 02:11:02,852: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:11:02.852738784Z [2024-05-25 02:11:02,852: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:11:02.852996642Z [2024-05-25 02:11:02,852: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:11:02.853065451Z [2024-05-25 02:11:02,852: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:11:02.890822005Z [2024-05-25 02:11:02,890: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:11:02.950536962Z [2024-05-25 02:11:02,950: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:11:04.809018878Z [2024-05-25 02:11:04,808: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2ae02df7-8d76-47de-b254-4d1f0973b389] succeeded in 3.6688783669997065s: None 2024-05-25T02:11:05.512686702Z [2024-05-25 02:11:05,512: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e7463ab8-711d-40ac-86bd-aaaf6a36fcd6] succeeded in 4.382521850999183s: None 2024-05-25T02:12:01.038683377Z [2024-05-25 02:12:01,038: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0323ca4-c54a-4c80-a3fc-daa161c6c607] received 2024-05-25T02:12:01.042318282Z [2024-05-25 02:12:01,042: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[618fb0e0-9139-4313-bf59-2ce55e880f01] received 2024-05-25T02:12:01.045121273Z [2024-05-25 02:12:01,044: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc9009b4-a354-41b3-bd97-719fe21a9f62] received 2024-05-25T02:12:01.053686732Z [2024-05-25 02:12:01,053: INFO/ForkPoolWorker-15] [a0323ca4-c54a-4c80-a3fc-daa161c6c607] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:12:01.054406653Z [2024-05-25 02:12:01,054: INFO/ForkPoolWorker-1] [fc9009b4-a354-41b3-bd97-719fe21a9f62] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:12:01.054716656Z [2024-05-25 02:12:01,054: INFO/ForkPoolWorker-16] [618fb0e0-9139-4313-bf59-2ce55e880f01] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:12:01.063215527Z [2024-05-25 02:12:01,062: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1948b9d2-f71c-43ec-a62f-75e50193fa07] received 2024-05-25T02:12:01.090237459Z [2024-05-25 02:12:01,089: INFO/ForkPoolWorker-2] [1948b9d2-f71c-43ec-a62f-75e50193fa07] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:12:01.428254503Z [2024-05-25 02:12:01,425: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:12:01.630672942Z [2024-05-25 02:12:01,627: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:12:01.672629286Z [2024-05-25 02:12:01,669: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:12:01.755703032Z [2024-05-25 02:12:01,752: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:12:01.804068430Z [2024-05-25 02:12:01,803: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T02:12:01.808120506Z [2024-05-25 02:12:01,807: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:12:01.863059651Z [2024-05-25 02:12:01,862: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:12:01.865027699Z [2024-05-25 02:12:01,864: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:12:01.865623931Z [2024-05-25 02:12:01,864: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:12:01.865778721Z [2024-05-25 02:12:01,865: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T02:12:01.866063254Z [2024-05-25 02:12:01,865: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:12:01.994042286Z [2024-05-25 02:12:01,993: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:12:02.082930339Z [2024-05-25 02:12:02,082: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:12:02.814459568Z [2024-05-25 02:12:02,813: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a0323ca4-c54a-4c80-a3fc-daa161c6c607] succeeded in 1.7719360989995039s: None 2024-05-25T02:12:02.827319816Z [2024-05-25 02:12:02,826: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fc9009b4-a354-41b3-bd97-719fe21a9f62] succeeded in 1.7795850099992094s: None 2024-05-25T02:12:03.023214243Z [2024-05-25 02:12:03,022: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T02:12:03.027081331Z [2024-05-25 02:12:03,026: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:12:03.082785163Z [2024-05-25 02:12:03,082: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:12:03.087246395Z [2024-05-25 02:12:03,086: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:12:03.087363190Z [2024-05-25 02:12:03,087: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:12:03.087672064Z [2024-05-25 02:12:03,087: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:12:03.087907965Z [2024-05-25 02:12:03,087: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T02:12:03.088739435Z [2024-05-25 02:12:03,088: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:12:03.088854991Z [2024-05-25 02:12:03,088: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:12:03.143897306Z [2024-05-25 02:12:03,143: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:12:03.148920817Z [2024-05-25 02:12:03,148: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:12:03.163779432Z [2024-05-25 02:12:03,163: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:12:03.169168702Z [2024-05-25 02:12:03,168: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:12:03.170526539Z [2024-05-25 02:12:03,170: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:12:03.170542840Z [2024-05-25 02:12:03,170: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:12:03.170649301Z [2024-05-25 02:12:03,170: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:12:03.170665563Z [2024-05-25 02:12:03,170: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:12:03.171421050Z [2024-05-25 02:12:03,170: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:12:03.171437476Z [2024-05-25 02:12:03,171: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:12:03.263316867Z [2024-05-25 02:12:03,262: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:12:04.899919767Z [2024-05-25 02:12:04,899: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[618fb0e0-9139-4313-bf59-2ce55e880f01] succeeded in 3.855447390000336s: None 2024-05-25T02:12:05.282005837Z [2024-05-25 02:12:05,281: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1948b9d2-f71c-43ec-a62f-75e50193fa07] succeeded in 4.2117251150011725s: None 2024-05-25T02:13:00.377091797Z [2024-05-25 02:13:00,376: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[272d3f57-e54e-4c60-82a3-82f0a7f52db0] received 2024-05-25T02:13:00.382528934Z [2024-05-25 02:13:00,382: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3dc0d8f6-dfdf-4a45-8795-813bd249a417] received 2024-05-25T02:13:00.385240909Z [2024-05-25 02:13:00,384: INFO/ForkPoolWorker-15] [272d3f57-e54e-4c60-82a3-82f0a7f52db0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:13:00.391048236Z [2024-05-25 02:13:00,390: INFO/ForkPoolWorker-16] [3dc0d8f6-dfdf-4a45-8795-813bd249a417] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:13:00.398449444Z [2024-05-25 02:13:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9145723-6c58-4569-ac6b-df2df9d00fe0] received 2024-05-25T02:13:00.408799639Z [2024-05-25 02:13:00,408: INFO/ForkPoolWorker-1] [f9145723-6c58-4569-ac6b-df2df9d00fe0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:13:00.702571878Z [2024-05-25 02:13:00,698: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:13:00.707384689Z [2024-05-25 02:13:00,704: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:13:00.713373500Z [2024-05-25 02:13:00,710: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:13:00.854075101Z [2024-05-25 02:13:00,853: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T02:13:00.857895848Z [2024-05-25 02:13:00,857: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:13:00.880952600Z [2024-05-25 02:13:00,880: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:13:00.882183446Z [2024-05-25 02:13:00,881: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:13:00.882392620Z [2024-05-25 02:13:00,882: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:13:00.882493303Z [2024-05-25 02:13:00,882: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T02:13:00.882715205Z [2024-05-25 02:13:00,882: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:13:00.992288044Z [2024-05-25 02:13:00,991: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:13:01.520327095Z [2024-05-25 02:13:01,519: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3dc0d8f6-dfdf-4a45-8795-813bd249a417] succeeded in 1.136161741000251s: None 2024-05-25T02:13:01.930720876Z [2024-05-25 02:13:01,930: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:13:01.934099075Z [2024-05-25 02:13:01,933: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:13:01.948812757Z [2024-05-25 02:13:01,948: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:13:01.952534806Z [2024-05-25 02:13:01,952: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:13:01.958156364Z [2024-05-25 02:13:01,957: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:13:01.959873774Z [2024-05-25 02:13:01,959: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:13:01.960080252Z [2024-05-25 02:13:01,959: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:13:01.960320142Z [2024-05-25 02:13:01,960: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:13:01.960473848Z [2024-05-25 02:13:01,960: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:13:01.960848483Z [2024-05-25 02:13:01,960: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:13:01.960994340Z [2024-05-25 02:13:01,960: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:13:01.982778160Z [2024-05-25 02:13:01,982: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:13:01.985528768Z [2024-05-25 02:13:01,985: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:13:01.985724677Z [2024-05-25 02:13:01,985: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:13:01.986777482Z [2024-05-25 02:13:01,986: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:13:01.986955869Z [2024-05-25 02:13:01,986: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:13:01.987602093Z [2024-05-25 02:13:01,987: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:13:01.987769231Z [2024-05-25 02:13:01,987: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:13:02.043291556Z [2024-05-25 02:13:02,042: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:13:02.072943674Z [2024-05-25 02:13:02,072: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:13:03.607494710Z [2024-05-25 02:13:03,606: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f9145723-6c58-4569-ac6b-df2df9d00fe0] succeeded in 3.205645658001231s: None 2024-05-25T02:13:03.995952520Z [2024-05-25 02:13:03,994: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[272d3f57-e54e-4c60-82a3-82f0a7f52db0] succeeded in 3.6163897450005607s: None 2024-05-25T02:14:00.990263163Z [2024-05-25 02:14:00,989: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6817787d-28df-4eac-afc4-94632ae28a9a] received 2024-05-25T02:14:00.994595667Z [2024-05-25 02:14:00,994: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f070e9e-be46-443f-9e6b-d11f792bafba] received 2024-05-25T02:14:01.015157770Z [2024-05-25 02:14:01,014: INFO/ForkPoolWorker-15] [6817787d-28df-4eac-afc4-94632ae28a9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:14:01.016208216Z [2024-05-25 02:14:01,015: INFO/ForkPoolWorker-16] [5f070e9e-be46-443f-9e6b-d11f792bafba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:14:01.018275505Z [2024-05-25 02:14:01,017: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22bdb7bb-e57b-446c-9994-fb8dfc566974] received 2024-05-25T02:14:01.020872365Z [2024-05-25 02:14:01,020: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe9c7dd9-5bd0-428f-81c9-508b3c71336e] received 2024-05-25T02:14:01.038094255Z [2024-05-25 02:14:01,037: INFO/ForkPoolWorker-1] [22bdb7bb-e57b-446c-9994-fb8dfc566974] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:14:01.039237163Z [2024-05-25 02:14:01,038: INFO/ForkPoolWorker-2] [fe9c7dd9-5bd0-428f-81c9-508b3c71336e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:14:01.437327128Z [2024-05-25 02:14:01,404: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:14:01.445381278Z [2024-05-25 02:14:01,437: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:14:01.452329586Z [2024-05-25 02:14:01,444: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:14:01.457312634Z [2024-05-25 02:14:01,449: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:14:01.633581118Z [2024-05-25 02:14:01,633: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T02:14:01.638041801Z [2024-05-25 02:14:01,637: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:14:01.687052742Z [2024-05-25 02:14:01,686: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:14:01.697779206Z [2024-05-25 02:14:01,697: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:14:01.701612041Z [2024-05-25 02:14:01,697: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:14:01.701696760Z [2024-05-25 02:14:01,701: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T02:14:01.701950139Z [2024-05-25 02:14:01,701: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:14:01.740008945Z [2024-05-25 02:14:01,739: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:14:01.864812585Z [2024-05-25 02:14:01,864: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:14:02.503171506Z [2024-05-25 02:14:02,502: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6817787d-28df-4eac-afc4-94632ae28a9a] succeeded in 1.506527632000143s: None 2024-05-25T02:14:02.791227334Z [2024-05-25 02:14:02,790: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fe9c7dd9-5bd0-428f-81c9-508b3c71336e] succeeded in 1.7669330530006846s: None 2024-05-25T02:14:03.038921249Z [2024-05-25 02:14:03,038: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:14:03.042165132Z [2024-05-25 02:14:03,041: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:14:03.063937663Z [2024-05-25 02:14:03,063: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:14:03.065480089Z [2024-05-25 02:14:03,065: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:14:03.065517078Z [2024-05-25 02:14:03,065: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:14:03.065719591Z [2024-05-25 02:14:03,065: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:14:03.065870850Z [2024-05-25 02:14:03,065: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:14:03.066334750Z [2024-05-25 02:14:03,066: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:14:03.066399560Z [2024-05-25 02:14:03,066: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:14:03.174616902Z [2024-05-25 02:14:03,174: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:14:03.218350247Z [2024-05-25 02:14:03,217: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:14:03.221759226Z [2024-05-25 02:14:03,221: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:14:03.247117413Z [2024-05-25 02:14:03,246: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:14:03.249846912Z [2024-05-25 02:14:03,248: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:14:03.249874407Z [2024-05-25 02:14:03,248: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:14:03.249879019Z [2024-05-25 02:14:03,248: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:14:03.249883561Z [2024-05-25 02:14:03,248: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:14:03.249887717Z [2024-05-25 02:14:03,248: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:14:03.249891180Z [2024-05-25 02:14:03,248: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:14:03.361536353Z [2024-05-25 02:14:03,361: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:14:05.057001596Z [2024-05-25 02:14:05,056: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[22bdb7bb-e57b-446c-9994-fb8dfc566974] succeeded in 4.033371135999914s: None 2024-05-25T02:14:05.255217141Z [2024-05-25 02:14:05,254: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5f070e9e-be46-443f-9e6b-d11f792bafba] succeeded in 4.255055834999439s: None 2024-05-25T02:15:00.907522263Z [2024-05-25 02:15:00,907: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc6bebf9-423f-40a2-b3c2-7a512ee7a49f] received 2024-05-25T02:15:00.916021197Z [2024-05-25 02:15:00,915: INFO/ForkPoolWorker-15] [bc6bebf9-423f-40a2-b3c2-7a512ee7a49f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:15:00.918065069Z [2024-05-25 02:15:00,917: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9ef091d-8cfd-451e-a81e-bb3ab6128df5] received 2024-05-25T02:15:00.927312299Z [2024-05-25 02:15:00,927: INFO/ForkPoolWorker-16] [f9ef091d-8cfd-451e-a81e-bb3ab6128df5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:15:00.931424713Z [2024-05-25 02:15:00,926: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab4b26b1-aefc-42fa-a623-f5dd0c69bc7c] received 2024-05-25T02:15:00.933241392Z [2024-05-25 02:15:00,933: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42055790-8d56-40c2-9acd-96509c60ddac] received 2024-05-25T02:15:00.938470683Z [2024-05-25 02:15:00,938: INFO/ForkPoolWorker-1] [ab4b26b1-aefc-42fa-a623-f5dd0c69bc7c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:15:00.945355382Z [2024-05-25 02:15:00,945: INFO/ForkPoolWorker-2] [42055790-8d56-40c2-9acd-96509c60ddac] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:15:01.220278798Z [2024-05-25 02:15:01,215: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:15:01.254329139Z [2024-05-25 02:15:01,250: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:15:01.268279299Z [2024-05-25 02:15:01,264: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:15:01.292206513Z [2024-05-25 02:15:01,287: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:15:01.526947466Z [2024-05-25 02:15:01,526: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T02:15:01.530887843Z [2024-05-25 02:15:01,530: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:15:01.571522027Z [2024-05-25 02:15:01,571: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:15:01.574224458Z [2024-05-25 02:15:01,574: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:15:01.574428544Z [2024-05-25 02:15:01,574: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:15:01.574509698Z [2024-05-25 02:15:01,574: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T02:15:01.574720720Z [2024-05-25 02:15:01,574: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:15:01.671630189Z [2024-05-25 02:15:01,671: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:15:02.366783683Z [2024-05-25 02:15:02,366: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[42055790-8d56-40c2-9acd-96509c60ddac] succeeded in 1.4282574379994912s: None 2024-05-25T02:15:02.601912774Z [2024-05-25 02:15:02,601: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:15:02.605224090Z [2024-05-25 02:15:02,604: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:15:02.631033855Z [2024-05-25 02:15:02,630: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:15:02.632571469Z [2024-05-25 02:15:02,632: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:15:02.632787914Z [2024-05-25 02:15:02,632: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:15:02.633013427Z [2024-05-25 02:15:02,632: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:15:02.633152875Z [2024-05-25 02:15:02,633: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:15:02.633530207Z [2024-05-25 02:15:02,633: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:15:02.634013597Z [2024-05-25 02:15:02,633: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:15:02.709634529Z [2024-05-25 02:15:02,709: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:15:02.716580191Z [2024-05-25 02:15:02,716: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:15:02.720215363Z [2024-05-25 02:15:02,719: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:15:02.765338775Z [2024-05-25 02:15:02,765: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:15:02.766825320Z [2024-05-25 02:15:02,766: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:15:02.766842976Z [2024-05-25 02:15:02,766: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:15:02.766951994Z [2024-05-25 02:15:02,766: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:15:02.766978804Z [2024-05-25 02:15:02,766: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:15:02.767298300Z [2024-05-25 02:15:02,767: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:15:02.767307459Z [2024-05-25 02:15:02,767: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:15:02.855292970Z [2024-05-25 02:15:02,855: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:15:02.900678880Z [2024-05-25 02:15:02,900: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:15:02.904046535Z [2024-05-25 02:15:02,903: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:15:02.926670704Z [2024-05-25 02:15:02,926: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:15:02.927993684Z [2024-05-25 02:15:02,927: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:15:02.928102486Z [2024-05-25 02:15:02,927: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:15:02.928294159Z [2024-05-25 02:15:02,928: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:15:02.928406068Z [2024-05-25 02:15:02,928: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:15:02.928689212Z [2024-05-25 02:15:02,928: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:15:02.928810929Z [2024-05-25 02:15:02,928: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:15:03.023381375Z [2024-05-25 02:15:03,023: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:15:03.633290695Z [2024-05-25 02:15:03,630: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bc6bebf9-423f-40a2-b3c2-7a512ee7a49f] succeeded in 2.722104849999596s: None 2024-05-25T02:15:03.919021839Z [2024-05-25 02:15:03,918: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c8105d9-f34c-4c50-a1ad-1e23ed1c114d] received 2024-05-25T02:15:03.927359523Z [2024-05-25 02:15:03,927: INFO/ForkPoolWorker-15] [0c8105d9-f34c-4c50-a1ad-1e23ed1c114d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:15:04.237055963Z [2024-05-25 02:15:04,225: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:15:04.422238636Z [2024-05-25 02:15:04,421: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ab4b26b1-aefc-42fa-a623-f5dd0c69bc7c] succeeded in 3.489045056001487s: None 2024-05-25T02:15:04.749028822Z [2024-05-25 02:15:04,748: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f9ef091d-8cfd-451e-a81e-bb3ab6128df5] succeeded in 3.828959862999909s: None 2024-05-25T02:15:05.356296883Z [2024-05-25 02:15:05,355: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:15:05.359646304Z [2024-05-25 02:15:05,359: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:15:05.377795624Z [2024-05-25 02:15:05,377: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:15:05.379056774Z [2024-05-25 02:15:05,378: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:15:05.379181307Z [2024-05-25 02:15:05,379: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:15:05.379384825Z [2024-05-25 02:15:05,379: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:15:05.379465755Z [2024-05-25 02:15:05,379: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:15:05.379752759Z [2024-05-25 02:15:05,379: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:15:05.380243277Z [2024-05-25 02:15:05,380: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:15:05.474662610Z [2024-05-25 02:15:05,474: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:15:06.150077866Z [2024-05-25 02:15:06,149: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0c8105d9-f34c-4c50-a1ad-1e23ed1c114d] succeeded in 2.2290777969992632s: None 2024-05-25T02:15:06.618945370Z [2024-05-25 02:15:06,618: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c58491c9-c774-4f8e-a4c1-d1ebaca60207] received 2024-05-25T02:15:06.628033064Z [2024-05-25 02:15:06,627: INFO/ForkPoolWorker-15] [c58491c9-c774-4f8e-a4c1-d1ebaca60207] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T02:15:06.932438752Z [2024-05-25 02:15:06,929: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:15:08.283354070Z [2024-05-25 02:15:08,282: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:15:08.286874741Z [2024-05-25 02:15:08,286: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:15:08.311122959Z [2024-05-25 02:15:08,310: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:15:08.313074005Z [2024-05-25 02:15:08,312: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:15:08.313099867Z [2024-05-25 02:15:08,312: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:15:08.313567319Z [2024-05-25 02:15:08,313: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:15:08.313659724Z [2024-05-25 02:15:08,313: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:15:08.314046199Z [2024-05-25 02:15:08,313: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:15:08.314177669Z [2024-05-25 02:15:08,313: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:15:08.421907864Z [2024-05-25 02:15:08,421: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:15:09.023686020Z [2024-05-25 02:15:09,023: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3775e8c6-ecf7-40ac-bac2-8c7b09c2074a] received 2024-05-25T02:15:09.034549345Z [2024-05-25 02:15:09,034: INFO/ForkPoolWorker-16] [3775e8c6-ecf7-40ac-bac2-8c7b09c2074a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:15:09.099478713Z [2024-05-25 02:15:09,098: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c58491c9-c774-4f8e-a4c1-d1ebaca60207] succeeded in 2.4785965270002634s: None 2024-05-25T02:15:09.321271726Z [2024-05-25 02:15:09,316: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:15:10.369085055Z [2024-05-25 02:15:10,368: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:15:10.372274320Z [2024-05-25 02:15:10,371: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:15:10.405336774Z [2024-05-25 02:15:10,404: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:15:10.408084118Z [2024-05-25 02:15:10,407: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:15:10.408432988Z [2024-05-25 02:15:10,408: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:15:10.408889347Z [2024-05-25 02:15:10,408: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:15:10.409250843Z [2024-05-25 02:15:10,408: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:15:10.410211117Z [2024-05-25 02:15:10,409: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:15:10.410581940Z [2024-05-25 02:15:10,410: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:15:10.550050804Z [2024-05-25 02:15:10,549: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:15:11.244194142Z [2024-05-25 02:15:11,243: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3775e8c6-ecf7-40ac-bac2-8c7b09c2074a] succeeded in 2.2176571910003986s: None 2024-05-25T02:16:00.871523498Z [2024-05-25 02:16:00,870: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6bbc7d3-dbb6-45e9-8849-7d561fa7d836] received 2024-05-25T02:16:00.875076205Z [2024-05-25 02:16:00,874: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c1887ea-994e-4c8d-9cbc-a2bc33355282] received 2024-05-25T02:16:00.880928440Z [2024-05-25 02:16:00,880: INFO/ForkPoolWorker-15] [c6bbc7d3-dbb6-45e9-8849-7d561fa7d836] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:16:00.889682157Z [2024-05-25 02:16:00,889: INFO/ForkPoolWorker-16] [6c1887ea-994e-4c8d-9cbc-a2bc33355282] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:16:00.907090398Z [2024-05-25 02:16:00,906: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67fb1598-1202-4cdd-9b50-8cfa3b1e6cfd] received 2024-05-25T02:16:00.926042917Z [2024-05-25 02:16:00,925: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9518afa8-9423-4401-9b89-67fb582afc9b] received 2024-05-25T02:16:00.943098416Z [2024-05-25 02:16:00,940: INFO/ForkPoolWorker-1] [67fb1598-1202-4cdd-9b50-8cfa3b1e6cfd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:16:00.951311436Z [2024-05-25 02:16:00,950: INFO/ForkPoolWorker-2] [9518afa8-9423-4401-9b89-67fb582afc9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:16:01.300194215Z [2024-05-25 02:16:01,294: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:16:01.358623584Z [2024-05-25 02:16:01,355: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:16:01.381337401Z [2024-05-25 02:16:01,371: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:16:01.638885205Z [2024-05-25 02:16:01,634: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:16:01.822869516Z [2024-05-25 02:16:01,821: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T02:16:01.826885644Z [2024-05-25 02:16:01,826: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:16:01.853919134Z [2024-05-25 02:16:01,853: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:16:01.855401083Z [2024-05-25 02:16:01,855: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:16:01.855476211Z [2024-05-25 02:16:01,855: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:16:01.855518853Z [2024-05-25 02:16:01,855: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T02:16:01.855707003Z [2024-05-25 02:16:01,855: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:16:01.971152262Z [2024-05-25 02:16:01,970: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:16:02.008276386Z [2024-05-25 02:16:02,007: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:16:02.949846358Z [2024-05-25 02:16:02,949: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:16:02.953158719Z [2024-05-25 02:16:02,952: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:16:02.953365415Z [2024-05-25 02:16:02,952: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c6bbc7d3-dbb6-45e9-8849-7d561fa7d836] succeeded in 2.078753133999271s: None 2024-05-25T02:16:02.976887386Z [2024-05-25 02:16:02,976: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9518afa8-9423-4401-9b89-67fb582afc9b] succeeded in 2.0440769079996244s: None 2024-05-25T02:16:02.979817002Z [2024-05-25 02:16:02,979: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:16:02.981304450Z [2024-05-25 02:16:02,981: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:16:02.981458654Z [2024-05-25 02:16:02,981: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:16:02.981702289Z [2024-05-25 02:16:02,981: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:16:02.981904699Z [2024-05-25 02:16:02,981: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:16:02.982369633Z [2024-05-25 02:16:02,982: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:16:02.982551145Z [2024-05-25 02:16:02,982: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:16:03.073920337Z [2024-05-25 02:16:03,073: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:16:03.194720733Z [2024-05-25 02:16:03,194: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:16:03.198445149Z [2024-05-25 02:16:03,197: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:16:03.223412535Z [2024-05-25 02:16:03,223: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:16:03.224806251Z [2024-05-25 02:16:03,224: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:16:03.224822886Z [2024-05-25 02:16:03,224: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:16:03.225021707Z [2024-05-25 02:16:03,224: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:16:03.225095296Z [2024-05-25 02:16:03,224: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:16:03.225704246Z [2024-05-25 02:16:03,225: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:16:03.225761061Z [2024-05-25 02:16:03,225: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:16:03.302542088Z [2024-05-25 02:16:03,302: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:16:06.030929229Z [2024-05-25 02:16:06,030: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[67fb1598-1202-4cdd-9b50-8cfa3b1e6cfd] succeeded in 5.1140870500003075s: None 2024-05-25T02:16:06.165871852Z [2024-05-25 02:16:06,165: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6c1887ea-994e-4c8d-9cbc-a2bc33355282] succeeded in 5.288095366000562s: None 2024-05-25T02:17:00.384110488Z [2024-05-25 02:17:00,383: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad5bf752-4192-471e-9c9f-c0ad600f70c8] received 2024-05-25T02:17:00.385921422Z [2024-05-25 02:17:00,385: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a415ab3-09f1-4b06-b074-b0ef1d226e26] received 2024-05-25T02:17:00.388050561Z [2024-05-25 02:17:00,387: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a636e889-bc37-4f81-99d1-14e15defef60] received 2024-05-25T02:17:00.395574444Z [2024-05-25 02:17:00,395: INFO/ForkPoolWorker-1] [a636e889-bc37-4f81-99d1-14e15defef60] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:17:00.417053753Z [2024-05-25 02:17:00,416: INFO/ForkPoolWorker-16] [4a415ab3-09f1-4b06-b074-b0ef1d226e26] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:17:00.419271818Z [2024-05-25 02:17:00,418: INFO/ForkPoolWorker-15] [ad5bf752-4192-471e-9c9f-c0ad600f70c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:17:00.703986125Z [2024-05-25 02:17:00,700: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:17:00.706229662Z [2024-05-25 02:17:00,702: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:17:00.737093770Z [2024-05-25 02:17:00,734: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:17:00.893512064Z [2024-05-25 02:17:00,893: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T02:17:00.898288287Z [2024-05-25 02:17:00,897: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:17:00.923716825Z [2024-05-25 02:17:00,923: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:17:00.924609282Z [2024-05-25 02:17:00,924: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:17:00.924743008Z [2024-05-25 02:17:00,924: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:17:00.924817741Z [2024-05-25 02:17:00,924: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T02:17:00.925068431Z [2024-05-25 02:17:00,924: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:17:01.025122887Z [2024-05-25 02:17:01,024: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:17:01.720564722Z [2024-05-25 02:17:01,720: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a636e889-bc37-4f81-99d1-14e15defef60] succeeded in 1.331137397999555s: None 2024-05-25T02:17:01.925539351Z [2024-05-25 02:17:01,925: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:17:01.928961287Z [2024-05-25 02:17:01,928: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:17:01.951703512Z [2024-05-25 02:17:01,951: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:17:01.953266066Z [2024-05-25 02:17:01,952: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:17:01.953451033Z [2024-05-25 02:17:01,953: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:17:01.953709816Z [2024-05-25 02:17:01,953: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:17:01.953753636Z [2024-05-25 02:17:01,953: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:17:01.954180837Z [2024-05-25 02:17:01,953: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:17:01.954331539Z [2024-05-25 02:17:01,954: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:17:02.044906663Z [2024-05-25 02:17:02,044: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:17:02.048079676Z [2024-05-25 02:17:02,047: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:17:02.068166523Z [2024-05-25 02:17:02,067: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:17:02.069456741Z [2024-05-25 02:17:02,069: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:17:02.069523147Z [2024-05-25 02:17:02,069: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:17:02.069661073Z [2024-05-25 02:17:02,069: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:17:02.069722193Z [2024-05-25 02:17:02,069: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:17:02.070053685Z [2024-05-25 02:17:02,069: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:17:02.070106183Z [2024-05-25 02:17:02,070: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:17:02.079202014Z [2024-05-25 02:17:02,078: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:17:02.153563304Z [2024-05-25 02:17:02,153: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:17:03.680438678Z [2024-05-25 02:17:03,679: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4a415ab3-09f1-4b06-b074-b0ef1d226e26] succeeded in 3.289772683998308s: None 2024-05-25T02:17:04.214806853Z [2024-05-25 02:17:04,214: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ad5bf752-4192-471e-9c9f-c0ad600f70c8] succeeded in 3.827645876999668s: None 2024-05-25T02:18:00.616453421Z [2024-05-25 02:18:00,616: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9c5d95a-a952-40b4-bc3d-e950864d3090] received 2024-05-25T02:18:00.618244011Z [2024-05-25 02:18:00,618: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[feabf2cd-cb4e-4c7b-b996-35d10c612b2d] received 2024-05-25T02:18:00.624698060Z [2024-05-25 02:18:00,624: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d078bc3e-1afa-4663-95f6-9ced6305195e] received 2024-05-25T02:18:00.625337110Z [2024-05-25 02:18:00,625: INFO/ForkPoolWorker-15] [b9c5d95a-a952-40b4-bc3d-e950864d3090] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:18:00.631338826Z [2024-05-25 02:18:00,631: INFO/ForkPoolWorker-16] [feabf2cd-cb4e-4c7b-b996-35d10c612b2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:18:00.640926165Z [2024-05-25 02:18:00,640: INFO/ForkPoolWorker-1] [d078bc3e-1afa-4663-95f6-9ced6305195e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:18:00.645653753Z [2024-05-25 02:18:00,645: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4b6c42d-16b5-4eed-9037-ae87ce8c0332] received 2024-05-25T02:18:00.653074268Z [2024-05-25 02:18:00,652: INFO/ForkPoolWorker-2] [e4b6c42d-16b5-4eed-9037-ae87ce8c0332] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:18:00.938515381Z [2024-05-25 02:18:00,935: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:18:00.994915883Z [2024-05-25 02:18:00,991: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:18:01.104033144Z [2024-05-25 02:18:01,099: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:18:01.159057421Z [2024-05-25 02:18:01,156: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:18:01.185074634Z [2024-05-25 02:18:01,184: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T02:18:01.189383190Z [2024-05-25 02:18:01,188: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:18:01.221939426Z [2024-05-25 02:18:01,221: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:18:01.223308411Z [2024-05-25 02:18:01,223: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:18:01.223533917Z [2024-05-25 02:18:01,223: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:18:01.223703208Z [2024-05-25 02:18:01,223: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T02:18:01.224029060Z [2024-05-25 02:18:01,223: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:18:01.257251495Z [2024-05-25 02:18:01,256: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:18:01.362416535Z [2024-05-25 02:18:01,357: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:18:01.908043823Z [2024-05-25 02:18:01,907: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b9c5d95a-a952-40b4-bc3d-e950864d3090] succeeded in 1.2875608100002864s: None 2024-05-25T02:18:02.041612715Z [2024-05-25 02:18:02,041: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e4b6c42d-16b5-4eed-9037-ae87ce8c0332] succeeded in 1.3941233589994226s: None 2024-05-25T02:18:02.524778068Z [2024-05-25 02:18:02,523: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:18:02.533348054Z [2024-05-25 02:18:02,531: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:18:02.561833621Z [2024-05-25 02:18:02,561: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:18:02.566891234Z [2024-05-25 02:18:02,566: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:18:02.574218800Z [2024-05-25 02:18:02,573: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:18:02.576258748Z [2024-05-25 02:18:02,576: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:18:02.576409627Z [2024-05-25 02:18:02,576: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:18:02.576645303Z [2024-05-25 02:18:02,576: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:18:02.576676676Z [2024-05-25 02:18:02,576: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:18:02.578651366Z [2024-05-25 02:18:02,578: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:18:02.578874378Z [2024-05-25 02:18:02,578: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:18:02.593160079Z [2024-05-25 02:18:02,592: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:18:02.594596535Z [2024-05-25 02:18:02,594: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:18:02.594612454Z [2024-05-25 02:18:02,594: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:18:02.594681299Z [2024-05-25 02:18:02,594: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:18:02.594748472Z [2024-05-25 02:18:02,594: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:18:02.595056216Z [2024-05-25 02:18:02,594: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:18:02.595125231Z [2024-05-25 02:18:02,595: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:18:02.676913619Z [2024-05-25 02:18:02,676: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:18:02.725187063Z [2024-05-25 02:18:02,724: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:18:04.864431377Z [2024-05-25 02:18:04,863: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d078bc3e-1afa-4663-95f6-9ced6305195e] succeeded in 4.236912982998547s: None 2024-05-25T02:18:05.354674814Z [2024-05-25 02:18:05,353: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[feabf2cd-cb4e-4c7b-b996-35d10c612b2d] succeeded in 4.730893329999162s: None 2024-05-25T02:19:00.871823732Z [2024-05-25 02:19:00,871: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e297f9bd-58e6-4cd7-b115-272618e6f085] received 2024-05-25T02:19:00.878976453Z [2024-05-25 02:19:00,878: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[610aa79f-70c0-4e8c-9980-f5b6311710f6] received 2024-05-25T02:19:00.886822950Z [2024-05-25 02:19:00,886: INFO/ForkPoolWorker-15] [e297f9bd-58e6-4cd7-b115-272618e6f085] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:19:00.891749584Z [2024-05-25 02:19:00,891: INFO/ForkPoolWorker-16] [610aa79f-70c0-4e8c-9980-f5b6311710f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:19:00.893839600Z [2024-05-25 02:19:00,893: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa5055a8-f8db-423a-bc8b-6749ea1361f9] received 2024-05-25T02:19:00.908844643Z [2024-05-25 02:19:00,908: INFO/ForkPoolWorker-1] [aa5055a8-f8db-423a-bc8b-6749ea1361f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:19:01.224912450Z [2024-05-25 02:19:01,221: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:19:01.263004433Z [2024-05-25 02:19:01,259: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:19:01.266168104Z [2024-05-25 02:19:01,262: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:19:01.508661659Z [2024-05-25 02:19:01,508: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T02:19:01.512891177Z [2024-05-25 02:19:01,512: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:19:01.566253905Z [2024-05-25 02:19:01,566: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:19:01.570048336Z [2024-05-25 02:19:01,569: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:19:01.570241545Z [2024-05-25 02:19:01,569: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:19:01.570356730Z [2024-05-25 02:19:01,570: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T02:19:01.570708178Z [2024-05-25 02:19:01,570: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:19:01.662464932Z [2024-05-25 02:19:01,662: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:19:02.428136822Z [2024-05-25 02:19:02,427: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aa5055a8-f8db-423a-bc8b-6749ea1361f9] succeeded in 1.5321050110014767s: None 2024-05-25T02:19:02.712284329Z [2024-05-25 02:19:02,711: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:19:02.716172328Z [2024-05-25 02:19:02,715: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:19:02.741764319Z [2024-05-25 02:19:02,741: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:19:02.743105068Z [2024-05-25 02:19:02,742: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:19:02.743154400Z [2024-05-25 02:19:02,743: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:19:02.743312283Z [2024-05-25 02:19:02,743: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:19:02.743373910Z [2024-05-25 02:19:02,743: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:19:02.743846343Z [2024-05-25 02:19:02,743: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:19:02.743907165Z [2024-05-25 02:19:02,743: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:19:02.754528304Z [2024-05-25 02:19:02,752: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:19:02.758327659Z [2024-05-25 02:19:02,757: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:19:02.782187316Z [2024-05-25 02:19:02,781: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:19:02.783942760Z [2024-05-25 02:19:02,783: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:19:02.784131893Z [2024-05-25 02:19:02,783: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:19:02.784352532Z [2024-05-25 02:19:02,784: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:19:02.784470505Z [2024-05-25 02:19:02,784: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:19:02.785977750Z [2024-05-25 02:19:02,785: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:19:02.786312465Z [2024-05-25 02:19:02,786: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:19:02.830418732Z [2024-05-25 02:19:02,830: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:19:02.936828924Z [2024-05-25 02:19:02,936: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:19:04.778988235Z [2024-05-25 02:19:04,778: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e297f9bd-58e6-4cd7-b115-272618e6f085] succeeded in 3.9033190019999893s: None 2024-05-25T02:19:05.358541093Z [2024-05-25 02:19:05,358: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[610aa79f-70c0-4e8c-9980-f5b6311710f6] succeeded in 4.477528092998909s: None 2024-05-25T02:20:00.365136486Z [2024-05-25 02:20:00,364: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ba03f29-40a3-46b9-8b67-c3908cbb361e] received 2024-05-25T02:20:00.366931425Z [2024-05-25 02:20:00,366: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ffeebc4f-8250-49b8-98d6-033700718c43] received 2024-05-25T02:20:00.372370124Z [2024-05-25 02:20:00,372: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4f209e9-77fc-4797-9e2c-3efe36f77f58] received 2024-05-25T02:20:00.375652058Z [2024-05-25 02:20:00,375: INFO/ForkPoolWorker-16] [ffeebc4f-8250-49b8-98d6-033700718c43] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:20:00.376295216Z [2024-05-25 02:20:00,376: INFO/ForkPoolWorker-15] [9ba03f29-40a3-46b9-8b67-c3908cbb361e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:20:00.380334571Z [2024-05-25 02:20:00,380: INFO/ForkPoolWorker-1] [a4f209e9-77fc-4797-9e2c-3efe36f77f58] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:20:00.385624189Z [2024-05-25 02:20:00,385: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f32c48b-a334-4a22-997f-f6792f92340c] received 2024-05-25T02:20:00.400848871Z [2024-05-25 02:20:00,400: INFO/ForkPoolWorker-2] [0f32c48b-a334-4a22-997f-f6792f92340c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:20:00.414064939Z [2024-05-25 02:20:00,413: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7771176d-9f2a-4f86-a706-e658a2e714be] received 2024-05-25T02:20:00.434237130Z [2024-05-25 02:20:00,433: INFO/ForkPoolWorker-3] [7771176d-9f2a-4f86-a706-e658a2e714be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:20:00.738666655Z [2024-05-25 02:20:00,735: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:20:00.848983563Z [2024-05-25 02:20:00,844: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:20:00.855993447Z [2024-05-25 02:20:00,851: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:20:00.924420475Z [2024-05-25 02:20:00,920: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:20:01.012267206Z [2024-05-25 02:20:01,011: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T02:20:01.016515599Z [2024-05-25 02:20:01,016: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:20:01.078275438Z [2024-05-25 02:20:01,078: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:20:01.083993705Z [2024-05-25 02:20:01,083: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:20:01.085446543Z [2024-05-25 02:20:01,083: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:20:01.085598226Z [2024-05-25 02:20:01,085: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T02:20:01.087992819Z [2024-05-25 02:20:01,087: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:20:01.162730395Z [2024-05-25 02:20:01,154: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:20:01.236636720Z [2024-05-25 02:20:01,236: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:20:01.628128154Z [2024-05-25 02:20:01,627: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:20:02.155773957Z [2024-05-25 02:20:02,155: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ffeebc4f-8250-49b8-98d6-033700718c43] succeeded in 1.7856921140009945s: None 2024-05-25T02:20:02.292655540Z [2024-05-25 02:20:02,292: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a4f209e9-77fc-4797-9e2c-3efe36f77f58] succeeded in 1.9174468729997898s: None 2024-05-25T02:20:02.573715481Z [2024-05-25 02:20:02,573: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T02:20:02.576897428Z [2024-05-25 02:20:02,576: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:20:02.610269207Z [2024-05-25 02:20:02,609: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:20:02.612655402Z [2024-05-25 02:20:02,612: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:20:02.612751968Z [2024-05-25 02:20:02,612: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:20:02.612948761Z [2024-05-25 02:20:02,612: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:20:02.613030795Z [2024-05-25 02:20:02,612: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T02:20:02.614053939Z [2024-05-25 02:20:02,613: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:20:02.614126923Z [2024-05-25 02:20:02,614: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:20:02.709179293Z [2024-05-25 02:20:02,708: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:20:02.804241639Z [2024-05-25 02:20:02,803: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-25T02:20:02.807511699Z [2024-05-25 02:20:02,806: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:20:02.835159069Z [2024-05-25 02:20:02,834: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T02:20:02.836551186Z [2024-05-25 02:20:02,836: INFO/ForkPoolWorker-3] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:20:02.836604475Z [2024-05-25 02:20:02,836: INFO/ForkPoolWorker-3] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:20:02.836732345Z [2024-05-25 02:20:02,836: INFO/ForkPoolWorker-3] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:20:02.836780888Z [2024-05-25 02:20:02,836: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-25T02:20:02.837024660Z [2024-05-25 02:20:02,836: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:20:02.837068522Z [2024-05-25 02:20:02,836: INFO/ForkPoolWorker-3] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:20:02.933152748Z [2024-05-25 02:20:02,932: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:20:02.954823814Z [2024-05-25 02:20:02,954: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:20:02.958206395Z [2024-05-25 02:20:02,957: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:20:02.990221179Z [2024-05-25 02:20:02,989: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:20:02.995684269Z [2024-05-25 02:20:02,995: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:20:02.995703304Z [2024-05-25 02:20:02,995: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:20:02.995790591Z [2024-05-25 02:20:02,995: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:20:02.995822264Z [2024-05-25 02:20:02,995: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:20:02.996124235Z [2024-05-25 02:20:02,995: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:20:02.996136085Z [2024-05-25 02:20:02,996: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:20:03.125959582Z [2024-05-25 02:20:03,125: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:20:03.826159038Z [2024-05-25 02:20:03,825: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9ba03f29-40a3-46b9-8b67-c3908cbb361e] succeeded in 3.458734085999822s: None 2024-05-25T02:20:04.462549449Z [2024-05-25 02:20:04,462: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[7771176d-9f2a-4f86-a706-e658a2e714be] succeeded in 4.0435180759996s: None 2024-05-25T02:20:04.576693906Z [2024-05-25 02:20:04,576: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0f32c48b-a334-4a22-997f-f6792f92340c] succeeded in 4.18873342400002s: None 2024-05-25T02:20:04.700183853Z [2024-05-25 02:20:04,698: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2bac30a-9056-4007-9d00-9a06b024e3c7] received 2024-05-25T02:20:04.712888463Z [2024-05-25 02:20:04,711: INFO/ForkPoolWorker-15] [a2bac30a-9056-4007-9d00-9a06b024e3c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:20:04.991685677Z [2024-05-25 02:20:04,988: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:20:06.211221917Z [2024-05-25 02:20:06,210: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:20:06.214958800Z [2024-05-25 02:20:06,214: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:20:06.237745167Z [2024-05-25 02:20:06,237: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:20:06.239434872Z [2024-05-25 02:20:06,239: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:20:06.239735617Z [2024-05-25 02:20:06,239: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:20:06.240168553Z [2024-05-25 02:20:06,239: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:20:06.240350992Z [2024-05-25 02:20:06,240: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:20:06.240846794Z [2024-05-25 02:20:06,240: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:20:06.240989069Z [2024-05-25 02:20:06,240: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:20:06.324969012Z [2024-05-25 02:20:06,324: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:20:07.100974735Z [2024-05-25 02:20:07,100: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a2bac30a-9056-4007-9d00-9a06b024e3c7] succeeded in 2.4005466580001666s: None 2024-05-25T02:20:07.220955169Z [2024-05-25 02:20:07,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3f08fd2-6e0f-42ce-9748-93bfd7bddd82] received 2024-05-25T02:20:07.229441582Z [2024-05-25 02:20:07,229: INFO/ForkPoolWorker-15] [c3f08fd2-6e0f-42ce-9748-93bfd7bddd82] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T02:20:07.579049357Z [2024-05-25 02:20:07,575: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:20:08.932198012Z [2024-05-25 02:20:08,931: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:20:08.935505715Z [2024-05-25 02:20:08,935: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:20:08.957621711Z [2024-05-25 02:20:08,957: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:20:08.959200578Z [2024-05-25 02:20:08,958: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:20:08.959223879Z [2024-05-25 02:20:08,959: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:20:08.959355783Z [2024-05-25 02:20:08,959: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:20:08.959420347Z [2024-05-25 02:20:08,959: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:20:08.959730230Z [2024-05-25 02:20:08,959: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:20:08.959946048Z [2024-05-25 02:20:08,959: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:20:09.070905863Z [2024-05-25 02:20:09,070: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:20:09.764423198Z [2024-05-25 02:20:09,763: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c3f08fd2-6e0f-42ce-9748-93bfd7bddd82] succeeded in 2.5412475330012967s: None 2024-05-25T02:20:10.049086150Z [2024-05-25 02:20:10,048: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59f4fa3a-e7a8-48c0-9a1a-8dd4d067c51e] received 2024-05-25T02:20:10.059115531Z [2024-05-25 02:20:10,058: INFO/ForkPoolWorker-15] [59f4fa3a-e7a8-48c0-9a1a-8dd4d067c51e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:20:10.336659108Z [2024-05-25 02:20:10,333: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:20:11.411196738Z [2024-05-25 02:20:11,410: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:20:11.414486342Z [2024-05-25 02:20:11,413: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:20:11.438266432Z [2024-05-25 02:20:11,437: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:20:11.440349975Z [2024-05-25 02:20:11,440: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:20:11.440398476Z [2024-05-25 02:20:11,440: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:20:11.440602592Z [2024-05-25 02:20:11,440: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:20:11.440666524Z [2024-05-25 02:20:11,440: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:20:11.441745033Z [2024-05-25 02:20:11,441: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:20:11.441777958Z [2024-05-25 02:20:11,441: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:20:11.539841626Z [2024-05-25 02:20:11,539: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:20:12.198465916Z [2024-05-25 02:20:12,198: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[59f4fa3a-e7a8-48c0-9a1a-8dd4d067c51e] succeeded in 2.1458355850008957s: None 2024-05-25T02:21:00.391834069Z [2024-05-25 02:21:00,391: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e473ccb-3987-4366-9cac-7b2320fe97ae] received 2024-05-25T02:21:00.393910162Z [2024-05-25 02:21:00,393: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f1d5e8c-a451-40dd-a81a-50e51f4d78cb] received 2024-05-25T02:21:00.395240384Z [2024-05-25 02:21:00,395: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[40291549-971c-4107-92d6-8d4d79797072] received 2024-05-25T02:21:00.406507031Z [2024-05-25 02:21:00,406: INFO/ForkPoolWorker-15] [7e473ccb-3987-4366-9cac-7b2320fe97ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:21:00.410125282Z [2024-05-25 02:21:00,409: INFO/ForkPoolWorker-1] [40291549-971c-4107-92d6-8d4d79797072] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:21:00.411882565Z [2024-05-25 02:21:00,411: INFO/ForkPoolWorker-16] [1f1d5e8c-a451-40dd-a81a-50e51f4d78cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:21:00.691912604Z [2024-05-25 02:21:00,688: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:21:00.700093411Z [2024-05-25 02:21:00,696: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:21:00.705425439Z [2024-05-25 02:21:00,702: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:21:00.836649081Z [2024-05-25 02:21:00,836: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T02:21:00.840564645Z [2024-05-25 02:21:00,840: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:21:00.862994130Z [2024-05-25 02:21:00,862: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:21:00.864162357Z [2024-05-25 02:21:00,863: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:21:00.864280194Z [2024-05-25 02:21:00,864: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:21:00.864293231Z [2024-05-25 02:21:00,864: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T02:21:00.864453193Z [2024-05-25 02:21:00,864: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:21:00.945727648Z [2024-05-25 02:21:00,945: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:21:01.575593459Z [2024-05-25 02:21:01,575: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[40291549-971c-4107-92d6-8d4d79797072] succeeded in 1.1774145540002792s: None 2024-05-25T02:21:01.812324193Z [2024-05-25 02:21:01,811: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:21:01.815528246Z [2024-05-25 02:21:01,814: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:21:01.839724448Z [2024-05-25 02:21:01,839: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:21:01.841040749Z [2024-05-25 02:21:01,840: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:21:01.841085982Z [2024-05-25 02:21:01,840: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:21:01.841193791Z [2024-05-25 02:21:01,840: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:21:01.841244889Z [2024-05-25 02:21:01,841: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:21:01.841902418Z [2024-05-25 02:21:01,841: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:21:01.841944087Z [2024-05-25 02:21:01,841: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:21:01.930221883Z [2024-05-25 02:21:01,929: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:21:01.979846544Z [2024-05-25 02:21:01,979: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:21:01.983108757Z [2024-05-25 02:21:01,982: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:21:02.015863495Z [2024-05-25 02:21:02,015: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:21:02.019457568Z [2024-05-25 02:21:02,019: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:21:02.019705102Z [2024-05-25 02:21:02,019: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:21:02.020174245Z [2024-05-25 02:21:02,019: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:21:02.020476674Z [2024-05-25 02:21:02,020: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:21:02.021327682Z [2024-05-25 02:21:02,020: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:21:02.025037224Z [2024-05-25 02:21:02,024: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:21:02.104061551Z [2024-05-25 02:21:02,103: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:21:03.998888733Z [2024-05-25 02:21:03,998: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7e473ccb-3987-4366-9cac-7b2320fe97ae] succeeded in 3.6017525359984575s: None 2024-05-25T02:21:04.948937012Z [2024-05-25 02:21:04,948: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1f1d5e8c-a451-40dd-a81a-50e51f4d78cb] succeeded in 4.553531273999397s: None 2024-05-25T02:22:00.998151262Z [2024-05-25 02:22:00,997: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16166dbc-be5e-41ce-b5aa-39cef141728d] received 2024-05-25T02:22:01.010457900Z [2024-05-25 02:22:01,010: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39c0a585-7627-4af2-9a2b-08a2a9297b28] received 2024-05-25T02:22:01.011792501Z [2024-05-25 02:22:01,011: INFO/ForkPoolWorker-15] [16166dbc-be5e-41ce-b5aa-39cef141728d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:22:01.023645981Z [2024-05-25 02:22:01,023: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fdf57b61-b404-42e1-ac07-268d852ab5b5] received 2024-05-25T02:22:01.026614768Z [2024-05-25 02:22:01,026: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c9e7b96-877a-4cd3-a65f-448c16c5f4df] received 2024-05-25T02:22:01.035950480Z [2024-05-25 02:22:01,035: INFO/ForkPoolWorker-1] [fdf57b61-b404-42e1-ac07-268d852ab5b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:22:01.042736658Z [2024-05-25 02:22:01,042: INFO/ForkPoolWorker-2] [7c9e7b96-877a-4cd3-a65f-448c16c5f4df] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:22:01.045193456Z [2024-05-25 02:22:01,044: INFO/ForkPoolWorker-16] [39c0a585-7627-4af2-9a2b-08a2a9297b28] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:22:01.316920070Z [2024-05-25 02:22:01,312: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:22:01.362564901Z [2024-05-25 02:22:01,359: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:22:01.474082091Z [2024-05-25 02:22:01,470: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:22:01.552940182Z [2024-05-25 02:22:01,548: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:22:01.637836929Z [2024-05-25 02:22:01,637: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:22:01.640950014Z [2024-05-25 02:22:01,640: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T02:22:01.644701117Z [2024-05-25 02:22:01,644: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:22:01.683422699Z [2024-05-25 02:22:01,683: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:22:01.685951115Z [2024-05-25 02:22:01,685: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:22:01.686295764Z [2024-05-25 02:22:01,685: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:22:01.686475898Z [2024-05-25 02:22:01,686: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T02:22:01.686841920Z [2024-05-25 02:22:01,686: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:22:01.782252280Z [2024-05-25 02:22:01,781: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:22:02.335929130Z [2024-05-25 02:22:02,335: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[16166dbc-be5e-41ce-b5aa-39cef141728d] succeeded in 1.331652471999405s: None 2024-05-25T02:22:02.586042860Z [2024-05-25 02:22:02,585: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7c9e7b96-877a-4cd3-a65f-448c16c5f4df] succeeded in 1.5553216909993353s: None 2024-05-25T02:22:02.890784811Z [2024-05-25 02:22:02,890: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:22:02.894046064Z [2024-05-25 02:22:02,893: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:22:02.915095309Z [2024-05-25 02:22:02,914: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:22:02.916357399Z [2024-05-25 02:22:02,915: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:22:02.916377439Z [2024-05-25 02:22:02,916: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:22:02.916429366Z [2024-05-25 02:22:02,916: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:22:02.916437935Z [2024-05-25 02:22:02,916: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:22:02.916627609Z [2024-05-25 02:22:02,916: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:22:02.916637997Z [2024-05-25 02:22:02,916: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:22:03.013111245Z [2024-05-25 02:22:03,012: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:22:03.064822320Z [2024-05-25 02:22:03,064: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:22:03.068038247Z [2024-05-25 02:22:03,067: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:22:03.090231920Z [2024-05-25 02:22:03,090: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:22:03.091719453Z [2024-05-25 02:22:03,091: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:22:03.091731317Z [2024-05-25 02:22:03,091: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:22:03.091866274Z [2024-05-25 02:22:03,091: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:22:03.092013284Z [2024-05-25 02:22:03,091: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:22:03.092307473Z [2024-05-25 02:22:03,092: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:22:03.092495008Z [2024-05-25 02:22:03,092: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:22:03.179565222Z [2024-05-25 02:22:03,179: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:22:05.007691067Z [2024-05-25 02:22:05,004: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[39c0a585-7627-4af2-9a2b-08a2a9297b28] succeeded in 3.977178843000729s: None 2024-05-25T02:22:05.025891341Z [2024-05-25 02:22:05,025: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fdf57b61-b404-42e1-ac07-268d852ab5b5] succeeded in 3.9989031910008634s: None 2024-05-25T02:23:00.269966446Z [2024-05-25 02:23:00,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e67c4014-2756-4b3e-bdcd-f52580805ebb] received 2024-05-25T02:23:00.273163193Z [2024-05-25 02:23:00,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1cd36e5d-b9cf-4e31-89ca-04f7b2a4e9b5] received 2024-05-25T02:23:00.278215889Z [2024-05-25 02:23:00,277: INFO/ForkPoolWorker-15] [e67c4014-2756-4b3e-bdcd-f52580805ebb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:23:00.279734694Z [2024-05-25 02:23:00,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca76eca6-8e03-478e-a82d-a0d4ceb5ad4c] received 2024-05-25T02:23:00.281796722Z [2024-05-25 02:23:00,281: INFO/ForkPoolWorker-16] [1cd36e5d-b9cf-4e31-89ca-04f7b2a4e9b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:23:00.286399239Z [2024-05-25 02:23:00,285: INFO/ForkPoolWorker-1] [ca76eca6-8e03-478e-a82d-a0d4ceb5ad4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:23:00.571030938Z [2024-05-25 02:23:00,567: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:23:00.606667414Z [2024-05-25 02:23:00,603: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:23:00.665895503Z [2024-05-25 02:23:00,662: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:23:00.719028062Z [2024-05-25 02:23:00,718: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T02:23:00.731996294Z [2024-05-25 02:23:00,731: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:23:00.780140789Z [2024-05-25 02:23:00,779: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:23:00.786167457Z [2024-05-25 02:23:00,785: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:23:00.786353206Z [2024-05-25 02:23:00,786: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:23:00.786475165Z [2024-05-25 02:23:00,786: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T02:23:00.786754798Z [2024-05-25 02:23:00,786: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:23:00.922696739Z [2024-05-25 02:23:00,922: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:23:01.689725606Z [2024-05-25 02:23:01,689: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1cd36e5d-b9cf-4e31-89ca-04f7b2a4e9b5] succeeded in 1.41431639899929s: None 2024-05-25T02:23:01.922159007Z [2024-05-25 02:23:01,921: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:23:01.925679221Z [2024-05-25 02:23:01,925: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:23:01.946611617Z [2024-05-25 02:23:01,946: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:23:01.950529220Z [2024-05-25 02:23:01,950: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:23:01.951419520Z [2024-05-25 02:23:01,950: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:23:01.952396320Z [2024-05-25 02:23:01,952: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:23:01.952411607Z [2024-05-25 02:23:01,952: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:23:01.952555222Z [2024-05-25 02:23:01,952: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:23:01.952566981Z [2024-05-25 02:23:01,952: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:23:01.952872797Z [2024-05-25 02:23:01,952: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:23:01.952978063Z [2024-05-25 02:23:01,952: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:23:01.974992283Z [2024-05-25 02:23:01,974: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:23:01.976678138Z [2024-05-25 02:23:01,976: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:23:01.976785784Z [2024-05-25 02:23:01,976: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:23:01.976972338Z [2024-05-25 02:23:01,976: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:23:01.977066777Z [2024-05-25 02:23:01,976: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:23:01.977437199Z [2024-05-25 02:23:01,977: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:23:01.977540179Z [2024-05-25 02:23:01,977: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:23:02.031495280Z [2024-05-25 02:23:02,031: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:23:02.071741529Z [2024-05-25 02:23:02,071: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:23:03.787850282Z [2024-05-25 02:23:03,786: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ca76eca6-8e03-478e-a82d-a0d4ceb5ad4c] succeeded in 3.50557568899967s: None 2024-05-25T02:23:04.130413790Z [2024-05-25 02:23:04,130: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e67c4014-2756-4b3e-bdcd-f52580805ebb] succeeded in 3.8582717499994033s: None 2024-05-25T02:24:00.983280378Z [2024-05-25 02:24:00,982: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a94877c1-61f6-4e7e-9d90-7691a4074289] received 2024-05-25T02:24:00.990005598Z [2024-05-25 02:24:00,989: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63126c50-c078-4402-a173-05d4801723c5] received 2024-05-25T02:24:00.994338946Z [2024-05-25 02:24:00,994: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e01900b9-bd66-40fd-884b-575eb94ae130] received 2024-05-25T02:24:01.005850202Z [2024-05-25 02:24:01,005: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc10fdc5-15c4-4620-962f-f39916273bbb] received 2024-05-25T02:24:01.006714730Z [2024-05-25 02:24:01,006: INFO/ForkPoolWorker-16] [63126c50-c078-4402-a173-05d4801723c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:24:01.007209853Z [2024-05-25 02:24:01,007: INFO/ForkPoolWorker-15] [a94877c1-61f6-4e7e-9d90-7691a4074289] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:24:01.015619025Z [2024-05-25 02:24:01,015: INFO/ForkPoolWorker-1] [e01900b9-bd66-40fd-884b-575eb94ae130] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:24:01.018914825Z [2024-05-25 02:24:01,018: INFO/ForkPoolWorker-2] [fc10fdc5-15c4-4620-962f-f39916273bbb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:24:01.321601632Z [2024-05-25 02:24:01,318: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:24:01.416918588Z [2024-05-25 02:24:01,404: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:24:01.441637085Z [2024-05-25 02:24:01,438: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:24:01.482055053Z [2024-05-25 02:24:01,478: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:24:01.594626476Z [2024-05-25 02:24:01,594: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T02:24:01.598765493Z [2024-05-25 02:24:01,598: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:24:01.627221071Z [2024-05-25 02:24:01,626: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:24:01.628463765Z [2024-05-25 02:24:01,628: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:24:01.628611307Z [2024-05-25 02:24:01,628: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:24:01.628701973Z [2024-05-25 02:24:01,628: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T02:24:01.629276126Z [2024-05-25 02:24:01,629: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:24:01.755073668Z [2024-05-25 02:24:01,753: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:24:01.766517444Z [2024-05-25 02:24:01,766: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:24:02.495131877Z [2024-05-25 02:24:02,493: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[63126c50-c078-4402-a173-05d4801723c5] succeeded in 1.5003455959995335s: None 2024-05-25T02:24:02.556080063Z [2024-05-25 02:24:02,555: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fc10fdc5-15c4-4620-962f-f39916273bbb] succeeded in 1.5445835459995578s: None 2024-05-25T02:24:02.927253494Z [2024-05-25 02:24:02,926: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:24:02.930463617Z [2024-05-25 02:24:02,930: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:24:02.948328804Z [2024-05-25 02:24:02,947: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:24:02.951653708Z [2024-05-25 02:24:02,951: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:24:02.954217655Z [2024-05-25 02:24:02,954: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:24:02.958221171Z [2024-05-25 02:24:02,957: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:24:02.958335177Z [2024-05-25 02:24:02,958: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:24:02.958502048Z [2024-05-25 02:24:02,958: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:24:02.958586655Z [2024-05-25 02:24:02,958: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:24:02.958906062Z [2024-05-25 02:24:02,958: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:24:02.958992104Z [2024-05-25 02:24:02,958: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:24:02.975983949Z [2024-05-25 02:24:02,975: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:24:02.977478490Z [2024-05-25 02:24:02,977: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:24:02.977596420Z [2024-05-25 02:24:02,977: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:24:02.977794531Z [2024-05-25 02:24:02,977: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:24:02.977923152Z [2024-05-25 02:24:02,977: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:24:02.978232954Z [2024-05-25 02:24:02,978: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:24:02.978415659Z [2024-05-25 02:24:02,978: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:24:03.041884110Z [2024-05-25 02:24:03,041: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:24:03.076779761Z [2024-05-25 02:24:03,076: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:24:04.634742674Z [2024-05-25 02:24:04,634: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a94877c1-61f6-4e7e-9d90-7691a4074289] succeeded in 3.644989221000287s: None 2024-05-25T02:24:05.222894468Z [2024-05-25 02:24:05,222: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e01900b9-bd66-40fd-884b-575eb94ae130] succeeded in 4.223440241999924s: None 2024-05-25T02:25:00.425136095Z [2024-05-25 02:25:00,424: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9c8b36d-192b-40a4-bae3-3710d3adab0d] received 2024-05-25T02:25:00.427226299Z [2024-05-25 02:25:00,426: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b546ce4d-be01-4800-a7c1-76a10d67776c] received 2024-05-25T02:25:00.440485690Z [2024-05-25 02:25:00,440: INFO/ForkPoolWorker-16] [b546ce4d-be01-4800-a7c1-76a10d67776c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:25:00.441976361Z [2024-05-25 02:25:00,441: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eaf52e91-3730-45f5-9642-5880fe90202d] received 2024-05-25T02:25:00.443495094Z [2024-05-25 02:25:00,442: INFO/ForkPoolWorker-15] [f9c8b36d-192b-40a4-bae3-3710d3adab0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:25:00.449440927Z [2024-05-25 02:25:00,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6739de2d-49c7-4425-a1cd-22f1c86128c0] received 2024-05-25T02:25:00.453713270Z [2024-05-25 02:25:00,453: INFO/ForkPoolWorker-1] [eaf52e91-3730-45f5-9642-5880fe90202d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:25:00.458187878Z [2024-05-25 02:25:00,457: INFO/ForkPoolWorker-2] [6739de2d-49c7-4425-a1cd-22f1c86128c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:25:00.754627228Z [2024-05-25 02:25:00,751: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:25:00.796862953Z [2024-05-25 02:25:00,793: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:25:00.804414281Z [2024-05-25 02:25:00,800: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:25:00.819583646Z [2024-05-25 02:25:00,815: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:25:01.042260704Z [2024-05-25 02:25:01,041: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T02:25:01.049295964Z [2024-05-25 02:25:01,048: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:25:01.101982398Z [2024-05-25 02:25:01,101: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:25:01.105937070Z [2024-05-25 02:25:01,105: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:25:01.106117699Z [2024-05-25 02:25:01,105: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:25:01.106234704Z [2024-05-25 02:25:01,106: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T02:25:01.106489886Z [2024-05-25 02:25:01,106: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:25:01.227481883Z [2024-05-25 02:25:01,226: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:25:01.977199666Z [2024-05-25 02:25:01,976: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6739de2d-49c7-4425-a1cd-22f1c86128c0] succeeded in 1.5253604800000176s: None 2024-05-25T02:25:02.436419502Z [2024-05-25 02:25:02,436: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:25:02.439818094Z [2024-05-25 02:25:02,439: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:25:02.459196624Z [2024-05-25 02:25:02,458: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:25:02.460387986Z [2024-05-25 02:25:02,460: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:25:02.460401843Z [2024-05-25 02:25:02,460: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:25:02.460510626Z [2024-05-25 02:25:02,460: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:25:02.460522691Z [2024-05-25 02:25:02,460: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:25:02.460776889Z [2024-05-25 02:25:02,460: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:25:02.460826604Z [2024-05-25 02:25:02,460: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:25:02.503461175Z [2024-05-25 02:25:02,503: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:25:02.506958439Z [2024-05-25 02:25:02,506: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:25:02.545814572Z [2024-05-25 02:25:02,545: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:25:02.547320440Z [2024-05-25 02:25:02,547: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:25:02.548932036Z [2024-05-25 02:25:02,548: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:25:02.549058152Z [2024-05-25 02:25:02,548: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:25:02.549359763Z [2024-05-25 02:25:02,549: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:25:02.549461219Z [2024-05-25 02:25:02,549: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:25:02.549825229Z [2024-05-25 02:25:02,549: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:25:02.549924771Z [2024-05-25 02:25:02,549: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:25:02.639845132Z [2024-05-25 02:25:02,639: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:25:02.797980503Z [2024-05-25 02:25:02,797: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:25:02.801501136Z [2024-05-25 02:25:02,801: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:25:02.841729131Z [2024-05-25 02:25:02,841: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:25:02.843084501Z [2024-05-25 02:25:02,842: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:25:02.844226051Z [2024-05-25 02:25:02,844: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:25:02.844466188Z [2024-05-25 02:25:02,844: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:25:02.844604477Z [2024-05-25 02:25:02,844: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:25:02.844904872Z [2024-05-25 02:25:02,844: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:25:02.845375058Z [2024-05-25 02:25:02,845: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:25:02.959954560Z [2024-05-25 02:25:02,959: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:25:03.659609757Z [2024-05-25 02:25:03,659: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f9c8b36d-192b-40a4-bae3-3710d3adab0d] succeeded in 3.231290538000394s: None 2024-05-25T02:25:04.243855753Z [2024-05-25 02:25:04,242: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eaf52e91-3730-45f5-9642-5880fe90202d] succeeded in 3.7967490529990755s: None 2024-05-25T02:25:04.711005694Z [2024-05-25 02:25:04,710: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6f433fc-bb77-4920-abca-976c18722fdc] received 2024-05-25T02:25:04.722266547Z [2024-05-25 02:25:04,720: INFO/ForkPoolWorker-15] [f6f433fc-bb77-4920-abca-976c18722fdc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:25:04.723797991Z [2024-05-25 02:25:04,723: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b546ce4d-be01-4800-a7c1-76a10d67776c] succeeded in 4.293693706998965s: None 2024-05-25T02:25:05.008812836Z [2024-05-25 02:25:05,005: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:25:06.090957747Z [2024-05-25 02:25:06,086: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:25:06.090988159Z [2024-05-25 02:25:06,089: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:25:06.118916194Z [2024-05-25 02:25:06,118: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:25:06.120206556Z [2024-05-25 02:25:06,119: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:25:06.120265226Z [2024-05-25 02:25:06,120: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:25:06.120410175Z [2024-05-25 02:25:06,120: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:25:06.120492180Z [2024-05-25 02:25:06,120: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:25:06.120716725Z [2024-05-25 02:25:06,120: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:25:06.120794851Z [2024-05-25 02:25:06,120: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:25:06.211086720Z [2024-05-25 02:25:06,210: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:25:06.910342081Z [2024-05-25 02:25:06,909: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f6f433fc-bb77-4920-abca-976c18722fdc] succeeded in 2.1958569340004033s: None 2024-05-25T02:25:07.199155283Z [2024-05-25 02:25:07,198: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd106f87-f0ef-490a-b007-309c19ee7cfc] received 2024-05-25T02:25:07.218206121Z [2024-05-25 02:25:07,217: INFO/ForkPoolWorker-15] [dd106f87-f0ef-490a-b007-309c19ee7cfc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T02:25:07.483561325Z [2024-05-25 02:25:07,480: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:25:08.824481956Z [2024-05-25 02:25:08,823: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:25:08.828128676Z [2024-05-25 02:25:08,827: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:25:08.866006365Z [2024-05-25 02:25:08,865: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:25:08.869994534Z [2024-05-25 02:25:08,869: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:25:08.870014855Z [2024-05-25 02:25:08,869: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:25:08.870296688Z [2024-05-25 02:25:08,869: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:25:08.870304907Z [2024-05-25 02:25:08,870: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:25:08.873836815Z [2024-05-25 02:25:08,873: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:25:08.874050479Z [2024-05-25 02:25:08,873: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:25:09.006277965Z [2024-05-25 02:25:09,005: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:25:10.598079201Z [2024-05-25 02:25:10,597: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dd106f87-f0ef-490a-b007-309c19ee7cfc] succeeded in 3.3965928770012397s: None 2024-05-25T02:25:10.658897757Z [2024-05-25 02:25:10,657: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9de1a07-1050-4aee-a3f1-b6daa88d1670] received 2024-05-25T02:25:10.674173276Z [2024-05-25 02:25:10,673: INFO/ForkPoolWorker-15] [d9de1a07-1050-4aee-a3f1-b6daa88d1670] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:25:10.940076652Z [2024-05-25 02:25:10,936: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:25:12.148700437Z [2024-05-25 02:25:12,148: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:25:12.152226042Z [2024-05-25 02:25:12,151: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:25:12.193876944Z [2024-05-25 02:25:12,193: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:25:12.195573903Z [2024-05-25 02:25:12,195: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:25:12.195674059Z [2024-05-25 02:25:12,195: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:25:12.195778895Z [2024-05-25 02:25:12,195: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:25:12.195868583Z [2024-05-25 02:25:12,195: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:25:12.196211443Z [2024-05-25 02:25:12,195: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:25:12.196231121Z [2024-05-25 02:25:12,196: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:25:12.306012443Z [2024-05-25 02:25:12,305: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:25:12.985723151Z [2024-05-25 02:25:12,983: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d9de1a07-1050-4aee-a3f1-b6daa88d1670] succeeded in 2.3214295159996254s: None 2024-05-25T02:26:00.400575872Z [2024-05-25 02:26:00,400: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5c8acd7-0008-4e62-bd94-77b6e7b3cc07] received 2024-05-25T02:26:00.403825870Z [2024-05-25 02:26:00,403: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a8c9d427-2ba9-4168-a11a-03cda5364da1] received 2024-05-25T02:26:00.411999861Z [2024-05-25 02:26:00,411: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7c055c4-5f26-4074-a41b-3ba207ea4770] received 2024-05-25T02:26:00.422067140Z [2024-05-25 02:26:00,421: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73db2c9c-3d2e-4832-ae7b-292daf16e0c4] received 2024-05-25T02:26:00.424280902Z [2024-05-25 02:26:00,423: INFO/ForkPoolWorker-15] [d5c8acd7-0008-4e62-bd94-77b6e7b3cc07] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:26:00.428515973Z [2024-05-25 02:26:00,428: INFO/ForkPoolWorker-1] [f7c055c4-5f26-4074-a41b-3ba207ea4770] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:26:00.431117400Z [2024-05-25 02:26:00,430: INFO/ForkPoolWorker-2] [73db2c9c-3d2e-4832-ae7b-292daf16e0c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:26:00.433442005Z [2024-05-25 02:26:00,433: INFO/ForkPoolWorker-16] [a8c9d427-2ba9-4168-a11a-03cda5364da1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:26:00.705339366Z [2024-05-25 02:26:00,702: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:26:00.786292129Z [2024-05-25 02:26:00,782: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:26:00.813060761Z [2024-05-25 02:26:00,809: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:26:00.842973081Z [2024-05-25 02:26:00,838: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:26:00.978019905Z [2024-05-25 02:26:00,977: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T02:26:00.985317935Z [2024-05-25 02:26:00,984: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:26:01.022838068Z [2024-05-25 02:26:01,022: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:26:01.029799809Z [2024-05-25 02:26:01,029: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:26:01.031914962Z [2024-05-25 02:26:01,031: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:26:01.032215022Z [2024-05-25 02:26:01,032: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:26:01.032348905Z [2024-05-25 02:26:01,032: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T02:26:01.032835437Z [2024-05-25 02:26:01,032: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:26:01.220521814Z [2024-05-25 02:26:01,220: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:26:01.701760963Z [2024-05-25 02:26:01,701: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d5c8acd7-0008-4e62-bd94-77b6e7b3cc07] succeeded in 1.291727069999979s: None 2024-05-25T02:26:02.071186135Z [2024-05-25 02:26:02,070: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[73db2c9c-3d2e-4832-ae7b-292daf16e0c4] succeeded in 1.6466761200008477s: None 2024-05-25T02:26:02.372162265Z [2024-05-25 02:26:02,371: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:26:02.376925361Z [2024-05-25 02:26:02,376: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:26:02.403702311Z [2024-05-25 02:26:02,403: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:26:02.405031747Z [2024-05-25 02:26:02,404: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:26:02.405168074Z [2024-05-25 02:26:02,405: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:26:02.405375540Z [2024-05-25 02:26:02,405: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:26:02.405491977Z [2024-05-25 02:26:02,405: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:26:02.405759696Z [2024-05-25 02:26:02,405: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:26:02.405873453Z [2024-05-25 02:26:02,405: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:26:02.418397390Z [2024-05-25 02:26:02,417: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:26:02.424250475Z [2024-05-25 02:26:02,422: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:26:02.456375003Z [2024-05-25 02:26:02,456: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:26:02.457883784Z [2024-05-25 02:26:02,457: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:26:02.457901245Z [2024-05-25 02:26:02,457: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:26:02.458111241Z [2024-05-25 02:26:02,457: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:26:02.458205613Z [2024-05-25 02:26:02,458: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:26:02.458732893Z [2024-05-25 02:26:02,458: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:26:02.458887382Z [2024-05-25 02:26:02,458: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:26:02.507539275Z [2024-05-25 02:26:02,507: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:26:02.570596947Z [2024-05-25 02:26:02,570: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:26:04.342979578Z [2024-05-25 02:26:04,342: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f7c055c4-5f26-4074-a41b-3ba207ea4770] succeeded in 3.9284347650009295s: None 2024-05-25T02:26:04.891191730Z [2024-05-25 02:26:04,890: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a8c9d427-2ba9-4168-a11a-03cda5364da1] succeeded in 4.483182581998335s: None 2024-05-25T02:27:00.266579369Z [2024-05-25 02:27:00,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48997582-0812-4a2c-b689-4994163797d8] received 2024-05-25T02:27:00.269975931Z [2024-05-25 02:27:00,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0bdd37f-0637-4bd0-9a04-bc97d0f4128b] received 2024-05-25T02:27:00.275457796Z [2024-05-25 02:27:00,274: INFO/ForkPoolWorker-15] [48997582-0812-4a2c-b689-4994163797d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:27:00.279051598Z [2024-05-25 02:27:00,278: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c03f8fb-573c-483c-8cae-cfed4c498059] received 2024-05-25T02:27:00.280013502Z [2024-05-25 02:27:00,279: INFO/ForkPoolWorker-16] [e0bdd37f-0637-4bd0-9a04-bc97d0f4128b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:27:00.298127326Z [2024-05-25 02:27:00,297: INFO/ForkPoolWorker-1] [4c03f8fb-573c-483c-8cae-cfed4c498059] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:27:00.579836668Z [2024-05-25 02:27:00,576: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:27:00.608077152Z [2024-05-25 02:27:00,604: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:27:00.662189832Z [2024-05-25 02:27:00,659: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:27:00.768419681Z [2024-05-25 02:27:00,767: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T02:27:00.772728354Z [2024-05-25 02:27:00,772: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:27:00.805363343Z [2024-05-25 02:27:00,805: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:27:00.806875986Z [2024-05-25 02:27:00,806: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:27:00.807119234Z [2024-05-25 02:27:00,806: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:27:00.807286024Z [2024-05-25 02:27:00,807: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T02:27:00.807618774Z [2024-05-25 02:27:00,807: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:27:00.919045990Z [2024-05-25 02:27:00,918: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:27:01.551328873Z [2024-05-25 02:27:01,550: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4c03f8fb-573c-483c-8cae-cfed4c498059] succeeded in 1.2657130430015968s: None 2024-05-25T02:27:01.730749950Z [2024-05-25 02:27:01,730: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:27:01.734140988Z [2024-05-25 02:27:01,733: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:27:01.764957502Z [2024-05-25 02:27:01,764: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:27:01.768064139Z [2024-05-25 02:27:01,767: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:27:01.768169963Z [2024-05-25 02:27:01,767: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:27:01.768380887Z [2024-05-25 02:27:01,768: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:27:01.768456907Z [2024-05-25 02:27:01,768: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:27:01.768783702Z [2024-05-25 02:27:01,768: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:27:01.768853421Z [2024-05-25 02:27:01,768: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:27:01.828226852Z [2024-05-25 02:27:01,827: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:27:01.831453166Z [2024-05-25 02:27:01,831: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:27:01.852219793Z [2024-05-25 02:27:01,851: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:27:01.853744283Z [2024-05-25 02:27:01,853: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:27:01.853898563Z [2024-05-25 02:27:01,853: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:27:01.854118764Z [2024-05-25 02:27:01,853: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:27:01.854257572Z [2024-05-25 02:27:01,854: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:27:01.854582345Z [2024-05-25 02:27:01,854: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:27:01.854715526Z [2024-05-25 02:27:01,854: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:27:01.887250227Z [2024-05-25 02:27:01,886: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:27:01.955290296Z [2024-05-25 02:27:01,955: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:27:03.558724274Z [2024-05-25 02:27:03,558: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[48997582-0812-4a2c-b689-4994163797d8] succeeded in 3.289732360000926s: None 2024-05-25T02:27:04.121014843Z [2024-05-25 02:27:04,120: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e0bdd37f-0637-4bd0-9a04-bc97d0f4128b] succeeded in 3.8470351449996087s: None 2024-05-25T02:28:01.282426382Z [2024-05-25 02:28:01,281: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fac590b4-99da-4e2b-8c72-5e1a6204383b] received 2024-05-25T02:28:01.287559627Z [2024-05-25 02:28:01,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0817c4a7-ac3f-4c21-8af6-c312908033bd] received 2024-05-25T02:28:01.293308647Z [2024-05-25 02:28:01,292: INFO/ForkPoolWorker-15] [fac590b4-99da-4e2b-8c72-5e1a6204383b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:28:01.297452152Z [2024-05-25 02:28:01,297: INFO/ForkPoolWorker-16] [0817c4a7-ac3f-4c21-8af6-c312908033bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:28:01.324008310Z [2024-05-25 02:28:01,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c38e0913-55d0-4af6-84af-72d80a22c308] received 2024-05-25T02:28:01.329667974Z [2024-05-25 02:28:01,329: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d7fdbcc-bdeb-4d43-9cdc-a99b368a8f65] received 2024-05-25T02:28:01.359288618Z [2024-05-25 02:28:01,357: INFO/ForkPoolWorker-1] [c38e0913-55d0-4af6-84af-72d80a22c308] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:28:01.366546115Z [2024-05-25 02:28:01,365: INFO/ForkPoolWorker-2] [3d7fdbcc-bdeb-4d43-9cdc-a99b368a8f65] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:28:01.773376695Z [2024-05-25 02:28:01,767: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:28:01.786620717Z [2024-05-25 02:28:01,783: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:28:01.939655781Z [2024-05-25 02:28:01,934: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:28:02.004251683Z [2024-05-25 02:28:01,993: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:28:02.054499109Z [2024-05-25 02:28:02,054: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:28:02.451580178Z [2024-05-25 02:28:02,451: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T02:28:02.456338357Z [2024-05-25 02:28:02,455: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:28:02.500605924Z [2024-05-25 02:28:02,500: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:28:02.503022024Z [2024-05-25 02:28:02,502: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:28:02.503130363Z [2024-05-25 02:28:02,502: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:28:02.503226679Z [2024-05-25 02:28:02,503: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T02:28:02.503597325Z [2024-05-25 02:28:02,503: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:28:02.597354704Z [2024-05-25 02:28:02,597: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:28:02.703263086Z [2024-05-25 02:28:02,702: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fac590b4-99da-4e2b-8c72-5e1a6204383b] succeeded in 1.418485789999977s: None 2024-05-25T02:28:03.153420662Z [2024-05-25 02:28:03,152: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3d7fdbcc-bdeb-4d43-9cdc-a99b368a8f65] succeeded in 1.8202269860012166s: None 2024-05-25T02:28:03.587914768Z [2024-05-25 02:28:03,587: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:28:03.591147352Z [2024-05-25 02:28:03,590: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:28:03.602189682Z [2024-05-25 02:28:03,601: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:28:03.609540242Z [2024-05-25 02:28:03,601: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:28:03.633102458Z [2024-05-25 02:28:03,632: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:28:03.636879794Z [2024-05-25 02:28:03,636: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:28:03.637033558Z [2024-05-25 02:28:03,636: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:28:03.641511558Z [2024-05-25 02:28:03,638: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:28:03.641530221Z [2024-05-25 02:28:03,636: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:28:03.641535589Z [2024-05-25 02:28:03,639: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:28:03.641540382Z [2024-05-25 02:28:03,639: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:28:03.641545390Z [2024-05-25 02:28:03,639: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:28:03.642622542Z [2024-05-25 02:28:03,642: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:28:03.642846798Z [2024-05-25 02:28:03,642: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:28:03.643094369Z [2024-05-25 02:28:03,642: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:28:03.643268090Z [2024-05-25 02:28:03,643: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:28:03.643766989Z [2024-05-25 02:28:03,643: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:28:03.643919509Z [2024-05-25 02:28:03,643: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:28:03.748768836Z [2024-05-25 02:28:03,748: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:28:03.759169068Z [2024-05-25 02:28:03,758: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:28:05.282494222Z [2024-05-25 02:28:05,281: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c38e0913-55d0-4af6-84af-72d80a22c308] succeeded in 3.9537895299999946s: None 2024-05-25T02:28:05.739323134Z [2024-05-25 02:28:05,738: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0817c4a7-ac3f-4c21-8af6-c312908033bd] succeeded in 4.449963228998968s: None 2024-05-25T02:29:01.210111781Z [2024-05-25 02:29:01,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[414b34c5-243e-4927-b26c-e7cdbdbae520] received 2024-05-25T02:29:01.217074620Z [2024-05-25 02:29:01,216: INFO/ForkPoolWorker-15] [414b34c5-243e-4927-b26c-e7cdbdbae520] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:29:01.218933056Z [2024-05-25 02:29:01,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a215287-8944-4553-9281-d2d6a211d345] received 2024-05-25T02:29:01.220557866Z [2024-05-25 02:29:01,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0bc66046-3a34-4edb-9490-aa5c9342d636] received 2024-05-25T02:29:01.230491446Z [2024-05-25 02:29:01,229: INFO/ForkPoolWorker-1] [0bc66046-3a34-4edb-9490-aa5c9342d636] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:29:01.230537316Z [2024-05-25 02:29:01,230: INFO/ForkPoolWorker-16] [9a215287-8944-4553-9281-d2d6a211d345] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:29:01.567493527Z [2024-05-25 02:29:01,564: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:29:01.691709828Z [2024-05-25 02:29:01,688: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:29:01.726694553Z [2024-05-25 02:29:01,726: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T02:29:01.730769171Z [2024-05-25 02:29:01,730: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:29:01.737884112Z [2024-05-25 02:29:01,733: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:29:01.763705262Z [2024-05-25 02:29:01,763: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:29:01.766974429Z [2024-05-25 02:29:01,766: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:29:01.767098406Z [2024-05-25 02:29:01,766: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:29:01.767164639Z [2024-05-25 02:29:01,767: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T02:29:01.767441148Z [2024-05-25 02:29:01,767: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:29:01.860631805Z [2024-05-25 02:29:01,860: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:29:02.576857967Z [2024-05-25 02:29:02,576: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9a215287-8944-4553-9281-d2d6a211d345] succeeded in 1.355495683999834s: None 2024-05-25T02:29:03.017428547Z [2024-05-25 02:29:03,017: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:29:03.020589162Z [2024-05-25 02:29:03,020: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:29:03.046211788Z [2024-05-25 02:29:03,045: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:29:03.048014170Z [2024-05-25 02:29:03,047: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:29:03.048314811Z [2024-05-25 02:29:03,047: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:29:03.048558030Z [2024-05-25 02:29:03,048: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:29:03.048687047Z [2024-05-25 02:29:03,048: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:29:03.049111468Z [2024-05-25 02:29:03,048: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:29:03.049232219Z [2024-05-25 02:29:03,049: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:29:03.143730812Z [2024-05-25 02:29:03,143: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:29:03.167696669Z [2024-05-25 02:29:03,167: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:29:03.171107183Z [2024-05-25 02:29:03,170: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:29:03.196748235Z [2024-05-25 02:29:03,196: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:29:03.198267767Z [2024-05-25 02:29:03,198: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:29:03.198440915Z [2024-05-25 02:29:03,198: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:29:03.198710826Z [2024-05-25 02:29:03,198: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:29:03.198864781Z [2024-05-25 02:29:03,198: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:29:03.199231666Z [2024-05-25 02:29:03,199: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:29:03.199358874Z [2024-05-25 02:29:03,199: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:29:03.285123397Z [2024-05-25 02:29:03,284: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:29:04.890375753Z [2024-05-25 02:29:04,889: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[414b34c5-243e-4927-b26c-e7cdbdbae520] succeeded in 3.678548406000118s: None 2024-05-25T02:29:05.497760034Z [2024-05-25 02:29:05,497: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0bc66046-3a34-4edb-9490-aa5c9342d636] succeeded in 4.275048098999832s: None 2024-05-25T02:30:00.338670500Z [2024-05-25 02:30:00,338: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88323abf-e14a-4e63-876a-3fde561729e4] received 2024-05-25T02:30:00.342495633Z [2024-05-25 02:30:00,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[713b9f82-de89-4b29-8967-49427854d942] received 2024-05-25T02:30:00.344421323Z [2024-05-25 02:30:00,344: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35040600-7362-4e63-a47c-6bcab43a16c4] received 2024-05-25T02:30:00.345779796Z [2024-05-25 02:30:00,345: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77b8d511-2000-422d-b6ad-321684c3d212] received 2024-05-25T02:30:00.354793072Z [2024-05-25 02:30:00,354: INFO/ForkPoolWorker-16] [713b9f82-de89-4b29-8967-49427854d942] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:30:00.355868198Z [2024-05-25 02:30:00,355: INFO/ForkPoolWorker-1] [35040600-7362-4e63-a47c-6bcab43a16c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:30:00.358298658Z [2024-05-25 02:30:00,357: INFO/ForkPoolWorker-15] [88323abf-e14a-4e63-876a-3fde561729e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:30:00.361163090Z [2024-05-25 02:30:00,360: INFO/ForkPoolWorker-2] [77b8d511-2000-422d-b6ad-321684c3d212] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:30:00.362588407Z [2024-05-25 02:30:00,362: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0e4728a-2da7-425f-bd18-f3104babb438] received 2024-05-25T02:30:00.380961108Z [2024-05-25 02:30:00,380: INFO/ForkPoolWorker-3] [f0e4728a-2da7-425f-bd18-f3104babb438] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:30:00.734655359Z [2024-05-25 02:30:00,731: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:30:00.744201972Z [2024-05-25 02:30:00,740: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:30:00.847947301Z [2024-05-25 02:30:00,843: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:30:00.871955478Z [2024-05-25 02:30:00,860: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:30:00.980409204Z [2024-05-25 02:30:00,971: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:30:01.086940857Z [2024-05-25 02:30:01,086: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:30:01.141119808Z [2024-05-25 02:30:01,140: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-25T02:30:01.144974713Z [2024-05-25 02:30:01,144: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:30:01.178471198Z [2024-05-25 02:30:01,178: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T02:30:01.179465548Z [2024-05-25 02:30:01,179: INFO/ForkPoolWorker-3] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:30:01.179527940Z [2024-05-25 02:30:01,179: INFO/ForkPoolWorker-3] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:30:01.179564326Z [2024-05-25 02:30:01,179: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-25T02:30:01.179734739Z [2024-05-25 02:30:01,179: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:30:01.271199506Z [2024-05-25 02:30:01,270: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:30:01.706365106Z [2024-05-25 02:30:01,705: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[713b9f82-de89-4b29-8967-49427854d942] succeeded in 1.360373654999421s: None 2024-05-25T02:30:01.927274081Z [2024-05-25 02:30:01,926: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[f0e4728a-2da7-425f-bd18-f3104babb438] succeeded in 1.562258097999802s: None 2024-05-25T02:30:02.221294200Z [2024-05-25 02:30:02,215: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:30:02.221323756Z [2024-05-25 02:30:02,218: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:30:02.276888003Z [2024-05-25 02:30:02,276: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:30:02.278536184Z [2024-05-25 02:30:02,278: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:30:02.278712270Z [2024-05-25 02:30:02,278: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:30:02.278907824Z [2024-05-25 02:30:02,278: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:30:02.279034299Z [2024-05-25 02:30:02,278: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:30:02.279425761Z [2024-05-25 02:30:02,279: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:30:02.279568013Z [2024-05-25 02:30:02,279: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:30:02.400532427Z [2024-05-25 02:30:02,400: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:30:02.431382082Z [2024-05-25 02:30:02,431: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T02:30:02.434578730Z [2024-05-25 02:30:02,434: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:30:02.455640154Z [2024-05-25 02:30:02,455: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:30:02.456721438Z [2024-05-25 02:30:02,456: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:30:02.456803229Z [2024-05-25 02:30:02,456: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:30:02.457000242Z [2024-05-25 02:30:02,456: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:30:02.457112668Z [2024-05-25 02:30:02,456: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T02:30:02.457705818Z [2024-05-25 02:30:02,457: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:30:02.457779152Z [2024-05-25 02:30:02,457: INFO/ForkPoolWorker-2] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:30:02.571954432Z [2024-05-25 02:30:02,571: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:30:02.637351071Z [2024-05-25 02:30:02,636: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:30:02.640838134Z [2024-05-25 02:30:02,640: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:30:02.662476789Z [2024-05-25 02:30:02,662: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:30:02.663796194Z [2024-05-25 02:30:02,663: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:30:02.663812169Z [2024-05-25 02:30:02,663: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:30:02.664105867Z [2024-05-25 02:30:02,663: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:30:02.664117771Z [2024-05-25 02:30:02,664: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:30:02.664432550Z [2024-05-25 02:30:02,664: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:30:02.664596801Z [2024-05-25 02:30:02,664: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:30:02.774488271Z [2024-05-25 02:30:02,774: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:30:03.033536294Z [2024-05-25 02:30:03,033: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[88323abf-e14a-4e63-876a-3fde561729e4] succeeded in 2.6923012799998105s: None 2024-05-25T02:30:03.234602584Z [2024-05-25 02:30:03,234: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e8bf057-06b9-43fa-a1d9-fcc0c71adb51] received 2024-05-25T02:30:03.251237572Z [2024-05-25 02:30:03,250: INFO/ForkPoolWorker-15] [6e8bf057-06b9-43fa-a1d9-fcc0c71adb51] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:30:03.562133339Z [2024-05-25 02:30:03,558: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:30:04.104443277Z [2024-05-25 02:30:04,103: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[77b8d511-2000-422d-b6ad-321684c3d212] succeeded in 3.7550337499997113s: None 2024-05-25T02:30:04.835664719Z [2024-05-25 02:30:04,835: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[35040600-7362-4e63-a47c-6bcab43a16c4] succeeded in 4.4889398839986825s: None 2024-05-25T02:30:04.886983347Z [2024-05-25 02:30:04,886: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:30:04.890366369Z [2024-05-25 02:30:04,889: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:30:04.919575812Z [2024-05-25 02:30:04,919: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:30:04.922153579Z [2024-05-25 02:30:04,921: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:30:04.922236291Z [2024-05-25 02:30:04,922: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:30:04.922997349Z [2024-05-25 02:30:04,922: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:30:04.923221502Z [2024-05-25 02:30:04,922: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:30:04.923887578Z [2024-05-25 02:30:04,923: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:30:04.924315698Z [2024-05-25 02:30:04,923: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:30:05.019529336Z [2024-05-25 02:30:05,019: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:30:05.694360243Z [2024-05-25 02:30:05,693: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6e8bf057-06b9-43fa-a1d9-fcc0c71adb51] succeeded in 2.457417022998925s: None 2024-05-25T02:30:06.056880154Z [2024-05-25 02:30:06,056: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d7f9804-d34b-4cb1-8cb8-88823f47a738] received 2024-05-25T02:30:06.063043688Z [2024-05-25 02:30:06,062: INFO/ForkPoolWorker-15] [2d7f9804-d34b-4cb1-8cb8-88823f47a738] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T02:30:06.358328444Z [2024-05-25 02:30:06,355: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:30:07.446841810Z [2024-05-25 02:30:07,446: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:30:07.450199042Z [2024-05-25 02:30:07,449: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:30:07.478292426Z [2024-05-25 02:30:07,478: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:30:07.480208084Z [2024-05-25 02:30:07,479: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:30:07.480434195Z [2024-05-25 02:30:07,480: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:30:07.480662316Z [2024-05-25 02:30:07,480: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:30:07.480842455Z [2024-05-25 02:30:07,480: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:30:07.481178026Z [2024-05-25 02:30:07,481: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:30:07.481403033Z [2024-05-25 02:30:07,481: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:30:07.568265567Z [2024-05-25 02:30:07,567: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:30:09.188720209Z [2024-05-25 02:30:09,187: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2d7f9804-d34b-4cb1-8cb8-88823f47a738] succeeded in 3.1294234829983907s: None 2024-05-25T02:30:09.508362535Z [2024-05-25 02:30:09,507: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff1da448-a430-49a1-8766-f979ca37ddc5] received 2024-05-25T02:30:09.519249984Z [2024-05-25 02:30:09,518: INFO/ForkPoolWorker-15] [ff1da448-a430-49a1-8766-f979ca37ddc5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:30:09.787172604Z [2024-05-25 02:30:09,784: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:30:10.863512906Z [2024-05-25 02:30:10,863: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:30:10.866912395Z [2024-05-25 02:30:10,866: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:30:10.891149140Z [2024-05-25 02:30:10,890: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:30:10.893024767Z [2024-05-25 02:30:10,892: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:30:10.893253516Z [2024-05-25 02:30:10,892: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:30:10.893590088Z [2024-05-25 02:30:10,893: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:30:10.893774360Z [2024-05-25 02:30:10,893: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:30:10.894181816Z [2024-05-25 02:30:10,893: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:30:10.894463173Z [2024-05-25 02:30:10,894: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:30:10.987451399Z [2024-05-25 02:30:10,987: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:30:11.647738280Z [2024-05-25 02:30:11,647: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ff1da448-a430-49a1-8766-f979ca37ddc5] succeeded in 2.1352588219997415s: None 2024-05-25T02:31:00.304116827Z [2024-05-25 02:31:00,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f838505-e347-4691-8b24-f8c50037b597] received 2024-05-25T02:31:00.309352379Z [2024-05-25 02:31:00,309: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e90e384-95d4-48bb-8d14-0236dc8a92b6] received 2024-05-25T02:31:00.318056321Z [2024-05-25 02:31:00,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c230b9ac-bd3a-4859-ae53-3bc02201174f] received 2024-05-25T02:31:00.326468474Z [2024-05-25 02:31:00,325: INFO/ForkPoolWorker-15] [8f838505-e347-4691-8b24-f8c50037b597] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:31:00.327539969Z [2024-05-25 02:31:00,327: INFO/ForkPoolWorker-16] [2e90e384-95d4-48bb-8d14-0236dc8a92b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:31:00.329746287Z [2024-05-25 02:31:00,329: INFO/ForkPoolWorker-1] [c230b9ac-bd3a-4859-ae53-3bc02201174f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:31:00.639985969Z [2024-05-25 02:31:00,635: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:31:00.687543753Z [2024-05-25 02:31:00,683: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:31:00.719025310Z [2024-05-25 02:31:00,715: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:31:00.890394961Z [2024-05-25 02:31:00,889: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T02:31:00.894859730Z [2024-05-25 02:31:00,894: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:31:00.925052358Z [2024-05-25 02:31:00,924: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:31:00.926702606Z [2024-05-25 02:31:00,926: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:31:00.927003750Z [2024-05-25 02:31:00,926: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:31:00.927235032Z [2024-05-25 02:31:00,927: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T02:31:00.927582240Z [2024-05-25 02:31:00,927: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:31:01.028286218Z [2024-05-25 02:31:01,027: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:31:01.735724648Z [2024-05-25 02:31:01,735: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2e90e384-95d4-48bb-8d14-0236dc8a92b6] succeeded in 1.4231248809992394s: None 2024-05-25T02:31:01.784492881Z [2024-05-25 02:31:01,784: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:31:01.787781046Z [2024-05-25 02:31:01,787: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:31:01.823879105Z [2024-05-25 02:31:01,823: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:31:01.825752731Z [2024-05-25 02:31:01,825: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:31:01.825919605Z [2024-05-25 02:31:01,825: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:31:01.826223507Z [2024-05-25 02:31:01,825: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:31:01.826421721Z [2024-05-25 02:31:01,826: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:31:01.826813089Z [2024-05-25 02:31:01,826: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:31:01.827825745Z [2024-05-25 02:31:01,827: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:31:01.907770805Z [2024-05-25 02:31:01,907: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:31:02.157606109Z [2024-05-25 02:31:02,157: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:31:02.161115513Z [2024-05-25 02:31:02,160: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:31:02.210540797Z [2024-05-25 02:31:02,210: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:31:02.211887749Z [2024-05-25 02:31:02,211: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:31:02.211898772Z [2024-05-25 02:31:02,211: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:31:02.211902750Z [2024-05-25 02:31:02,211: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:31:02.211906727Z [2024-05-25 02:31:02,211: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:31:02.212099267Z [2024-05-25 02:31:02,211: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:31:02.212104159Z [2024-05-25 02:31:02,212: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:31:02.364623469Z [2024-05-25 02:31:02,364: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:31:03.804526244Z [2024-05-25 02:31:03,803: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8f838505-e347-4691-8b24-f8c50037b597] succeeded in 3.4965173630007484s: None 2024-05-25T02:31:04.026280185Z [2024-05-25 02:31:04,025: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c230b9ac-bd3a-4859-ae53-3bc02201174f] succeeded in 3.706707938999898s: None 2024-05-25T02:32:00.408958221Z [2024-05-25 02:32:00,408: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[643bb48e-eb2b-456a-88dd-7c2d1d339b7e] received 2024-05-25T02:32:00.412398501Z [2024-05-25 02:32:00,412: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[426cd843-536c-4fe4-8bd3-9b894cbae468] received 2024-05-25T02:32:00.423689709Z [2024-05-25 02:32:00,422: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a8cd0c77-a7a0-4454-9fe4-9a4bc8e9ae65] received 2024-05-25T02:32:00.426244254Z [2024-05-25 02:32:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5aae381b-6914-4dc9-bede-42c0037ba0c9] received 2024-05-25T02:32:00.429706421Z [2024-05-25 02:32:00,429: INFO/ForkPoolWorker-16] [426cd843-536c-4fe4-8bd3-9b894cbae468] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:32:00.445675867Z [2024-05-25 02:32:00,444: INFO/ForkPoolWorker-15] [643bb48e-eb2b-456a-88dd-7c2d1d339b7e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:32:00.447792980Z [2024-05-25 02:32:00,447: INFO/ForkPoolWorker-2] [5aae381b-6914-4dc9-bede-42c0037ba0c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:32:00.453154067Z [2024-05-25 02:32:00,452: INFO/ForkPoolWorker-1] [a8cd0c77-a7a0-4454-9fe4-9a4bc8e9ae65] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:32:00.727654977Z [2024-05-25 02:32:00,724: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:32:00.729721688Z [2024-05-25 02:32:00,725: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:32:00.758523461Z [2024-05-25 02:32:00,755: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:32:00.801277236Z [2024-05-25 02:32:00,796: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:32:00.922880369Z [2024-05-25 02:32:00,922: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T02:32:00.927163153Z [2024-05-25 02:32:00,926: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:32:00.956957273Z [2024-05-25 02:32:00,956: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:32:00.958667613Z [2024-05-25 02:32:00,958: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:32:00.958905921Z [2024-05-25 02:32:00,958: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:32:00.959074855Z [2024-05-25 02:32:00,958: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T02:32:00.959399921Z [2024-05-25 02:32:00,959: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:32:01.109149673Z [2024-05-25 02:32:01,108: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:32:01.110768870Z [2024-05-25 02:32:01,110: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:32:01.822708945Z [2024-05-25 02:32:01,822: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[643bb48e-eb2b-456a-88dd-7c2d1d339b7e] succeeded in 1.4084397799997532s: None 2024-05-25T02:32:01.874937312Z [2024-05-25 02:32:01,874: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5aae381b-6914-4dc9-bede-42c0037ba0c9] succeeded in 1.443668288000481s: None 2024-05-25T02:32:02.036055633Z [2024-05-25 02:32:02,035: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:32:02.039261780Z [2024-05-25 02:32:02,038: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:32:02.059206771Z [2024-05-25 02:32:02,058: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:32:02.060788657Z [2024-05-25 02:32:02,060: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:32:02.060904908Z [2024-05-25 02:32:02,060: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:32:02.061084583Z [2024-05-25 02:32:02,060: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:32:02.061262932Z [2024-05-25 02:32:02,061: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:32:02.061642845Z [2024-05-25 02:32:02,061: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:32:02.061765620Z [2024-05-25 02:32:02,061: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:32:02.108531252Z [2024-05-25 02:32:02,108: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:32:02.112056774Z [2024-05-25 02:32:02,111: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:32:02.137719140Z [2024-05-25 02:32:02,137: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:32:02.139030653Z [2024-05-25 02:32:02,138: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:32:02.139048268Z [2024-05-25 02:32:02,138: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:32:02.139196280Z [2024-05-25 02:32:02,139: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:32:02.139209330Z [2024-05-25 02:32:02,139: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:32:02.139464184Z [2024-05-25 02:32:02,139: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:32:02.139474978Z [2024-05-25 02:32:02,139: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:32:02.145543297Z [2024-05-25 02:32:02,145: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:32:02.339558044Z [2024-05-25 02:32:02,339: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:32:03.875977754Z [2024-05-25 02:32:03,874: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a8cd0c77-a7a0-4454-9fe4-9a4bc8e9ae65] succeeded in 3.4456294139999954s: None 2024-05-25T02:32:04.536518947Z [2024-05-25 02:32:04,534: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[426cd843-536c-4fe4-8bd3-9b894cbae468] succeeded in 4.11975418899965s: None 2024-05-25T02:33:01.296437868Z [2024-05-25 02:33:01,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63ca354d-e2d7-43d9-8fb6-45e57e47d02f] received 2024-05-25T02:33:01.298015566Z [2024-05-25 02:33:01,297: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e18a348-e0e0-44c9-9e48-661659a48b03] received 2024-05-25T02:33:01.306129673Z [2024-05-25 02:33:01,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb54f3b3-a42f-475b-98de-3def0bd8012a] received 2024-05-25T02:33:01.315882587Z [2024-05-25 02:33:01,315: INFO/ForkPoolWorker-1] [cb54f3b3-a42f-475b-98de-3def0bd8012a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:33:01.319663381Z [2024-05-25 02:33:01,319: INFO/ForkPoolWorker-16] [8e18a348-e0e0-44c9-9e48-661659a48b03] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:33:01.320477412Z [2024-05-25 02:33:01,320: INFO/ForkPoolWorker-15] [63ca354d-e2d7-43d9-8fb6-45e57e47d02f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:33:01.639930887Z [2024-05-25 02:33:01,636: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:33:01.668207933Z [2024-05-25 02:33:01,663: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:33:01.673207408Z [2024-05-25 02:33:01,669: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:33:01.822064039Z [2024-05-25 02:33:01,821: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T02:33:01.826096504Z [2024-05-25 02:33:01,825: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:33:01.848121853Z [2024-05-25 02:33:01,847: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:33:01.849346611Z [2024-05-25 02:33:01,849: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:33:01.849502673Z [2024-05-25 02:33:01,849: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:33:01.849595845Z [2024-05-25 02:33:01,849: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T02:33:01.849838950Z [2024-05-25 02:33:01,849: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:33:01.959556888Z [2024-05-25 02:33:01,959: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:33:02.585037533Z [2024-05-25 02:33:02,584: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cb54f3b3-a42f-475b-98de-3def0bd8012a] succeeded in 1.2745404520010197s: None 2024-05-25T02:33:02.866905133Z [2024-05-25 02:33:02,866: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:33:02.870114235Z [2024-05-25 02:33:02,869: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:33:02.898457923Z [2024-05-25 02:33:02,898: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:33:02.900809514Z [2024-05-25 02:33:02,900: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:33:02.900832210Z [2024-05-25 02:33:02,900: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:33:02.901252217Z [2024-05-25 02:33:02,900: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:33:02.901623024Z [2024-05-25 02:33:02,901: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:33:02.902449121Z [2024-05-25 02:33:02,902: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:33:02.902692795Z [2024-05-25 02:33:02,902: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:33:02.993872274Z [2024-05-25 02:33:02,993: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:33:03.017961416Z [2024-05-25 02:33:03,017: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:33:03.021479521Z [2024-05-25 02:33:03,020: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:33:03.042578901Z [2024-05-25 02:33:03,042: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:33:03.044095099Z [2024-05-25 02:33:03,043: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:33:03.044126211Z [2024-05-25 02:33:03,043: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:33:03.044168969Z [2024-05-25 02:33:03,043: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:33:03.044180194Z [2024-05-25 02:33:03,043: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:33:03.044408529Z [2024-05-25 02:33:03,044: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:33:03.044957752Z [2024-05-25 02:33:03,044: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:33:03.135415442Z [2024-05-25 02:33:03,135: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:33:05.150224547Z [2024-05-25 02:33:05,149: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8e18a348-e0e0-44c9-9e48-661659a48b03] succeeded in 3.8456774899987067s: None 2024-05-25T02:33:05.515607460Z [2024-05-25 02:33:05,514: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[63ca354d-e2d7-43d9-8fb6-45e57e47d02f] succeeded in 4.2149702530005015s: None 2024-05-25T02:34:01.202313626Z [2024-05-25 02:34:01,201: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fcbc4c50-4ccb-4294-9f27-9e3cea853436] received 2024-05-25T02:34:01.207981590Z [2024-05-25 02:34:01,207: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1a9760c-4e73-49b8-8514-b99108a327e5] received 2024-05-25T02:34:01.219639782Z [2024-05-25 02:34:01,219: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a55bfb13-3e2d-4a58-9a06-c69c91c9be6b] received 2024-05-25T02:34:01.223212051Z [2024-05-25 02:34:01,222: INFO/ForkPoolWorker-15] [fcbc4c50-4ccb-4294-9f27-9e3cea853436] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:34:01.224764846Z [2024-05-25 02:34:01,224: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76b7ed78-1dc8-4d83-a338-80c9fa6e7feb] received 2024-05-25T02:34:01.228847355Z [2024-05-25 02:34:01,228: INFO/ForkPoolWorker-16] [f1a9760c-4e73-49b8-8514-b99108a327e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:34:01.229752381Z [2024-05-25 02:34:01,229: INFO/ForkPoolWorker-1] [a55bfb13-3e2d-4a58-9a06-c69c91c9be6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:34:01.235978776Z [2024-05-25 02:34:01,235: INFO/ForkPoolWorker-2] [76b7ed78-1dc8-4d83-a338-80c9fa6e7feb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:34:01.587473016Z [2024-05-25 02:34:01,584: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:34:01.597816203Z [2024-05-25 02:34:01,594: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:34:01.597854229Z [2024-05-25 02:34:01,594: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:34:01.638005310Z [2024-05-25 02:34:01,634: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:34:01.743609223Z [2024-05-25 02:34:01,743: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T02:34:01.749202004Z [2024-05-25 02:34:01,748: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:34:01.781160671Z [2024-05-25 02:34:01,780: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:34:01.784097292Z [2024-05-25 02:34:01,783: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:34:01.784274768Z [2024-05-25 02:34:01,784: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:34:01.784349753Z [2024-05-25 02:34:01,784: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T02:34:01.784582198Z [2024-05-25 02:34:01,784: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:34:01.868491550Z [2024-05-25 02:34:01,868: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:34:01.877180738Z [2024-05-25 02:34:01,873: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:34:02.622615021Z [2024-05-25 02:34:02,621: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a55bfb13-3e2d-4a58-9a06-c69c91c9be6b] succeeded in 1.3999856209993595s: None 2024-05-25T02:34:02.654596101Z [2024-05-25 02:34:02,654: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f1a9760c-4e73-49b8-8514-b99108a327e5] succeeded in 1.4438015820014698s: None 2024-05-25T02:34:03.005074306Z [2024-05-25 02:34:03,004: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T02:34:03.009554508Z [2024-05-25 02:34:03,009: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:34:03.037653981Z [2024-05-25 02:34:03,037: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:34:03.039473559Z [2024-05-25 02:34:03,039: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:34:03.039694495Z [2024-05-25 02:34:03,039: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:34:03.039988309Z [2024-05-25 02:34:03,039: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:34:03.040166603Z [2024-05-25 02:34:03,040: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T02:34:03.040568592Z [2024-05-25 02:34:03,040: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:34:03.040861839Z [2024-05-25 02:34:03,040: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:34:03.128459627Z [2024-05-25 02:34:03,128: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:34:03.186670223Z [2024-05-25 02:34:03,186: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:34:03.190180282Z [2024-05-25 02:34:03,189: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:34:03.218497044Z [2024-05-25 02:34:03,218: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:34:03.219946802Z [2024-05-25 02:34:03,219: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:34:03.219981612Z [2024-05-25 02:34:03,219: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:34:03.220167391Z [2024-05-25 02:34:03,219: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:34:03.220220647Z [2024-05-25 02:34:03,220: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:34:03.220652515Z [2024-05-25 02:34:03,220: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:34:03.220731475Z [2024-05-25 02:34:03,220: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:34:03.313508117Z [2024-05-25 02:34:03,313: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:34:04.824199775Z [2024-05-25 02:34:04,823: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fcbc4c50-4ccb-4294-9f27-9e3cea853436] succeeded in 3.614079896999101s: None 2024-05-25T02:34:05.221127213Z [2024-05-25 02:34:05,220: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[76b7ed78-1dc8-4d83-a338-80c9fa6e7feb] succeeded in 3.9932408280001255s: None 2024-05-25T02:35:01.103574692Z [2024-05-25 02:35:01,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f79b8e1-bfd5-4c6c-bade-2466cf44d418] received 2024-05-25T02:35:01.109120071Z [2024-05-25 02:35:01,108: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12610a62-18f9-4197-9b13-ec2db93b3172] received 2024-05-25T02:35:01.112872685Z [2024-05-25 02:35:01,112: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70ed70c4-60bf-4fb4-8e1a-bcee1569f01c] received 2024-05-25T02:35:01.118998596Z [2024-05-25 02:35:01,118: INFO/ForkPoolWorker-16] [12610a62-18f9-4197-9b13-ec2db93b3172] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:35:01.124402865Z [2024-05-25 02:35:01,124: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d77a3fed-9399-4541-95b2-7cf6299527bb] received 2024-05-25T02:35:01.126351289Z [2024-05-25 02:35:01,125: INFO/ForkPoolWorker-1] [70ed70c4-60bf-4fb4-8e1a-bcee1569f01c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:35:01.128186229Z [2024-05-25 02:35:01,127: INFO/ForkPoolWorker-15] [4f79b8e1-bfd5-4c6c-bade-2466cf44d418] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:35:01.143649116Z [2024-05-25 02:35:01,143: INFO/ForkPoolWorker-2] [d77a3fed-9399-4541-95b2-7cf6299527bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:35:01.471955413Z [2024-05-25 02:35:01,465: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:35:01.542545347Z [2024-05-25 02:35:01,538: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:35:01.551645862Z [2024-05-25 02:35:01,544: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:35:01.699108197Z [2024-05-25 02:35:01,691: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:35:01.743975298Z [2024-05-25 02:35:01,743: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T02:35:01.749689475Z [2024-05-25 02:35:01,749: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:35:01.773531166Z [2024-05-25 02:35:01,773: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:35:01.774671298Z [2024-05-25 02:35:01,774: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:35:01.774742424Z [2024-05-25 02:35:01,774: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:35:01.774807327Z [2024-05-25 02:35:01,774: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T02:35:01.774980239Z [2024-05-25 02:35:01,774: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:35:01.881038927Z [2024-05-25 02:35:01,880: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:35:02.492869689Z [2024-05-25 02:35:02,492: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d77a3fed-9399-4541-95b2-7cf6299527bb] succeeded in 1.3657917029995588s: None 2024-05-25T02:35:02.817370511Z [2024-05-25 02:35:02,816: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:35:02.820577992Z [2024-05-25 02:35:02,820: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:35:02.840565383Z [2024-05-25 02:35:02,840: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:35:02.842327110Z [2024-05-25 02:35:02,842: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:35:02.842416012Z [2024-05-25 02:35:02,842: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:35:02.842575707Z [2024-05-25 02:35:02,842: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:35:02.842640288Z [2024-05-25 02:35:02,842: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:35:02.842901706Z [2024-05-25 02:35:02,842: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:35:02.842970741Z [2024-05-25 02:35:02,842: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:35:02.936802081Z [2024-05-25 02:35:02,936: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:35:03.034394249Z [2024-05-25 02:35:03,033: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:35:03.037606613Z [2024-05-25 02:35:03,037: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:35:03.065118827Z [2024-05-25 02:35:03,064: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:35:03.067552534Z [2024-05-25 02:35:03,067: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:35:03.067645313Z [2024-05-25 02:35:03,067: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:35:03.067812485Z [2024-05-25 02:35:03,067: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:35:03.067873933Z [2024-05-25 02:35:03,067: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:35:03.068214619Z [2024-05-25 02:35:03,068: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:35:03.068317783Z [2024-05-25 02:35:03,068: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:35:03.157229304Z [2024-05-25 02:35:03,156: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:35:03.178836543Z [2024-05-25 02:35:03,178: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:35:03.183172007Z [2024-05-25 02:35:03,182: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:35:03.214207931Z [2024-05-25 02:35:03,213: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:35:03.217174246Z [2024-05-25 02:35:03,216: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:35:03.217435847Z [2024-05-25 02:35:03,217: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:35:03.217761508Z [2024-05-25 02:35:03,217: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:35:03.217975459Z [2024-05-25 02:35:03,217: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:35:03.218536545Z [2024-05-25 02:35:03,218: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:35:03.218752384Z [2024-05-25 02:35:03,218: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:35:03.351048561Z [2024-05-25 02:35:03,350: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:35:03.844773369Z [2024-05-25 02:35:03,844: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4f79b8e1-bfd5-4c6c-bade-2466cf44d418] succeeded in 2.7314518309995037s: None 2024-05-25T02:35:04.014442094Z [2024-05-25 02:35:04,013: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eefa9eb2-8142-4246-b6b9-7b4fce582f15] received 2024-05-25T02:35:04.028465469Z [2024-05-25 02:35:04,028: INFO/ForkPoolWorker-15] [eefa9eb2-8142-4246-b6b9-7b4fce582f15] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:35:04.358497425Z [2024-05-25 02:35:04,355: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:35:04.462302397Z [2024-05-25 02:35:04,461: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[12610a62-18f9-4197-9b13-ec2db93b3172] succeeded in 3.3510650640000677s: None 2024-05-25T02:35:05.342618337Z [2024-05-25 02:35:05,342: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[70ed70c4-60bf-4fb4-8e1a-bcee1569f01c] succeeded in 4.226021594999111s: None 2024-05-25T02:35:05.455864806Z [2024-05-25 02:35:05,455: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:35:05.459118484Z [2024-05-25 02:35:05,458: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:35:05.482113300Z [2024-05-25 02:35:05,481: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:35:05.483491831Z [2024-05-25 02:35:05,483: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:35:05.483709364Z [2024-05-25 02:35:05,483: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:35:05.483825513Z [2024-05-25 02:35:05,483: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:35:05.483843330Z [2024-05-25 02:35:05,483: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:35:05.484077781Z [2024-05-25 02:35:05,483: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:35:05.484163737Z [2024-05-25 02:35:05,484: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:35:05.584828754Z [2024-05-25 02:35:05,584: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:35:06.305504039Z [2024-05-25 02:35:06,305: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eefa9eb2-8142-4246-b6b9-7b4fce582f15] succeeded in 2.289788686000975s: None 2024-05-25T02:35:06.686670040Z [2024-05-25 02:35:06,686: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b050cc9-91b8-4e68-8ebb-633433f9fba9] received 2024-05-25T02:35:06.698653360Z [2024-05-25 02:35:06,698: INFO/ForkPoolWorker-15] [8b050cc9-91b8-4e68-8ebb-633433f9fba9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T02:35:06.988739882Z [2024-05-25 02:35:06,985: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:35:08.210029985Z [2024-05-25 02:35:08,206: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:35:08.210406338Z [2024-05-25 02:35:08,209: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:35:08.234208631Z [2024-05-25 02:35:08,233: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:35:08.238278703Z [2024-05-25 02:35:08,237: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:35:08.238308304Z [2024-05-25 02:35:08,238: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:35:08.238429757Z [2024-05-25 02:35:08,238: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:35:08.238512483Z [2024-05-25 02:35:08,238: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:35:08.238824645Z [2024-05-25 02:35:08,238: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:35:08.238845704Z [2024-05-25 02:35:08,238: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:35:08.344860328Z [2024-05-25 02:35:08,344: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:35:09.923279012Z [2024-05-25 02:35:09,922: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8b050cc9-91b8-4e68-8ebb-633433f9fba9] succeeded in 3.234773291998863s: None 2024-05-25T02:35:10.177539162Z [2024-05-25 02:35:10,177: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5636ff6e-c161-4a3a-aa59-e59c5216c121] received 2024-05-25T02:35:10.188145391Z [2024-05-25 02:35:10,187: INFO/ForkPoolWorker-15] [5636ff6e-c161-4a3a-aa59-e59c5216c121] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:35:10.469206042Z [2024-05-25 02:35:10,465: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:35:11.587922276Z [2024-05-25 02:35:11,587: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:35:11.591154023Z [2024-05-25 02:35:11,590: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:35:11.616106013Z [2024-05-25 02:35:11,615: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:35:11.617650610Z [2024-05-25 02:35:11,617: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:35:11.617681458Z [2024-05-25 02:35:11,617: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:35:11.617962828Z [2024-05-25 02:35:11,617: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:35:11.618002655Z [2024-05-25 02:35:11,617: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:35:11.618342746Z [2024-05-25 02:35:11,618: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:35:11.618411309Z [2024-05-25 02:35:11,618: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:35:11.712468520Z [2024-05-25 02:35:11,712: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:35:12.376687725Z [2024-05-25 02:35:12,376: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5636ff6e-c161-4a3a-aa59-e59c5216c121] succeeded in 2.1957772040004784s: None 2024-05-25T02:36:01.074761506Z [2024-05-25 02:36:01,074: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[882e4230-af2e-499e-845e-79656be6f30b] received 2024-05-25T02:36:01.078164920Z [2024-05-25 02:36:01,077: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fcd658fc-58d8-428c-a1aa-812c8553a8b6] received 2024-05-25T02:36:01.081778388Z [2024-05-25 02:36:01,081: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba61475f-251d-430e-92d7-9547ae060240] received 2024-05-25T02:36:01.084063213Z [2024-05-25 02:36:01,083: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed0f7719-a1c6-414d-9a8f-f4d62dfb69e3] received 2024-05-25T02:36:01.090725578Z [2024-05-25 02:36:01,090: INFO/ForkPoolWorker-16] [fcd658fc-58d8-428c-a1aa-812c8553a8b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:36:01.091123785Z [2024-05-25 02:36:01,090: INFO/ForkPoolWorker-15] [882e4230-af2e-499e-845e-79656be6f30b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:36:01.091306056Z [2024-05-25 02:36:01,091: INFO/ForkPoolWorker-2] [ed0f7719-a1c6-414d-9a8f-f4d62dfb69e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:36:01.096875185Z [2024-05-25 02:36:01,096: INFO/ForkPoolWorker-1] [ba61475f-251d-430e-92d7-9547ae060240] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:36:01.450656826Z [2024-05-25 02:36:01,441: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:36:01.602690509Z [2024-05-25 02:36:01,599: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:36:01.618266564Z [2024-05-25 02:36:01,615: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:36:01.620139883Z [2024-05-25 02:36:01,616: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:36:01.760351235Z [2024-05-25 02:36:01,759: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T02:36:01.767082505Z [2024-05-25 02:36:01,766: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:36:01.777986198Z [2024-05-25 02:36:01,777: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:36:01.809869587Z [2024-05-25 02:36:01,809: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:36:01.811350174Z [2024-05-25 02:36:01,811: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:36:01.811440294Z [2024-05-25 02:36:01,811: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:36:01.813452969Z [2024-05-25 02:36:01,811: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T02:36:01.813716291Z [2024-05-25 02:36:01,813: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:36:01.912907250Z [2024-05-25 02:36:01,912: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:36:02.549338120Z [2024-05-25 02:36:02,548: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fcd658fc-58d8-428c-a1aa-812c8553a8b6] succeeded in 1.4678820409990294s: None 2024-05-25T02:36:02.700877394Z [2024-05-25 02:36:02,700: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ba61475f-251d-430e-92d7-9547ae060240] succeeded in 1.6154638810003235s: None 2024-05-25T02:36:02.883809912Z [2024-05-25 02:36:02,883: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T02:36:02.887072971Z [2024-05-25 02:36:02,886: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:36:02.904733608Z [2024-05-25 02:36:02,904: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:36:02.906368554Z [2024-05-25 02:36:02,906: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:36:02.906392205Z [2024-05-25 02:36:02,906: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:36:02.906542310Z [2024-05-25 02:36:02,906: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:36:02.906620017Z [2024-05-25 02:36:02,906: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T02:36:02.907179788Z [2024-05-25 02:36:02,906: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:36:02.907339786Z [2024-05-25 02:36:02,907: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:36:03.005988828Z [2024-05-25 02:36:03,005: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:36:03.145545110Z [2024-05-25 02:36:03,145: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:36:03.148775925Z [2024-05-25 02:36:03,148: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:36:03.168621555Z [2024-05-25 02:36:03,168: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:36:03.169866196Z [2024-05-25 02:36:03,169: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:36:03.169892063Z [2024-05-25 02:36:03,169: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:36:03.170014022Z [2024-05-25 02:36:03,169: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:36:03.170031912Z [2024-05-25 02:36:03,169: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:36:03.170261468Z [2024-05-25 02:36:03,170: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:36:03.170268004Z [2024-05-25 02:36:03,170: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:36:03.258904644Z [2024-05-25 02:36:03,258: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:36:04.814686011Z [2024-05-25 02:36:04,814: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[882e4230-af2e-499e-845e-79656be6f30b] succeeded in 3.7330050139989908s: None 2024-05-25T02:36:04.839585210Z [2024-05-25 02:36:04,839: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ed0f7719-a1c6-414d-9a8f-f4d62dfb69e3] succeeded in 3.754110996000236s: None 2024-05-25T02:37:00.959358205Z [2024-05-25 02:37:00,958: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a85983e9-8afe-4e10-9382-95bf445bff8f] received 2024-05-25T02:37:00.965776110Z [2024-05-25 02:37:00,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a49b41f9-14c4-4afc-82d1-8e91fbaf93a4] received 2024-05-25T02:37:00.985392484Z [2024-05-25 02:37:00,984: INFO/ForkPoolWorker-15] [a85983e9-8afe-4e10-9382-95bf445bff8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:37:00.996817320Z [2024-05-25 02:37:00,996: INFO/ForkPoolWorker-16] [a49b41f9-14c4-4afc-82d1-8e91fbaf93a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:37:01.213904772Z [2024-05-25 02:37:01,213: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1340fb2c-9b56-4083-851e-9376eba0c9f3] received 2024-05-25T02:37:01.226167006Z [2024-05-25 02:37:01,225: INFO/ForkPoolWorker-1] [1340fb2c-9b56-4083-851e-9376eba0c9f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:37:01.273472658Z [2024-05-25 02:37:01,270: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:37:01.281468657Z [2024-05-25 02:37:01,278: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:37:01.502149236Z [2024-05-25 02:37:01,501: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T02:37:01.506113493Z [2024-05-25 02:37:01,505: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:37:01.531968984Z [2024-05-25 02:37:01,531: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:37:01.533754947Z [2024-05-25 02:37:01,533: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:37:01.533801812Z [2024-05-25 02:37:01,533: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:37:01.534062335Z [2024-05-25 02:37:01,533: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T02:37:01.534137674Z [2024-05-25 02:37:01,534: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:37:01.543157950Z [2024-05-25 02:37:01,539: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:37:01.646798284Z [2024-05-25 02:37:01,646: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:37:02.216387050Z [2024-05-25 02:37:02,209: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a49b41f9-14c4-4afc-82d1-8e91fbaf93a4] succeeded in 1.2418811699990329s: None 2024-05-25T02:37:02.470330777Z [2024-05-25 02:37:02,467: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:37:02.472903643Z [2024-05-25 02:37:02,471: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:37:02.525087594Z [2024-05-25 02:37:02,523: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:37:02.527144764Z [2024-05-25 02:37:02,526: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:37:02.527238116Z [2024-05-25 02:37:02,527: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:37:02.527380244Z [2024-05-25 02:37:02,527: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:37:02.527497181Z [2024-05-25 02:37:02,527: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:37:02.527713960Z [2024-05-25 02:37:02,527: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:37:02.527865349Z [2024-05-25 02:37:02,527: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:37:02.643681765Z [2024-05-25 02:37:02,643: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:37:02.735854462Z [2024-05-25 02:37:02,735: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:37:02.739062194Z [2024-05-25 02:37:02,738: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:37:02.762530558Z [2024-05-25 02:37:02,762: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:37:02.764060636Z [2024-05-25 02:37:02,763: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:37:02.764078828Z [2024-05-25 02:37:02,763: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:37:02.764440457Z [2024-05-25 02:37:02,764: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:37:02.764464861Z [2024-05-25 02:37:02,764: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:37:02.764793085Z [2024-05-25 02:37:02,764: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:37:02.764805632Z [2024-05-25 02:37:02,764: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:37:02.863868771Z [2024-05-25 02:37:02,863: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:37:04.496889954Z [2024-05-25 02:37:04,495: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a85983e9-8afe-4e10-9382-95bf445bff8f] succeeded in 3.5340122810011962s: None 2024-05-25T02:37:05.222353004Z [2024-05-25 02:37:05,221: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1340fb2c-9b56-4083-851e-9376eba0c9f3] succeeded in 4.006607037999856s: None 2024-05-25T02:38:01.025236412Z [2024-05-25 02:38:01,024: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[617aa222-80d5-4211-a6da-3e853360d3d7] received 2024-05-25T02:38:01.028662276Z [2024-05-25 02:38:01,028: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22df08dd-ffb0-43f6-9488-edbcf0ce727f] received 2024-05-25T02:38:01.048229381Z [2024-05-25 02:38:01,047: INFO/ForkPoolWorker-15] [617aa222-80d5-4211-a6da-3e853360d3d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:38:01.052744387Z [2024-05-25 02:38:01,052: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51b8b3e6-5efa-4240-afce-e4b31ec4e662] received 2024-05-25T02:38:01.055990171Z [2024-05-25 02:38:01,055: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd4003c7-2531-4726-9b4e-928317563694] received 2024-05-25T02:38:01.061769880Z [2024-05-25 02:38:01,061: INFO/ForkPoolWorker-16] [22df08dd-ffb0-43f6-9488-edbcf0ce727f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:38:01.073346003Z [2024-05-25 02:38:01,072: INFO/ForkPoolWorker-1] [51b8b3e6-5efa-4240-afce-e4b31ec4e662] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:38:01.075594034Z [2024-05-25 02:38:01,075: INFO/ForkPoolWorker-2] [fd4003c7-2531-4726-9b4e-928317563694] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:38:01.375159991Z [2024-05-25 02:38:01,369: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:38:01.449231911Z [2024-05-25 02:38:01,445: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:38:01.481788902Z [2024-05-25 02:38:01,471: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:38:01.517505876Z [2024-05-25 02:38:01,512: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:38:01.665730489Z [2024-05-25 02:38:01,665: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:38:01.758126990Z [2024-05-25 02:38:01,757: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T02:38:01.762674040Z [2024-05-25 02:38:01,762: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:38:01.791730151Z [2024-05-25 02:38:01,791: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:38:01.792917542Z [2024-05-25 02:38:01,792: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:38:01.793074219Z [2024-05-25 02:38:01,792: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:38:01.793173626Z [2024-05-25 02:38:01,793: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T02:38:01.793458085Z [2024-05-25 02:38:01,793: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:38:01.911987462Z [2024-05-25 02:38:01,911: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:38:02.303665133Z [2024-05-25 02:38:02,303: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[617aa222-80d5-4211-a6da-3e853360d3d7] succeeded in 1.2717674530013028s: None 2024-05-25T02:38:02.649448516Z [2024-05-25 02:38:02,648: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[51b8b3e6-5efa-4240-afce-e4b31ec4e662] succeeded in 1.5938495679984044s: None 2024-05-25T02:38:02.921559867Z [2024-05-25 02:38:02,921: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:38:02.924616544Z [2024-05-25 02:38:02,924: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:38:02.953878476Z [2024-05-25 02:38:02,953: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:38:02.955539552Z [2024-05-25 02:38:02,955: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:38:02.955569754Z [2024-05-25 02:38:02,955: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:38:02.955765876Z [2024-05-25 02:38:02,955: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:38:02.955812713Z [2024-05-25 02:38:02,955: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:38:02.956988183Z [2024-05-25 02:38:02,956: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:38:02.957036936Z [2024-05-25 02:38:02,956: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:38:03.040663901Z [2024-05-25 02:38:03,040: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:38:03.051289300Z [2024-05-25 02:38:03,050: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T02:38:03.061935765Z [2024-05-25 02:38:03,060: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:38:03.104792506Z [2024-05-25 02:38:03,104: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:38:03.107092732Z [2024-05-25 02:38:03,106: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:38:03.108579880Z [2024-05-25 02:38:03,108: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:38:03.108860979Z [2024-05-25 02:38:03,108: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:38:03.109024625Z [2024-05-25 02:38:03,108: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T02:38:03.109603299Z [2024-05-25 02:38:03,109: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:38:03.109775545Z [2024-05-25 02:38:03,109: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:38:03.201144742Z [2024-05-25 02:38:03,200: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:38:05.035404742Z [2024-05-25 02:38:05,034: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[22df08dd-ffb0-43f6-9488-edbcf0ce727f] succeeded in 3.9878478230002656s: None 2024-05-25T02:38:05.806234147Z [2024-05-25 02:38:05,805: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fd4003c7-2531-4726-9b4e-928317563694] succeeded in 4.746894395000709s: None 2024-05-25T02:39:00.768996589Z [2024-05-25 02:39:00,768: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5eafe5d5-a905-4c2e-ad09-1c96704d3088] received 2024-05-25T02:39:00.776850229Z [2024-05-25 02:39:00,776: INFO/ForkPoolWorker-15] [5eafe5d5-a905-4c2e-ad09-1c96704d3088] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:39:00.782375400Z [2024-05-25 02:39:00,782: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83621832-52ea-418e-8c7f-0bba6f706c25] received 2024-05-25T02:39:00.788755974Z [2024-05-25 02:39:00,788: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba5fb056-478a-437c-8562-2bb8e6a82541] received 2024-05-25T02:39:00.789450054Z [2024-05-25 02:39:00,789: INFO/ForkPoolWorker-16] [83621832-52ea-418e-8c7f-0bba6f706c25] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:39:00.800904763Z [2024-05-25 02:39:00,800: INFO/ForkPoolWorker-1] [ba5fb056-478a-437c-8562-2bb8e6a82541] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:39:01.044465944Z [2024-05-25 02:39:01,041: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:39:01.104848902Z [2024-05-25 02:39:01,101: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:39:01.128983680Z [2024-05-25 02:39:01,125: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:39:01.289608598Z [2024-05-25 02:39:01,289: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T02:39:01.293626534Z [2024-05-25 02:39:01,293: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:39:01.324868111Z [2024-05-25 02:39:01,324: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:39:01.332193913Z [2024-05-25 02:39:01,331: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:39:01.332534310Z [2024-05-25 02:39:01,332: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:39:01.332785168Z [2024-05-25 02:39:01,332: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T02:39:01.337399229Z [2024-05-25 02:39:01,333: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:39:01.459468954Z [2024-05-25 02:39:01,459: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:39:02.052565258Z [2024-05-25 02:39:02,052: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ba5fb056-478a-437c-8562-2bb8e6a82541] succeeded in 1.2562859039990144s: None 2024-05-25T02:39:02.205359942Z [2024-05-25 02:39:02,193: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:39:02.205385696Z [2024-05-25 02:39:02,201: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:39:02.240197504Z [2024-05-25 02:39:02,239: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:39:02.241445408Z [2024-05-25 02:39:02,241: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:39:02.241534193Z [2024-05-25 02:39:02,241: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:39:02.242307331Z [2024-05-25 02:39:02,241: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:39:02.242317313Z [2024-05-25 02:39:02,241: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:39:02.242321260Z [2024-05-25 02:39:02,241: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:39:02.242324529Z [2024-05-25 02:39:02,241: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:39:02.361301215Z [2024-05-25 02:39:02,361: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:39:02.372275321Z [2024-05-25 02:39:02,371: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:39:02.375992580Z [2024-05-25 02:39:02,374: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:39:02.398055971Z [2024-05-25 02:39:02,397: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:39:02.399184903Z [2024-05-25 02:39:02,399: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:39:02.399294497Z [2024-05-25 02:39:02,399: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:39:02.399458394Z [2024-05-25 02:39:02,399: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:39:02.399555836Z [2024-05-25 02:39:02,399: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:39:02.399828598Z [2024-05-25 02:39:02,399: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:39:02.399923000Z [2024-05-25 02:39:02,399: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:39:02.477751783Z [2024-05-25 02:39:02,477: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:39:03.881412455Z [2024-05-25 02:39:03,880: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[83621832-52ea-418e-8c7f-0bba6f706c25] succeeded in 3.097160024999539s: None 2024-05-25T02:39:04.096542368Z [2024-05-25 02:39:04,095: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5eafe5d5-a905-4c2e-ad09-1c96704d3088] succeeded in 3.3256106809985795s: None 2024-05-25T02:40:01.255864825Z [2024-05-25 02:40:01,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[767ca9bd-ac84-4e44-b2e6-2be427f4f9ba] received 2024-05-25T02:40:01.259457132Z [2024-05-25 02:40:01,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0437ddec-f6a7-42ed-8081-6ce3c26c1aef] received 2024-05-25T02:40:01.263967758Z [2024-05-25 02:40:01,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3000422c-7bcd-44f0-9199-3ce7433fbb60] received 2024-05-25T02:40:01.267119490Z [2024-05-25 02:40:01,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[003b3773-be6c-4415-b494-06de4efe5c19] received 2024-05-25T02:40:01.273945854Z [2024-05-25 02:40:01,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27c64032-1435-46fd-a7d1-cb8c7355465a] received 2024-05-25T02:40:01.285949675Z [2024-05-25 02:40:01,285: INFO/ForkPoolWorker-15] [767ca9bd-ac84-4e44-b2e6-2be427f4f9ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:40:01.288240480Z [2024-05-25 02:40:01,287: INFO/ForkPoolWorker-2] [003b3773-be6c-4415-b494-06de4efe5c19] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:40:01.289904687Z [2024-05-25 02:40:01,289: INFO/ForkPoolWorker-1] [3000422c-7bcd-44f0-9199-3ce7433fbb60] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:40:01.292011078Z [2024-05-25 02:40:01,291: INFO/ForkPoolWorker-16] [0437ddec-f6a7-42ed-8081-6ce3c26c1aef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:40:01.293554912Z [2024-05-25 02:40:01,293: INFO/ForkPoolWorker-3] [27c64032-1435-46fd-a7d1-cb8c7355465a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:40:01.620895420Z [2024-05-25 02:40:01,616: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:40:01.682014008Z [2024-05-25 02:40:01,676: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:40:01.718403102Z [2024-05-25 02:40:01,715: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:40:01.851683843Z [2024-05-25 02:40:01,847: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:40:01.905476173Z [2024-05-25 02:40:01,883: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:40:01.975893448Z [2024-05-25 02:40:01,975: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:40:02.272404216Z [2024-05-25 02:40:02,272: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T02:40:02.280039037Z [2024-05-25 02:40:02,279: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:40:02.354188504Z [2024-05-25 02:40:02,353: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:40:02.357910859Z [2024-05-25 02:40:02,357: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:40:02.358014444Z [2024-05-25 02:40:02,357: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:40:02.358074745Z [2024-05-25 02:40:02,357: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T02:40:02.358355734Z [2024-05-25 02:40:02,358: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:40:02.448190128Z [2024-05-25 02:40:02,447: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:40:02.758107532Z [2024-05-25 02:40:02,757: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[27c64032-1435-46fd-a7d1-cb8c7355465a] succeeded in 1.4816228590007086s: None 2024-05-25T02:40:02.980227732Z [2024-05-25 02:40:02,979: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3000422c-7bcd-44f0-9199-3ce7433fbb60] succeeded in 1.713237689999005s: None 2024-05-25T02:40:03.283992564Z [2024-05-25 02:40:03,283: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T02:40:03.287121881Z [2024-05-25 02:40:03,286: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:40:03.291688434Z [2024-05-25 02:40:03,291: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:40:03.295347598Z [2024-05-25 02:40:03,294: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:40:03.308173140Z [2024-05-25 02:40:03,307: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:40:03.311008182Z [2024-05-25 02:40:03,310: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:40:03.311392300Z [2024-05-25 02:40:03,311: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:40:03.311542932Z [2024-05-25 02:40:03,311: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:40:03.311619376Z [2024-05-25 02:40:03,311: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T02:40:03.312102802Z [2024-05-25 02:40:03,311: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:40:03.312224611Z [2024-05-25 02:40:03,312: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:40:03.322911316Z [2024-05-25 02:40:03,322: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:40:03.326090981Z [2024-05-25 02:40:03,325: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:40:03.327181777Z [2024-05-25 02:40:03,326: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:40:03.327783530Z [2024-05-25 02:40:03,327: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:40:03.328542091Z [2024-05-25 02:40:03,327: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:40:03.328883447Z [2024-05-25 02:40:03,328: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:40:03.329471143Z [2024-05-25 02:40:03,329: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:40:03.354009498Z [2024-05-25 02:40:03,353: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:40:03.358851192Z [2024-05-25 02:40:03,358: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:40:03.377614255Z [2024-05-25 02:40:03,377: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:40:03.379583141Z [2024-05-25 02:40:03,379: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:40:03.379868493Z [2024-05-25 02:40:03,379: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:40:03.380158895Z [2024-05-25 02:40:03,379: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:40:03.380402371Z [2024-05-25 02:40:03,380: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:40:03.380858003Z [2024-05-25 02:40:03,380: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:40:03.381086572Z [2024-05-25 02:40:03,380: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:40:03.390714636Z [2024-05-25 02:40:03,390: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:40:03.452446030Z [2024-05-25 02:40:03,452: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:40:03.465164575Z [2024-05-25 02:40:03,464: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:40:04.140785053Z [2024-05-25 02:40:04,140: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[003b3773-be6c-4415-b494-06de4efe5c19] succeeded in 2.8712830700005725s: None 2024-05-25T02:40:04.273147823Z [2024-05-25 02:40:04,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bdca2304-9287-484c-b1e7-7489aef2deaf] received 2024-05-25T02:40:04.286431910Z [2024-05-25 02:40:04,285: INFO/ForkPoolWorker-1] [bdca2304-9287-484c-b1e7-7489aef2deaf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:40:04.644666410Z [2024-05-25 02:40:04,641: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:40:05.080486438Z [2024-05-25 02:40:05,079: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0437ddec-f6a7-42ed-8081-6ce3c26c1aef] succeeded in 3.8158827500010375s: None 2024-05-25T02:40:05.329340767Z [2024-05-25 02:40:05,328: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[767ca9bd-ac84-4e44-b2e6-2be427f4f9ba] succeeded in 4.070984420999594s: None 2024-05-25T02:40:05.795497157Z [2024-05-25 02:40:05,794: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:40:05.798158955Z [2024-05-25 02:40:05,797: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:40:05.824377350Z [2024-05-25 02:40:05,824: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:40:05.825963721Z [2024-05-25 02:40:05,825: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:40:05.826038457Z [2024-05-25 02:40:05,825: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:40:05.826201456Z [2024-05-25 02:40:05,825: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:40:05.826215099Z [2024-05-25 02:40:05,826: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:40:05.826471799Z [2024-05-25 02:40:05,826: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:40:05.826591706Z [2024-05-25 02:40:05,826: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:40:05.919979408Z [2024-05-25 02:40:05,919: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:40:06.610053316Z [2024-05-25 02:40:06,609: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bdca2304-9287-484c-b1e7-7489aef2deaf] succeeded in 2.3340032169999176s: None 2024-05-25T02:40:06.732363075Z [2024-05-25 02:40:06,731: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b196632-8895-4331-a5d2-6390fd046c11] received 2024-05-25T02:40:06.745382613Z [2024-05-25 02:40:06,745: INFO/ForkPoolWorker-15] [4b196632-8895-4331-a5d2-6390fd046c11] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T02:40:07.024017833Z [2024-05-25 02:40:07,020: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:40:08.176504413Z [2024-05-25 02:40:08,176: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:40:08.179727601Z [2024-05-25 02:40:08,179: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:40:08.203717190Z [2024-05-25 02:40:08,203: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:40:08.206414958Z [2024-05-25 02:40:08,206: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:40:08.206433342Z [2024-05-25 02:40:08,206: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:40:08.206538526Z [2024-05-25 02:40:08,206: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:40:08.206580971Z [2024-05-25 02:40:08,206: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:40:08.206825393Z [2024-05-25 02:40:08,206: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:40:08.206830205Z [2024-05-25 02:40:08,206: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:40:08.300616426Z [2024-05-25 02:40:08,300: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:40:09.850027496Z [2024-05-25 02:40:09,849: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4b196632-8895-4331-a5d2-6390fd046c11] succeeded in 3.1147345839999616s: None 2024-05-25T02:40:10.101412668Z [2024-05-25 02:40:10,101: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07cd20e1-9be0-4e80-8bdc-cfcb69f0a3cb] received 2024-05-25T02:40:10.112385848Z [2024-05-25 02:40:10,112: INFO/ForkPoolWorker-15] [07cd20e1-9be0-4e80-8bdc-cfcb69f0a3cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:40:10.389459017Z [2024-05-25 02:40:10,385: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:40:11.456678008Z [2024-05-25 02:40:11,456: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:40:11.459715168Z [2024-05-25 02:40:11,459: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:40:11.493949543Z [2024-05-25 02:40:11,493: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:40:11.497657341Z [2024-05-25 02:40:11,497: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:40:11.497686855Z [2024-05-25 02:40:11,497: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:40:11.497778385Z [2024-05-25 02:40:11,497: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:40:11.497815166Z [2024-05-25 02:40:11,497: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:40:11.498028409Z [2024-05-25 02:40:11,497: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:40:11.498044466Z [2024-05-25 02:40:11,497: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:40:11.586417506Z [2024-05-25 02:40:11,586: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:40:12.142604379Z [2024-05-25 02:40:12,141: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[07cd20e1-9be0-4e80-8bdc-cfcb69f0a3cb] succeeded in 2.0391128589999425s: None 2024-05-25T02:41:00.571344877Z [2024-05-25 02:41:00,570: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[40583891-ab18-466c-802e-51f4fc9cfaab] received 2024-05-25T02:41:00.573359932Z [2024-05-25 02:41:00,573: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[359a6d2c-c6b6-4c40-817a-b4299f383c47] received 2024-05-25T02:41:00.574489455Z [2024-05-25 02:41:00,574: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a93c7f89-2633-43f0-8135-ac15b0f8ad00] received 2024-05-25T02:41:00.584634235Z [2024-05-25 02:41:00,584: INFO/ForkPoolWorker-15] [40583891-ab18-466c-802e-51f4fc9cfaab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:41:00.586050463Z [2024-05-25 02:41:00,585: INFO/ForkPoolWorker-1] [a93c7f89-2633-43f0-8135-ac15b0f8ad00] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:41:00.589861336Z [2024-05-25 02:41:00,589: INFO/ForkPoolWorker-16] [359a6d2c-c6b6-4c40-817a-b4299f383c47] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:41:00.869834718Z [2024-05-25 02:41:00,866: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:41:00.892263562Z [2024-05-25 02:41:00,889: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:41:00.893626771Z [2024-05-25 02:41:00,890: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:41:01.056025786Z [2024-05-25 02:41:01,055: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T02:41:01.059914267Z [2024-05-25 02:41:01,059: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:41:01.085955475Z [2024-05-25 02:41:01,085: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:41:01.087197579Z [2024-05-25 02:41:01,086: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:41:01.087333665Z [2024-05-25 02:41:01,087: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:41:01.087462566Z [2024-05-25 02:41:01,087: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T02:41:01.087728729Z [2024-05-25 02:41:01,087: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:41:01.177337604Z [2024-05-25 02:41:01,177: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:41:01.781156910Z [2024-05-25 02:41:01,780: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[359a6d2c-c6b6-4c40-817a-b4299f383c47] succeeded in 1.2044474839985924s: None 2024-05-25T02:41:01.979996922Z [2024-05-25 02:41:01,979: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:41:01.983160316Z [2024-05-25 02:41:01,982: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:41:02.012080486Z [2024-05-25 02:41:02,011: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:41:02.013548585Z [2024-05-25 02:41:02,013: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:41:02.013574390Z [2024-05-25 02:41:02,013: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:41:02.013813977Z [2024-05-25 02:41:02,013: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:41:02.013896248Z [2024-05-25 02:41:02,013: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:41:02.014183821Z [2024-05-25 02:41:02,013: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:41:02.014202999Z [2024-05-25 02:41:02,014: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:41:02.090429577Z [2024-05-25 02:41:02,090: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:41:02.106803752Z [2024-05-25 02:41:02,106: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:41:02.109963477Z [2024-05-25 02:41:02,109: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:41:02.127812965Z [2024-05-25 02:41:02,127: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:41:02.128963203Z [2024-05-25 02:41:02,128: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:41:02.128978294Z [2024-05-25 02:41:02,128: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:41:02.129160929Z [2024-05-25 02:41:02,128: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:41:02.129180565Z [2024-05-25 02:41:02,129: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:41:02.129509034Z [2024-05-25 02:41:02,129: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:41:02.129669483Z [2024-05-25 02:41:02,129: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:41:02.258408445Z [2024-05-25 02:41:02,258: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:41:03.799354060Z [2024-05-25 02:41:03,798: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a93c7f89-2633-43f0-8135-ac15b0f8ad00] succeeded in 3.223642118000498s: None 2024-05-25T02:41:03.912561916Z [2024-05-25 02:41:03,912: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[40583891-ab18-466c-802e-51f4fc9cfaab] succeeded in 3.338750312999764s: None 2024-05-25T02:42:01.046223291Z [2024-05-25 02:42:01,045: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[363d5061-07e3-45f8-8d20-fd955a480274] received 2024-05-25T02:42:01.050634987Z [2024-05-25 02:42:01,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e05b1fc-a520-45b9-ae96-ce66c66023dc] received 2024-05-25T02:42:01.052724107Z [2024-05-25 02:42:01,052: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5effa40b-8bf9-48cf-b857-e183a1bd5a5c] received 2024-05-25T02:42:01.054674395Z [2024-05-25 02:42:01,054: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11cf07e0-8a62-415a-8bef-a48ac1139c4b] received 2024-05-25T02:42:01.055450465Z [2024-05-25 02:42:01,055: INFO/ForkPoolWorker-15] [363d5061-07e3-45f8-8d20-fd955a480274] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:42:01.060988818Z [2024-05-25 02:42:01,060: INFO/ForkPoolWorker-1] [5effa40b-8bf9-48cf-b857-e183a1bd5a5c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:42:01.067098902Z [2024-05-25 02:42:01,066: INFO/ForkPoolWorker-16] [0e05b1fc-a520-45b9-ae96-ce66c66023dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:42:01.068762761Z [2024-05-25 02:42:01,068: INFO/ForkPoolWorker-2] [11cf07e0-8a62-415a-8bef-a48ac1139c4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:42:01.384761990Z [2024-05-25 02:42:01,375: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:42:01.409474969Z [2024-05-25 02:42:01,402: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:42:01.510005228Z [2024-05-25 02:42:01,505: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:42:01.588965832Z [2024-05-25 02:42:01,586: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:42:01.674465699Z [2024-05-25 02:42:01,673: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T02:42:01.678518898Z [2024-05-25 02:42:01,678: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:42:01.714243625Z [2024-05-25 02:42:01,713: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:42:01.720842653Z [2024-05-25 02:42:01,720: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:42:01.722003260Z [2024-05-25 02:42:01,721: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:42:01.722121803Z [2024-05-25 02:42:01,721: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:42:01.722192804Z [2024-05-25 02:42:01,722: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T02:42:01.722422868Z [2024-05-25 02:42:01,722: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:42:01.836353274Z [2024-05-25 02:42:01,836: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:42:02.269359359Z [2024-05-25 02:42:02,262: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[363d5061-07e3-45f8-8d20-fd955a480274] succeeded in 1.2143766320004943s: None 2024-05-25T02:42:02.450536248Z [2024-05-25 02:42:02,450: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[11cf07e0-8a62-415a-8bef-a48ac1139c4b] succeeded in 1.392998772998908s: None 2024-05-25T02:42:02.732359833Z [2024-05-25 02:42:02,732: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:42:02.735781808Z [2024-05-25 02:42:02,735: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:42:02.768331987Z [2024-05-25 02:42:02,768: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:42:02.769602851Z [2024-05-25 02:42:02,769: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:42:02.769620428Z [2024-05-25 02:42:02,769: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:42:02.769731593Z [2024-05-25 02:42:02,769: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:42:02.769763010Z [2024-05-25 02:42:02,769: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:42:02.770004097Z [2024-05-25 02:42:02,769: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:42:02.770011913Z [2024-05-25 02:42:02,769: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:42:02.857589775Z [2024-05-25 02:42:02,857: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:42:02.943469102Z [2024-05-25 02:42:02,943: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:42:02.946854559Z [2024-05-25 02:42:02,946: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:42:02.975796961Z [2024-05-25 02:42:02,975: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:42:02.977523928Z [2024-05-25 02:42:02,977: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:42:02.977657019Z [2024-05-25 02:42:02,977: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:42:02.977829171Z [2024-05-25 02:42:02,977: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:42:02.977911175Z [2024-05-25 02:42:02,977: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:42:02.978228188Z [2024-05-25 02:42:02,978: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:42:02.978320803Z [2024-05-25 02:42:02,978: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:42:03.083737561Z [2024-05-25 02:42:03,083: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:42:04.583824146Z [2024-05-25 02:42:04,583: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5effa40b-8bf9-48cf-b857-e183a1bd5a5c] succeeded in 3.529126814999472s: None 2024-05-25T02:42:05.006645747Z [2024-05-25 02:42:05,005: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0e05b1fc-a520-45b9-ae96-ce66c66023dc] succeeded in 3.948685805000423s: None 2024-05-25T02:43:00.442474791Z [2024-05-25 02:43:00,441: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0dc8554e-8965-4b6b-a74f-9e83ac4aa09b] received 2024-05-25T02:43:00.449893139Z [2024-05-25 02:43:00,449: INFO/ForkPoolWorker-15] [0dc8554e-8965-4b6b-a74f-9e83ac4aa09b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:43:00.455102677Z [2024-05-25 02:43:00,454: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a8679a9c-1a1f-40ad-a932-147191a0cba5] received 2024-05-25T02:43:00.461480029Z [2024-05-25 02:43:00,461: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a72897e8-0ba2-42b6-bc94-8371fe1e6c39] received 2024-05-25T02:43:00.476852214Z [2024-05-25 02:43:00,476: INFO/ForkPoolWorker-16] [a8679a9c-1a1f-40ad-a932-147191a0cba5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:43:00.497132386Z [2024-05-25 02:43:00,496: INFO/ForkPoolWorker-1] [a72897e8-0ba2-42b6-bc94-8371fe1e6c39] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:43:00.777884283Z [2024-05-25 02:43:00,774: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:43:00.783113881Z [2024-05-25 02:43:00,780: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:43:00.818191690Z [2024-05-25 02:43:00,813: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:43:00.927030226Z [2024-05-25 02:43:00,926: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T02:43:00.930883495Z [2024-05-25 02:43:00,930: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:43:00.954160767Z [2024-05-25 02:43:00,953: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:43:00.955242320Z [2024-05-25 02:43:00,955: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:43:00.955373912Z [2024-05-25 02:43:00,955: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:43:00.955449948Z [2024-05-25 02:43:00,955: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T02:43:00.955741652Z [2024-05-25 02:43:00,955: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:43:01.072529401Z [2024-05-25 02:43:01,072: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:43:01.684477407Z [2024-05-25 02:43:01,683: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0dc8554e-8965-4b6b-a74f-9e83ac4aa09b] succeeded in 1.2399514640001144s: None 2024-05-25T02:43:01.956162135Z [2024-05-25 02:43:01,955: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:43:01.959419608Z [2024-05-25 02:43:01,958: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:43:01.981300378Z [2024-05-25 02:43:01,981: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:43:01.984334131Z [2024-05-25 02:43:01,984: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:43:01.984407680Z [2024-05-25 02:43:01,984: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:43:01.984540879Z [2024-05-25 02:43:01,984: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:43:01.984616982Z [2024-05-25 02:43:01,984: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:43:01.984907944Z [2024-05-25 02:43:01,984: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:43:01.984949094Z [2024-05-25 02:43:01,984: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:43:02.099991825Z [2024-05-25 02:43:02,099: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:43:02.288865307Z [2024-05-25 02:43:02,288: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:43:02.292658331Z [2024-05-25 02:43:02,292: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:43:02.322844116Z [2024-05-25 02:43:02,322: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:43:02.324099710Z [2024-05-25 02:43:02,323: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:43:02.324404279Z [2024-05-25 02:43:02,324: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:43:02.324546222Z [2024-05-25 02:43:02,324: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:43:02.324616854Z [2024-05-25 02:43:02,324: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:43:02.324845546Z [2024-05-25 02:43:02,324: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:43:02.324922019Z [2024-05-25 02:43:02,324: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:43:02.430821970Z [2024-05-25 02:43:02,430: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:43:04.131271370Z [2024-05-25 02:43:04,130: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a8679a9c-1a1f-40ad-a932-147191a0cba5] succeeded in 3.672601632999431s: None 2024-05-25T02:43:04.505133690Z [2024-05-25 02:43:04,504: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a72897e8-0ba2-42b6-bc94-8371fe1e6c39] succeeded in 4.038554965000003s: None 2024-05-25T02:44:01.038827097Z [2024-05-25 02:44:01,038: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[458118ee-05f8-4032-a983-ac7787256af4] received 2024-05-25T02:44:01.041731645Z [2024-05-25 02:44:01,041: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21973d4c-4a76-497d-8ebf-e1fb74accfe1] received 2024-05-25T02:44:01.048278696Z [2024-05-25 02:44:01,047: INFO/ForkPoolWorker-15] [458118ee-05f8-4032-a983-ac7787256af4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:44:01.049984294Z [2024-05-25 02:44:01,049: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[98e8b682-4291-4dbf-9d4a-df2429bd750c] received 2024-05-25T02:44:01.054534089Z [2024-05-25 02:44:01,054: INFO/ForkPoolWorker-16] [21973d4c-4a76-497d-8ebf-e1fb74accfe1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:44:01.059945349Z [2024-05-25 02:44:01,059: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[542ac28b-78ca-4d6d-9af3-0970a5ac8f8c] received 2024-05-25T02:44:01.060609607Z [2024-05-25 02:44:01,060: INFO/ForkPoolWorker-1] [98e8b682-4291-4dbf-9d4a-df2429bd750c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:44:01.095488922Z [2024-05-25 02:44:01,095: INFO/ForkPoolWorker-2] [542ac28b-78ca-4d6d-9af3-0970a5ac8f8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:44:01.405317088Z [2024-05-25 02:44:01,400: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:44:01.459162279Z [2024-05-25 02:44:01,455: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:44:01.493896907Z [2024-05-25 02:44:01,486: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:44:01.577533049Z [2024-05-25 02:44:01,572: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:44:01.608505895Z [2024-05-25 02:44:01,607: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T02:44:01.612296306Z [2024-05-25 02:44:01,611: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:44:01.642312461Z [2024-05-25 02:44:01,642: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:44:01.646017566Z [2024-05-25 02:44:01,645: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:44:01.646328405Z [2024-05-25 02:44:01,645: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:44:01.646466332Z [2024-05-25 02:44:01,646: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T02:44:01.646729170Z [2024-05-25 02:44:01,646: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:44:01.757614581Z [2024-05-25 02:44:01,757: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:44:01.785290404Z [2024-05-25 02:44:01,785: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:44:02.433385730Z [2024-05-25 02:44:02,432: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[21973d4c-4a76-497d-8ebf-e1fb74accfe1] succeeded in 1.3892222109989234s: None 2024-05-25T02:44:02.440627813Z [2024-05-25 02:44:02,440: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[98e8b682-4291-4dbf-9d4a-df2429bd750c] succeeded in 1.3860524690007878s: None 2024-05-25T02:44:02.879841320Z [2024-05-25 02:44:02,879: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T02:44:02.883058393Z [2024-05-25 02:44:02,882: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:44:02.906008667Z [2024-05-25 02:44:02,905: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:44:02.907684438Z [2024-05-25 02:44:02,907: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:44:02.907811250Z [2024-05-25 02:44:02,907: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:44:02.907990888Z [2024-05-25 02:44:02,907: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:44:02.908110487Z [2024-05-25 02:44:02,907: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T02:44:02.908390726Z [2024-05-25 02:44:02,908: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:44:02.908878965Z [2024-05-25 02:44:02,908: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:44:02.912833201Z [2024-05-25 02:44:02,912: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:44:02.917005176Z [2024-05-25 02:44:02,915: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:44:02.949845736Z [2024-05-25 02:44:02,949: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:44:02.951373144Z [2024-05-25 02:44:02,951: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:44:02.951457518Z [2024-05-25 02:44:02,951: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:44:02.951750050Z [2024-05-25 02:44:02,951: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:44:02.951839472Z [2024-05-25 02:44:02,951: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:44:02.952139602Z [2024-05-25 02:44:02,952: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:44:02.952208375Z [2024-05-25 02:44:02,952: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:44:02.983749503Z [2024-05-25 02:44:02,983: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:44:03.049697674Z [2024-05-25 02:44:03,049: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:44:04.699579269Z [2024-05-25 02:44:04,699: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[458118ee-05f8-4032-a983-ac7787256af4] succeeded in 3.6572978909989615s: None 2024-05-25T02:44:05.453389702Z [2024-05-25 02:44:05,452: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[542ac28b-78ca-4d6d-9af3-0970a5ac8f8c] succeeded in 4.384739663999426s: None 2024-05-25T02:45:00.555745755Z [2024-05-25 02:45:00,555: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[feb62643-45bd-4e7f-9a36-674de92b2734] received 2024-05-25T02:45:00.560949884Z [2024-05-25 02:45:00,560: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[739130e7-d72a-4277-996d-03036f6b1531] received 2024-05-25T02:45:00.563856960Z [2024-05-25 02:45:00,563: INFO/ForkPoolWorker-15] [feb62643-45bd-4e7f-9a36-674de92b2734] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:45:00.566871296Z [2024-05-25 02:45:00,566: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf622cb1-9135-4274-bc08-a360795b1e3f] received 2024-05-25T02:45:00.571393168Z [2024-05-25 02:45:00,571: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2dd05a4-01dc-4957-8d29-918533ea1511] received 2024-05-25T02:45:00.582410397Z [2024-05-25 02:45:00,582: INFO/ForkPoolWorker-2] [e2dd05a4-01dc-4957-8d29-918533ea1511] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:45:00.586017359Z [2024-05-25 02:45:00,585: INFO/ForkPoolWorker-1] [cf622cb1-9135-4274-bc08-a360795b1e3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:45:00.588937922Z [2024-05-25 02:45:00,588: INFO/ForkPoolWorker-16] [739130e7-d72a-4277-996d-03036f6b1531] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:45:00.913968278Z [2024-05-25 02:45:00,910: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:45:00.923427927Z [2024-05-25 02:45:00,920: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:45:00.942034021Z [2024-05-25 02:45:00,939: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:45:01.126121557Z [2024-05-25 02:45:01,122: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:45:01.194514099Z [2024-05-25 02:45:01,194: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T02:45:01.198177943Z [2024-05-25 02:45:01,197: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:45:01.220350495Z [2024-05-25 02:45:01,220: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:45:01.221441694Z [2024-05-25 02:45:01,221: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:45:01.221507750Z [2024-05-25 02:45:01,221: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:45:01.221542356Z [2024-05-25 02:45:01,221: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T02:45:01.221709282Z [2024-05-25 02:45:01,221: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:45:01.345367081Z [2024-05-25 02:45:01,340: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:45:01.958391989Z [2024-05-25 02:45:01,957: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[739130e7-d72a-4277-996d-03036f6b1531] succeeded in 1.3951942269995925s: None 2024-05-25T02:45:02.396267970Z [2024-05-25 02:45:02,395: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:45:02.403407515Z [2024-05-25 02:45:02,402: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T02:45:02.406561596Z [2024-05-25 02:45:02,406: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:45:02.408670038Z [2024-05-25 02:45:02,408: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:45:02.427291237Z [2024-05-25 02:45:02,426: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:45:02.428637507Z [2024-05-25 02:45:02,428: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:45:02.428706147Z [2024-05-25 02:45:02,428: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:45:02.428936392Z [2024-05-25 02:45:02,428: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:45:02.428953396Z [2024-05-25 02:45:02,428: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T02:45:02.429204275Z [2024-05-25 02:45:02,428: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:45:02.429325803Z [2024-05-25 02:45:02,429: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:45:02.431404634Z [2024-05-25 02:45:02,431: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:45:02.432645880Z [2024-05-25 02:45:02,432: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:45:02.432779981Z [2024-05-25 02:45:02,432: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:45:02.432921210Z [2024-05-25 02:45:02,432: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:45:02.432934450Z [2024-05-25 02:45:02,432: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:45:02.433428592Z [2024-05-25 02:45:02,433: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:45:02.433623240Z [2024-05-25 02:45:02,433: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:45:02.506287147Z [2024-05-25 02:45:02,506: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:45:02.508565631Z [2024-05-25 02:45:02,508: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:45:02.511859469Z [2024-05-25 02:45:02,511: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:45:02.531829865Z [2024-05-25 02:45:02,531: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:45:02.532928832Z [2024-05-25 02:45:02,532: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:45:02.532943640Z [2024-05-25 02:45:02,532: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:45:02.533165602Z [2024-05-25 02:45:02,532: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:45:02.533177932Z [2024-05-25 02:45:02,533: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:45:02.535625858Z [2024-05-25 02:45:02,535: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:45:02.535644104Z [2024-05-25 02:45:02,535: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:45:02.539492974Z [2024-05-25 02:45:02,538: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:45:02.608465275Z [2024-05-25 02:45:02,608: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:45:03.263018031Z [2024-05-25 02:45:03,262: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cf622cb1-9135-4274-bc08-a360795b1e3f] succeeded in 2.69236302399986s: None 2024-05-25T02:45:03.512765944Z [2024-05-25 02:45:03,512: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c8f7bea-a008-4323-be42-650342f3aed1] received 2024-05-25T02:45:03.524565875Z [2024-05-25 02:45:03,524: INFO/ForkPoolWorker-16] [4c8f7bea-a008-4323-be42-650342f3aed1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:45:03.898048151Z [2024-05-25 02:45:03,892: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:45:04.095233199Z [2024-05-25 02:45:04,094: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[feb62643-45bd-4e7f-9a36-674de92b2734] succeeded in 3.537936261998766s: None 2024-05-25T02:45:04.338228280Z [2024-05-25 02:45:04,337: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e2dd05a4-01dc-4957-8d29-918533ea1511] succeeded in 3.7650811370003794s: None 2024-05-25T02:45:05.149297253Z [2024-05-25 02:45:05,148: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:45:05.152589681Z [2024-05-25 02:45:05,152: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:45:05.180088914Z [2024-05-25 02:45:05,179: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:45:05.182991302Z [2024-05-25 02:45:05,182: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:45:05.183378853Z [2024-05-25 02:45:05,183: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:45:05.183931110Z [2024-05-25 02:45:05,183: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:45:05.183982207Z [2024-05-25 02:45:05,183: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:45:05.184823695Z [2024-05-25 02:45:05,184: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:45:05.185069651Z [2024-05-25 02:45:05,184: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:45:05.303837856Z [2024-05-25 02:45:05,303: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:45:05.983123688Z [2024-05-25 02:45:05,982: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4c8f7bea-a008-4323-be42-650342f3aed1] succeeded in 2.4660856900009094s: None 2024-05-25T02:45:07.022000762Z [2024-05-25 02:45:07,021: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc0efbf3-93fb-4ec0-9643-6586a08f44a9] received 2024-05-25T02:45:07.030270118Z [2024-05-25 02:45:07,030: INFO/ForkPoolWorker-15] [cc0efbf3-93fb-4ec0-9643-6586a08f44a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T02:45:07.304052011Z [2024-05-25 02:45:07,300: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:45:08.436453328Z [2024-05-25 02:45:08,435: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:45:08.439743915Z [2024-05-25 02:45:08,439: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:45:08.464201038Z [2024-05-25 02:45:08,463: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:45:08.465823842Z [2024-05-25 02:45:08,465: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:45:08.465998913Z [2024-05-25 02:45:08,465: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:45:08.466275051Z [2024-05-25 02:45:08,465: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:45:08.466482740Z [2024-05-25 02:45:08,466: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:45:08.466955241Z [2024-05-25 02:45:08,466: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:45:08.467142004Z [2024-05-25 02:45:08,466: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:45:08.563973460Z [2024-05-25 02:45:08,563: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:45:10.164120990Z [2024-05-25 02:45:10,163: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cc0efbf3-93fb-4ec0-9643-6586a08f44a9] succeeded in 3.1376114300001063s: None 2024-05-25T02:45:10.442283296Z [2024-05-25 02:45:10,441: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9207305-d1ac-41c0-970f-7754e6ed4047] received 2024-05-25T02:45:10.450335458Z [2024-05-25 02:45:10,450: INFO/ForkPoolWorker-15] [c9207305-d1ac-41c0-970f-7754e6ed4047] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:45:10.731176619Z [2024-05-25 02:45:10,728: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:45:11.794883214Z [2024-05-25 02:45:11,794: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:45:11.798167343Z [2024-05-25 02:45:11,797: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:45:11.817068532Z [2024-05-25 02:45:11,816: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:45:11.818260522Z [2024-05-25 02:45:11,818: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:45:11.818490353Z [2024-05-25 02:45:11,818: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:45:11.818790282Z [2024-05-25 02:45:11,818: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:45:11.818978279Z [2024-05-25 02:45:11,818: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:45:11.819423839Z [2024-05-25 02:45:11,819: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:45:11.819567648Z [2024-05-25 02:45:11,819: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:45:11.894640095Z [2024-05-25 02:45:11,894: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:45:12.570824738Z [2024-05-25 02:45:12,570: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c9207305-d1ac-41c0-970f-7754e6ed4047] succeeded in 2.126311052999881s: None 2024-05-25T02:46:00.574895556Z [2024-05-25 02:46:00,574: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[912fa330-ac43-4ec3-acc3-c09c0b038da9] received 2024-05-25T02:46:00.586928282Z [2024-05-25 02:46:00,586: INFO/ForkPoolWorker-15] [912fa330-ac43-4ec3-acc3-c09c0b038da9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:46:00.590902517Z [2024-05-25 02:46:00,590: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c341aff7-249c-4df2-8962-80db77cc3531] received 2024-05-25T02:46:00.594780778Z [2024-05-25 02:46:00,594: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be0e4b40-2f1f-4e83-bbae-0755661a4aa6] received 2024-05-25T02:46:00.599380862Z [2024-05-25 02:46:00,599: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9269f5b9-a9b2-4e97-8c27-af3dc33a84ec] received 2024-05-25T02:46:00.608379114Z [2024-05-25 02:46:00,607: INFO/ForkPoolWorker-2] [9269f5b9-a9b2-4e97-8c27-af3dc33a84ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:46:00.615555907Z [2024-05-25 02:46:00,615: INFO/ForkPoolWorker-1] [be0e4b40-2f1f-4e83-bbae-0755661a4aa6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:46:00.617930554Z [2024-05-25 02:46:00,617: INFO/ForkPoolWorker-16] [c341aff7-249c-4df2-8962-80db77cc3531] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:46:01.036244179Z [2024-05-25 02:46:01,014: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:46:01.093634571Z [2024-05-25 02:46:01,090: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:46:01.099380407Z [2024-05-25 02:46:01,094: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:46:01.175958344Z [2024-05-25 02:46:01,172: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:46:01.433767901Z [2024-05-25 02:46:01,433: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:46:01.471088283Z [2024-05-25 02:46:01,470: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T02:46:01.476368208Z [2024-05-25 02:46:01,475: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:46:01.536306469Z [2024-05-25 02:46:01,536: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:46:01.547871971Z [2024-05-25 02:46:01,547: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:46:01.547921043Z [2024-05-25 02:46:01,547: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:46:01.547926776Z [2024-05-25 02:46:01,547: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T02:46:01.548123916Z [2024-05-25 02:46:01,548: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:46:01.704043052Z [2024-05-25 02:46:01,703: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:46:02.544802010Z [2024-05-25 02:46:02,544: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[912fa330-ac43-4ec3-acc3-c09c0b038da9] succeeded in 1.9663531409987627s: None 2024-05-25T02:46:02.645223808Z [2024-05-25 02:46:02,644: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9269f5b9-a9b2-4e97-8c27-af3dc33a84ec] succeeded in 2.043293700000504s: None 2024-05-25T02:46:02.728432252Z [2024-05-25 02:46:02,728: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:46:02.731634786Z [2024-05-25 02:46:02,731: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:46:02.751391102Z [2024-05-25 02:46:02,751: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:46:02.752621483Z [2024-05-25 02:46:02,752: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:46:02.752751135Z [2024-05-25 02:46:02,752: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:46:02.753013846Z [2024-05-25 02:46:02,752: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:46:02.753130386Z [2024-05-25 02:46:02,752: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:46:02.753454336Z [2024-05-25 02:46:02,753: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:46:02.753927139Z [2024-05-25 02:46:02,753: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:46:02.840366649Z [2024-05-25 02:46:02,840: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:46:03.154803009Z [2024-05-25 02:46:03,154: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:46:03.158223551Z [2024-05-25 02:46:03,157: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:46:03.187655333Z [2024-05-25 02:46:03,187: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:46:03.190305018Z [2024-05-25 02:46:03,189: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:46:03.190352130Z [2024-05-25 02:46:03,190: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:46:03.190653746Z [2024-05-25 02:46:03,190: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:46:03.190817019Z [2024-05-25 02:46:03,190: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:46:03.191561247Z [2024-05-25 02:46:03,191: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:46:03.191701348Z [2024-05-25 02:46:03,191: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:46:03.311519912Z [2024-05-25 02:46:03,311: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:46:05.023169723Z [2024-05-25 02:46:05,022: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c341aff7-249c-4df2-8962-80db77cc3531] succeeded in 4.428303525999581s: None 2024-05-25T02:46:05.052475304Z [2024-05-25 02:46:05,051: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[be0e4b40-2f1f-4e83-bbae-0755661a4aa6] succeeded in 4.454840532000162s: None 2024-05-25T02:46:57.190347741Z [2024-05-25 02:46:57,189: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f17a5d3-12b2-4f32-8e52-437b5ea4da3c] received 2024-05-25T02:46:57.218427030Z [2024-05-25 02:46:57,218: INFO/ForkPoolWorker-15] [7f17a5d3-12b2-4f32-8e52-437b5ea4da3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240525024655_004455', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-05-25T02:46:57.633534410Z [2024-05-25 02:46:57,630: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-05-25T02:46:58.004394183Z [2024-05-25 02:46:58,004: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:46:58.694403803Z [2024-05-25 02:46:58,693: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7f17a5d3-12b2-4f32-8e52-437b5ea4da3c] succeeded in 1.4993814250010473s: None 2024-05-25T02:47:00.422271230Z [2024-05-25 02:47:00,421: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e000dde-4e96-4d1b-b267-a4ee56b2deeb] received 2024-05-25T02:47:00.424013464Z [2024-05-25 02:47:00,423: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5bb92754-7ef8-49f7-9990-89dfa908a87c] received 2024-05-25T02:47:00.434464805Z [2024-05-25 02:47:00,434: INFO/ForkPoolWorker-16] [5bb92754-7ef8-49f7-9990-89dfa908a87c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:47:00.439215061Z [2024-05-25 02:47:00,438: INFO/ForkPoolWorker-15] [7e000dde-4e96-4d1b-b267-a4ee56b2deeb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:47:00.440333117Z [2024-05-25 02:47:00,440: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a69155e1-b8d5-4925-9f81-5866dbe86ecc] received 2024-05-25T02:47:00.452275805Z [2024-05-25 02:47:00,451: INFO/ForkPoolWorker-1] [a69155e1-b8d5-4925-9f81-5866dbe86ecc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:47:00.761111877Z [2024-05-25 02:47:00,757: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:47:00.763696562Z [2024-05-25 02:47:00,760: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:47:00.765113157Z [2024-05-25 02:47:00,762: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:47:00.927391703Z [2024-05-25 02:47:00,926: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T02:47:00.931239684Z [2024-05-25 02:47:00,930: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:47:00.960255074Z [2024-05-25 02:47:00,960: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:47:00.961676312Z [2024-05-25 02:47:00,961: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:47:00.961809862Z [2024-05-25 02:47:00,961: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:47:00.961888390Z [2024-05-25 02:47:00,961: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T02:47:00.962243374Z [2024-05-25 02:47:00,962: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:47:01.071266374Z [2024-05-25 02:47:01,070: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:47:01.671009058Z [2024-05-25 02:47:01,670: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5bb92754-7ef8-49f7-9990-89dfa908a87c] succeeded in 1.2450013710003986s: None 2024-05-25T02:47:01.898072539Z [2024-05-25 02:47:01,897: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:47:01.901303826Z [2024-05-25 02:47:01,900: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:47:01.924826234Z [2024-05-25 02:47:01,924: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:47:01.926404150Z [2024-05-25 02:47:01,926: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:47:01.926462322Z [2024-05-25 02:47:01,926: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:47:01.926658868Z [2024-05-25 02:47:01,926: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:47:01.926761556Z [2024-05-25 02:47:01,926: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:47:01.927051717Z [2024-05-25 02:47:01,926: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:47:01.927139420Z [2024-05-25 02:47:01,927: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:47:02.012512498Z [2024-05-25 02:47:02,012: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:47:02.015692922Z [2024-05-25 02:47:02,015: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:47:02.018559801Z [2024-05-25 02:47:02,018: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:47:02.038886753Z [2024-05-25 02:47:02,038: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:47:02.040425207Z [2024-05-25 02:47:02,040: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:47:02.040601501Z [2024-05-25 02:47:02,040: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:47:02.040822418Z [2024-05-25 02:47:02,040: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:47:02.040964118Z [2024-05-25 02:47:02,040: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:47:02.041413440Z [2024-05-25 02:47:02,041: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:47:02.041867421Z [2024-05-25 02:47:02,041: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:47:02.127456973Z [2024-05-25 02:47:02,127: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:47:03.567921964Z [2024-05-25 02:47:03,567: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a69155e1-b8d5-4925-9f81-5866dbe86ecc] succeeded in 3.1257725410014245s: None 2024-05-25T02:47:04.098350951Z [2024-05-25 02:47:04,097: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7e000dde-4e96-4d1b-b267-a4ee56b2deeb] succeeded in 3.6741526300011174s: None 2024-05-25T02:48:00.351957753Z [2024-05-25 02:48:00,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd942f91-ed55-425e-bbff-17e9c26e5224] received 2024-05-25T02:48:00.354303985Z [2024-05-25 02:48:00,354: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21db0ed4-b2e5-41d1-a299-18a5780a5d74] received 2024-05-25T02:48:00.363457962Z [2024-05-25 02:48:00,363: INFO/ForkPoolWorker-15] [fd942f91-ed55-425e-bbff-17e9c26e5224] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:48:00.366540812Z [2024-05-25 02:48:00,366: INFO/ForkPoolWorker-16] [21db0ed4-b2e5-41d1-a299-18a5780a5d74] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:48:00.379529040Z [2024-05-25 02:48:00,379: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0469628-db60-4146-9185-4af4c7371dcd] received 2024-05-25T02:48:00.383559849Z [2024-05-25 02:48:00,383: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0eed2d5c-6d0d-4b65-a9c3-b39c53c0bd32] received 2024-05-25T02:48:00.397267557Z [2024-05-25 02:48:00,396: INFO/ForkPoolWorker-2] [0eed2d5c-6d0d-4b65-a9c3-b39c53c0bd32] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:48:00.397484523Z [2024-05-25 02:48:00,394: INFO/ForkPoolWorker-1] [e0469628-db60-4146-9185-4af4c7371dcd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:48:00.695675416Z [2024-05-25 02:48:00,692: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:48:00.736214913Z [2024-05-25 02:48:00,733: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:48:00.737746849Z [2024-05-25 02:48:00,733: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:48:00.865203390Z [2024-05-25 02:48:00,861: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:48:00.912519192Z [2024-05-25 02:48:00,912: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T02:48:00.916639872Z [2024-05-25 02:48:00,916: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:48:00.961425367Z [2024-05-25 02:48:00,961: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:48:00.962816219Z [2024-05-25 02:48:00,962: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:48:00.963242610Z [2024-05-25 02:48:00,962: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:48:00.963402383Z [2024-05-25 02:48:00,963: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T02:48:00.964216787Z [2024-05-25 02:48:00,964: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:48:00.971026404Z [2024-05-25 02:48:00,970: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:48:01.102817021Z [2024-05-25 02:48:01,102: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:48:01.586314722Z [2024-05-25 02:48:01,585: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fd942f91-ed55-425e-bbff-17e9c26e5224] succeeded in 1.2300438709989976s: None 2024-05-25T02:48:01.802295799Z [2024-05-25 02:48:01,800: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0eed2d5c-6d0d-4b65-a9c3-b39c53c0bd32] succeeded in 1.4151715860007243s: None 2024-05-25T02:48:02.053114494Z [2024-05-25 02:48:02,052: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:48:02.056273654Z [2024-05-25 02:48:02,055: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:48:02.083246508Z [2024-05-25 02:48:02,082: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:48:02.084922461Z [2024-05-25 02:48:02,084: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:48:02.084969430Z [2024-05-25 02:48:02,084: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:48:02.085286076Z [2024-05-25 02:48:02,084: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:48:02.085322645Z [2024-05-25 02:48:02,085: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:48:02.086361175Z [2024-05-25 02:48:02,086: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:48:02.086396916Z [2024-05-25 02:48:02,086: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:48:02.192333249Z [2024-05-25 02:48:02,191: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:48:02.275646163Z [2024-05-25 02:48:02,274: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:48:02.277816023Z [2024-05-25 02:48:02,277: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:48:02.345676273Z [2024-05-25 02:48:02,345: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:48:02.348351877Z [2024-05-25 02:48:02,348: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:48:02.348549899Z [2024-05-25 02:48:02,348: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:48:02.348826278Z [2024-05-25 02:48:02,348: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:48:02.348978401Z [2024-05-25 02:48:02,348: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:48:02.349633832Z [2024-05-25 02:48:02,349: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:48:02.349818991Z [2024-05-25 02:48:02,349: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:48:02.456411130Z [2024-05-25 02:48:02,456: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:48:03.962462087Z [2024-05-25 02:48:03,962: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e0469628-db60-4146-9185-4af4c7371dcd] succeeded in 3.58046935800121s: None 2024-05-25T02:48:04.197313081Z [2024-05-25 02:48:04,196: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[21db0ed4-b2e5-41d1-a299-18a5780a5d74] succeeded in 3.8402713849991414s: None 2024-05-25T02:49:00.952576356Z [2024-05-25 02:49:00,951: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78e2f005-1827-4445-9575-11453f396452] received 2024-05-25T02:49:00.959842551Z [2024-05-25 02:49:00,959: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[152fb430-f311-4db6-8d90-3a8a6e12ad68] received 2024-05-25T02:49:00.962698320Z [2024-05-25 02:49:00,962: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d4d8cba-e4c6-41c6-891f-587b2bf98ef3] received 2024-05-25T02:49:00.972079918Z [2024-05-25 02:49:00,971: INFO/ForkPoolWorker-15] [78e2f005-1827-4445-9575-11453f396452] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:49:00.976672827Z [2024-05-25 02:49:00,976: INFO/ForkPoolWorker-1] [0d4d8cba-e4c6-41c6-891f-587b2bf98ef3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:49:00.984718883Z [2024-05-25 02:49:00,984: INFO/ForkPoolWorker-16] [152fb430-f311-4db6-8d90-3a8a6e12ad68] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:49:01.262869850Z [2024-05-25 02:49:01,259: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:49:01.351006089Z [2024-05-25 02:49:01,347: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:49:01.355088424Z [2024-05-25 02:49:01,350: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:49:01.573841590Z [2024-05-25 02:49:01,573: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T02:49:01.578138040Z [2024-05-25 02:49:01,577: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:49:01.612043605Z [2024-05-25 02:49:01,611: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:49:01.614970849Z [2024-05-25 02:49:01,614: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:49:01.615425505Z [2024-05-25 02:49:01,614: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:49:01.615624837Z [2024-05-25 02:49:01,615: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T02:49:01.615988893Z [2024-05-25 02:49:01,615: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:49:01.728107460Z [2024-05-25 02:49:01,727: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:49:02.491228190Z [2024-05-25 02:49:02,490: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:49:02.495287235Z [2024-05-25 02:49:02,494: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:49:02.502862641Z [2024-05-25 02:49:02,502: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0d4d8cba-e4c6-41c6-891f-587b2bf98ef3] succeeded in 1.5384575339994626s: None 2024-05-25T02:49:02.522337640Z [2024-05-25 02:49:02,522: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:49:02.526405422Z [2024-05-25 02:49:02,526: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:49:02.526513899Z [2024-05-25 02:49:02,526: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:49:02.526725314Z [2024-05-25 02:49:02,526: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:49:02.526841850Z [2024-05-25 02:49:02,526: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:49:02.527185583Z [2024-05-25 02:49:02,527: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:49:02.527307669Z [2024-05-25 02:49:02,527: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:49:02.643029694Z [2024-05-25 02:49:02,642: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:49:02.706221244Z [2024-05-25 02:49:02,705: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:49:02.709462477Z [2024-05-25 02:49:02,709: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:49:02.730814085Z [2024-05-25 02:49:02,730: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:49:02.732100490Z [2024-05-25 02:49:02,731: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:49:02.732250049Z [2024-05-25 02:49:02,732: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:49:02.732422956Z [2024-05-25 02:49:02,732: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:49:02.732493229Z [2024-05-25 02:49:02,732: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:49:02.732742267Z [2024-05-25 02:49:02,732: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:49:02.738018413Z [2024-05-25 02:49:02,737: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:49:02.842019819Z [2024-05-25 02:49:02,841: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:49:04.426483304Z [2024-05-25 02:49:04,425: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[152fb430-f311-4db6-8d90-3a8a6e12ad68] succeeded in 3.4644431409997196s: None 2024-05-25T02:49:04.953529878Z [2024-05-25 02:49:04,953: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[78e2f005-1827-4445-9575-11453f396452] succeeded in 3.995658886000456s: None 2024-05-25T02:50:00.927100007Z [2024-05-25 02:50:00,926: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e06b1c3-7db8-4cf8-acf4-3971940d07ae] received 2024-05-25T02:50:00.933833299Z [2024-05-25 02:50:00,933: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd792d42-ff6e-4617-b6c2-4547b09a1244] received 2024-05-25T02:50:00.938723181Z [2024-05-25 02:50:00,938: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45df96d5-8103-4af1-ae34-29581393b6b0] received 2024-05-25T02:50:00.944237727Z [2024-05-25 02:50:00,943: INFO/ForkPoolWorker-15] [3e06b1c3-7db8-4cf8-acf4-3971940d07ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:50:00.953125425Z [2024-05-25 02:50:00,952: INFO/ForkPoolWorker-16] [bd792d42-ff6e-4617-b6c2-4547b09a1244] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:50:00.953321697Z [2024-05-25 02:50:00,952: INFO/ForkPoolWorker-1] [45df96d5-8103-4af1-ae34-29581393b6b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:50:00.965880611Z [2024-05-25 02:50:00,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14adcbab-0b3a-4274-8364-982a4430de08] received 2024-05-25T02:50:00.977170083Z [2024-05-25 02:50:00,976: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d9dcbf6-4f80-4f19-9444-6e30fcb30872] received 2024-05-25T02:50:00.988709109Z [2024-05-25 02:50:00,988: INFO/ForkPoolWorker-2] [14adcbab-0b3a-4274-8364-982a4430de08] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:50:01.010716734Z [2024-05-25 02:50:01,010: INFO/ForkPoolWorker-3] [5d9dcbf6-4f80-4f19-9444-6e30fcb30872] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:50:01.321071946Z [2024-05-25 02:50:01,316: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:50:01.376337364Z [2024-05-25 02:50:01,369: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:50:01.430455063Z [2024-05-25 02:50:01,427: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:50:01.492595797Z [2024-05-25 02:50:01,484: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:50:01.565605978Z [2024-05-25 02:50:01,562: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:50:01.682909551Z [2024-05-25 02:50:01,682: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T02:50:01.709681102Z [2024-05-25 02:50:01,708: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:50:01.729725030Z [2024-05-25 02:50:01,729: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:50:01.776003961Z [2024-05-25 02:50:01,775: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:50:01.782117018Z [2024-05-25 02:50:01,781: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:50:01.782299103Z [2024-05-25 02:50:01,782: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:50:01.782394895Z [2024-05-25 02:50:01,782: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T02:50:01.782628010Z [2024-05-25 02:50:01,782: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:50:01.927973301Z [2024-05-25 02:50:01,927: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:50:02.517418867Z [2024-05-25 02:50:02,517: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[5d9dcbf6-4f80-4f19-9444-6e30fcb30872] succeeded in 1.5320552650009631s: None 2024-05-25T02:50:02.934175731Z [2024-05-25 02:50:02,933: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3e06b1c3-7db8-4cf8-acf4-3971940d07ae] succeeded in 2.0053846840000915s: None 2024-05-25T02:50:03.153181810Z [2024-05-25 02:50:03,152: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T02:50:03.156752993Z [2024-05-25 02:50:03,156: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:50:03.197909300Z [2024-05-25 02:50:03,197: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:50:03.200030161Z [2024-05-25 02:50:03,199: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:50:03.200114871Z [2024-05-25 02:50:03,199: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:50:03.200448965Z [2024-05-25 02:50:03,200: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:50:03.200475873Z [2024-05-25 02:50:03,200: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T02:50:03.201123935Z [2024-05-25 02:50:03,200: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:50:03.201234542Z [2024-05-25 02:50:03,201: INFO/ForkPoolWorker-2] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:50:03.263805423Z [2024-05-25 02:50:03,263: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:50:03.269053967Z [2024-05-25 02:50:03,268: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:50:03.299274542Z [2024-05-25 02:50:03,299: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:50:03.300552159Z [2024-05-25 02:50:03,300: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:50:03.300675070Z [2024-05-25 02:50:03,300: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:50:03.300944756Z [2024-05-25 02:50:03,300: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:50:03.301154939Z [2024-05-25 02:50:03,301: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:50:03.301707418Z [2024-05-25 02:50:03,301: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:50:03.301909593Z [2024-05-25 02:50:03,301: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:50:03.315788856Z [2024-05-25 02:50:03,315: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:50:03.359377947Z [2024-05-25 02:50:03,359: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:50:03.362797715Z [2024-05-25 02:50:03,362: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:50:03.405112480Z [2024-05-25 02:50:03,404: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:50:03.409853231Z [2024-05-25 02:50:03,409: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:50:03.411763949Z [2024-05-25 02:50:03,411: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:50:03.411815105Z [2024-05-25 02:50:03,411: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:50:03.412001906Z [2024-05-25 02:50:03,411: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:50:03.412055340Z [2024-05-25 02:50:03,411: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:50:03.412306680Z [2024-05-25 02:50:03,412: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:50:03.412360737Z [2024-05-25 02:50:03,412: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:50:03.501626325Z [2024-05-25 02:50:03,501: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:50:04.265467937Z [2024-05-25 02:50:04,264: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[45df96d5-8103-4af1-ae34-29581393b6b0] succeeded in 3.3212318049991154s: None 2024-05-25T02:50:04.335226415Z [2024-05-25 02:50:04,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9aa55453-623b-4c0c-847b-e43586d262a3] received 2024-05-25T02:50:04.347589101Z [2024-05-25 02:50:04,347: INFO/ForkPoolWorker-15] [9aa55453-623b-4c0c-847b-e43586d262a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:50:04.627723815Z [2024-05-25 02:50:04,624: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:50:05.153139392Z [2024-05-25 02:50:05,152: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[14adcbab-0b3a-4274-8364-982a4430de08] succeeded in 4.185222740999961s: None 2024-05-25T02:50:05.707049436Z [2024-05-25 02:50:05,706: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:50:05.710254491Z [2024-05-25 02:50:05,709: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:50:05.728646701Z [2024-05-25 02:50:05,728: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:50:05.729919461Z [2024-05-25 02:50:05,729: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:50:05.729946152Z [2024-05-25 02:50:05,729: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:50:05.730061764Z [2024-05-25 02:50:05,729: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:50:05.730077728Z [2024-05-25 02:50:05,730: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:50:05.730327136Z [2024-05-25 02:50:05,730: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:50:05.730347570Z [2024-05-25 02:50:05,730: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:50:05.833789933Z [2024-05-25 02:50:05,833: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:50:06.061194813Z [2024-05-25 02:50:06,058: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bd792d42-ff6e-4617-b6c2-4547b09a1244] succeeded in 5.122172793999198s: None 2024-05-25T02:50:06.630667996Z [2024-05-25 02:50:06,630: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9aa55453-623b-4c0c-847b-e43586d262a3] succeeded in 2.2879105960000743s: None 2024-05-25T02:50:06.833723189Z [2024-05-25 02:50:06,833: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ced45da-c796-4e6f-a428-3d69387bbbbb] received 2024-05-25T02:50:06.846587661Z [2024-05-25 02:50:06,846: INFO/ForkPoolWorker-15] [0ced45da-c796-4e6f-a428-3d69387bbbbb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T02:50:07.146779619Z [2024-05-25 02:50:07,143: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:50:08.303281731Z [2024-05-25 02:50:08,302: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:50:08.306823620Z [2024-05-25 02:50:08,306: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:50:08.326777098Z [2024-05-25 02:50:08,326: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:50:08.328489386Z [2024-05-25 02:50:08,328: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:50:08.328618764Z [2024-05-25 02:50:08,328: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:50:08.328822177Z [2024-05-25 02:50:08,328: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:50:08.328934098Z [2024-05-25 02:50:08,328: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:50:08.329856699Z [2024-05-25 02:50:08,329: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:50:08.329984557Z [2024-05-25 02:50:08,329: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:50:08.431218709Z [2024-05-25 02:50:08,430: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:50:10.408026107Z [2024-05-25 02:50:10,407: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0ced45da-c796-4e6f-a428-3d69387bbbbb] succeeded in 3.572202956000183s: None 2024-05-25T02:50:10.746631510Z [2024-05-25 02:50:10,746: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3804883-72be-4b25-b0b3-a79a5d4afa64] received 2024-05-25T02:50:10.757858607Z [2024-05-25 02:50:10,757: INFO/ForkPoolWorker-15] [d3804883-72be-4b25-b0b3-a79a5d4afa64] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:50:11.026482585Z [2024-05-25 02:50:11,023: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:50:12.056336383Z [2024-05-25 02:50:12,055: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:50:12.059588766Z [2024-05-25 02:50:12,059: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:50:12.089307961Z [2024-05-25 02:50:12,088: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:50:12.092737454Z [2024-05-25 02:50:12,092: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:50:12.092773138Z [2024-05-25 02:50:12,092: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:50:12.093173112Z [2024-05-25 02:50:12,092: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:50:12.093632717Z [2024-05-25 02:50:12,093: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:50:12.094252604Z [2024-05-25 02:50:12,093: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:50:12.094278830Z [2024-05-25 02:50:12,094: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:50:12.191831926Z [2024-05-25 02:50:12,191: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:50:12.767843790Z [2024-05-25 02:50:12,766: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d3804883-72be-4b25-b0b3-a79a5d4afa64] succeeded in 2.018578162000267s: None 2024-05-25T02:51:01.052567789Z [2024-05-25 02:51:01,051: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[264d2336-9f37-4570-accf-3472095f2642] received 2024-05-25T02:51:01.055091449Z [2024-05-25 02:51:01,054: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[991bb6dd-3896-43be-a97b-aefef0753c82] received 2024-05-25T02:51:01.065553040Z [2024-05-25 02:51:01,065: INFO/ForkPoolWorker-15] [264d2336-9f37-4570-accf-3472095f2642] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:51:01.069146490Z [2024-05-25 02:51:01,068: INFO/ForkPoolWorker-16] [991bb6dd-3896-43be-a97b-aefef0753c82] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:51:01.075715906Z [2024-05-25 02:51:01,075: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20836c13-3571-4223-bfc9-234a038b662c] received 2024-05-25T02:51:01.084859256Z [2024-05-25 02:51:01,084: INFO/ForkPoolWorker-1] [20836c13-3571-4223-bfc9-234a038b662c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:51:01.361277579Z [2024-05-25 02:51:01,358: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:51:01.369378179Z [2024-05-25 02:51:01,358: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:51:01.377335799Z [2024-05-25 02:51:01,372: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:51:01.560612683Z [2024-05-25 02:51:01,560: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T02:51:01.564778382Z [2024-05-25 02:51:01,564: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:51:01.598023630Z [2024-05-25 02:51:01,597: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:51:01.599169196Z [2024-05-25 02:51:01,598: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:51:01.599357624Z [2024-05-25 02:51:01,599: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:51:01.599437190Z [2024-05-25 02:51:01,599: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T02:51:01.599795846Z [2024-05-25 02:51:01,599: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:51:01.716019986Z [2024-05-25 02:51:01,715: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:51:02.431431838Z [2024-05-25 02:51:02,431: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[20836c13-3571-4223-bfc9-234a038b662c] succeeded in 1.353773626000475s: None 2024-05-25T02:51:02.583391436Z [2024-05-25 02:51:02,583: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:51:02.586834182Z [2024-05-25 02:51:02,586: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:51:02.614133198Z [2024-05-25 02:51:02,613: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:51:02.615386827Z [2024-05-25 02:51:02,615: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:51:02.615563379Z [2024-05-25 02:51:02,615: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:51:02.615767262Z [2024-05-25 02:51:02,615: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:51:02.615897257Z [2024-05-25 02:51:02,615: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:51:02.616193930Z [2024-05-25 02:51:02,616: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:51:02.616349614Z [2024-05-25 02:51:02,616: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:51:02.663089507Z [2024-05-25 02:51:02,662: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:51:02.666375130Z [2024-05-25 02:51:02,665: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:51:02.689152876Z [2024-05-25 02:51:02,688: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:51:02.690353306Z [2024-05-25 02:51:02,690: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:51:02.690431050Z [2024-05-25 02:51:02,690: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:51:02.690616318Z [2024-05-25 02:51:02,690: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:51:02.690673874Z [2024-05-25 02:51:02,690: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:51:02.690888627Z [2024-05-25 02:51:02,690: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:51:02.690955243Z [2024-05-25 02:51:02,690: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:51:02.707895958Z [2024-05-25 02:51:02,707: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:51:02.771856136Z [2024-05-25 02:51:02,771: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:51:04.583335317Z [2024-05-25 02:51:04,582: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[991bb6dd-3896-43be-a97b-aefef0753c82] succeeded in 3.524448141999528s: None 2024-05-25T02:51:05.277394627Z [2024-05-25 02:51:05,276: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[264d2336-9f37-4570-accf-3472095f2642] succeeded in 4.220424314999036s: None 2024-05-25T02:52:01.006874324Z [2024-05-25 02:52:01,006: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77e276e8-229a-4ff9-8c0a-09c990c3bb37] received 2024-05-25T02:52:01.010020330Z [2024-05-25 02:52:01,009: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52667242-8bff-405d-852f-62fb3f810775] received 2024-05-25T02:52:01.017976728Z [2024-05-25 02:52:01,017: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37a15f4a-1edf-47e2-a0a7-0380405247b9] received 2024-05-25T02:52:01.020013125Z [2024-05-25 02:52:01,019: INFO/ForkPoolWorker-16] [52667242-8bff-405d-852f-62fb3f810775] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:52:01.021038622Z [2024-05-25 02:52:01,020: INFO/ForkPoolWorker-15] [77e276e8-229a-4ff9-8c0a-09c990c3bb37] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:52:01.021174314Z [2024-05-25 02:52:01,020: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6d3fef6-080e-426c-8c4c-fc78b0f436b4] received 2024-05-25T02:52:01.030201868Z [2024-05-25 02:52:01,029: INFO/ForkPoolWorker-1] [37a15f4a-1edf-47e2-a0a7-0380405247b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:52:01.031255012Z [2024-05-25 02:52:01,030: INFO/ForkPoolWorker-2] [c6d3fef6-080e-426c-8c4c-fc78b0f436b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:52:01.365297218Z [2024-05-25 02:52:01,345: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:52:01.365319086Z [2024-05-25 02:52:01,349: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:52:01.516556401Z [2024-05-25 02:52:01,510: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:52:01.518212306Z [2024-05-25 02:52:01,514: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:52:01.582078189Z [2024-05-25 02:52:01,581: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T02:52:01.587324176Z [2024-05-25 02:52:01,586: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:52:01.618202343Z [2024-05-25 02:52:01,617: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:52:01.620348980Z [2024-05-25 02:52:01,620: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:52:01.620433270Z [2024-05-25 02:52:01,620: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:52:01.620515615Z [2024-05-25 02:52:01,620: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T02:52:01.621134963Z [2024-05-25 02:52:01,620: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:52:01.712405989Z [2024-05-25 02:52:01,712: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:52:01.816031614Z [2024-05-25 02:52:01,815: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:52:02.334868273Z [2024-05-25 02:52:02,334: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c6d3fef6-080e-426c-8c4c-fc78b0f436b4] succeeded in 1.3102259520001098s: None 2024-05-25T02:52:02.506553175Z [2024-05-25 02:52:02,506: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[77e276e8-229a-4ff9-8c0a-09c990c3bb37] succeeded in 1.497682070999872s: None 2024-05-25T02:52:02.744626434Z [2024-05-25 02:52:02,744: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:52:02.748046068Z [2024-05-25 02:52:02,747: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:52:02.769298387Z [2024-05-25 02:52:02,769: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:52:02.770675271Z [2024-05-25 02:52:02,770: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:52:02.770686248Z [2024-05-25 02:52:02,770: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:52:02.770772551Z [2024-05-25 02:52:02,770: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:52:02.770842250Z [2024-05-25 02:52:02,770: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:52:02.771139164Z [2024-05-25 02:52:02,771: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:52:02.771208164Z [2024-05-25 02:52:02,771: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:52:02.837899399Z [2024-05-25 02:52:02,837: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:52:02.841285027Z [2024-05-25 02:52:02,840: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:52:02.859842920Z [2024-05-25 02:52:02,859: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:52:02.863100414Z [2024-05-25 02:52:02,862: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:52:02.864623958Z [2024-05-25 02:52:02,864: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:52:02.864869787Z [2024-05-25 02:52:02,864: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:52:02.865141323Z [2024-05-25 02:52:02,864: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:52:02.865422610Z [2024-05-25 02:52:02,865: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:52:02.865821837Z [2024-05-25 02:52:02,865: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:52:02.866038816Z [2024-05-25 02:52:02,865: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:52:02.944372930Z [2024-05-25 02:52:02,944: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:52:04.341945187Z [2024-05-25 02:52:04,341: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[37a15f4a-1edf-47e2-a0a7-0380405247b9] succeeded in 3.321755827000743s: None 2024-05-25T02:52:05.070471821Z [2024-05-25 02:52:05,070: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[52667242-8bff-405d-852f-62fb3f810775] succeeded in 4.058587569999872s: None 2024-05-25T02:52:56.776034400Z [2024-05-25 02:52:56,774: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc14dc31-83e6-4d48-b0f0-c5a87b9dcba8] received 2024-05-25T02:52:56.795855302Z [2024-05-25 02:52:56,795: INFO/ForkPoolWorker-15] [bc14dc31-83e6-4d48-b0f0-c5a87b9dcba8] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240525025255_561983', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-05-25T02:52:57.093671083Z [2024-05-25 02:52:57,090: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-05-25T02:52:57.377412821Z [2024-05-25 02:52:57,377: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:52:57.942296676Z [2024-05-25 02:52:57,941: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bc14dc31-83e6-4d48-b0f0-c5a87b9dcba8] succeeded in 1.1600409010006842s: None 2024-05-25T02:53:00.261556982Z [2024-05-25 02:53:00,261: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c5b7260-df73-41fb-8039-83d48ad7e153] received 2024-05-25T02:53:00.268453607Z [2024-05-25 02:53:00,268: INFO/ForkPoolWorker-15] [8c5b7260-df73-41fb-8039-83d48ad7e153] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:53:00.280105642Z [2024-05-25 02:53:00,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f7d4ee6-7a08-4db8-948b-446399308683] received 2024-05-25T02:53:00.286268031Z [2024-05-25 02:53:00,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28766f9c-2531-4ed5-bedd-b737a50dffe3] received 2024-05-25T02:53:00.290894716Z [2024-05-25 02:53:00,290: INFO/ForkPoolWorker-16] [2f7d4ee6-7a08-4db8-948b-446399308683] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:53:00.303731276Z [2024-05-25 02:53:00,303: INFO/ForkPoolWorker-1] [28766f9c-2531-4ed5-bedd-b737a50dffe3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:53:00.577164168Z [2024-05-25 02:53:00,573: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:53:00.602358525Z [2024-05-25 02:53:00,598: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:53:00.640062342Z [2024-05-25 02:53:00,637: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:53:00.728997559Z [2024-05-25 02:53:00,728: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T02:53:00.733083372Z [2024-05-25 02:53:00,732: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:53:00.755498817Z [2024-05-25 02:53:00,755: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:53:00.757965863Z [2024-05-25 02:53:00,757: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:53:00.758128476Z [2024-05-25 02:53:00,757: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:53:00.758260525Z [2024-05-25 02:53:00,758: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T02:53:00.758517646Z [2024-05-25 02:53:00,758: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:53:00.873997610Z [2024-05-25 02:53:00,873: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:53:01.471085762Z [2024-05-25 02:53:01,470: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2f7d4ee6-7a08-4db8-948b-446399308683] succeeded in 1.1887382390013954s: None 2024-05-25T02:53:01.768912026Z [2024-05-25 02:53:01,768: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:53:01.772101129Z [2024-05-25 02:53:01,771: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:53:01.798931713Z [2024-05-25 02:53:01,798: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:53:01.802376181Z [2024-05-25 02:53:01,801: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:53:01.802555646Z [2024-05-25 02:53:01,802: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:53:01.803458090Z [2024-05-25 02:53:01,803: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:53:01.803538489Z [2024-05-25 02:53:01,803: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:53:01.804018860Z [2024-05-25 02:53:01,803: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:53:01.804026041Z [2024-05-25 02:53:01,803: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:53:01.844961434Z [2024-05-25 02:53:01,844: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:53:01.850136166Z [2024-05-25 02:53:01,849: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:53:01.877753323Z [2024-05-25 02:53:01,877: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:53:01.879464973Z [2024-05-25 02:53:01,879: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:53:01.879684430Z [2024-05-25 02:53:01,879: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:53:01.880036895Z [2024-05-25 02:53:01,879: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:53:01.880350770Z [2024-05-25 02:53:01,879: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:53:01.880812985Z [2024-05-25 02:53:01,880: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:53:01.880984660Z [2024-05-25 02:53:01,880: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:53:01.889143705Z [2024-05-25 02:53:01,888: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:53:01.973659058Z [2024-05-25 02:53:01,973: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:53:03.434347744Z [2024-05-25 02:53:03,433: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[28766f9c-2531-4ed5-bedd-b737a50dffe3] succeeded in 3.1453074159999233s: None 2024-05-25T02:53:05.263725675Z [2024-05-25 02:53:05,262: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8c5b7260-df73-41fb-8039-83d48ad7e153] succeeded in 4.999920366000879s: None 2024-05-25T02:54:00.977805129Z [2024-05-25 02:54:00,976: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85993d25-012e-461c-a870-7f4d4c0ad0a3] received 2024-05-25T02:54:00.982982918Z [2024-05-25 02:54:00,982: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed47707e-0296-4fae-a15c-832e4812ec59] received 2024-05-25T02:54:00.988322915Z [2024-05-25 02:54:00,988: INFO/ForkPoolWorker-15] [85993d25-012e-461c-a870-7f4d4c0ad0a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:54:00.994278785Z [2024-05-25 02:54:00,993: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9a5b123-dbf6-4317-9585-7c15681f9f9f] received 2024-05-25T02:54:00.996602762Z [2024-05-25 02:54:00,996: INFO/ForkPoolWorker-16] [ed47707e-0296-4fae-a15c-832e4812ec59] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:54:00.996983914Z [2024-05-25 02:54:00,996: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b317e55-557f-4ff6-95f5-4584bcbc448b] received 2024-05-25T02:54:01.000911099Z [2024-05-25 02:54:01,000: INFO/ForkPoolWorker-1] [f9a5b123-dbf6-4317-9585-7c15681f9f9f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:54:01.007906307Z [2024-05-25 02:54:01,007: INFO/ForkPoolWorker-2] [8b317e55-557f-4ff6-95f5-4584bcbc448b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:54:01.288504072Z [2024-05-25 02:54:01,281: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:54:01.314824714Z [2024-05-25 02:54:01,311: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:54:01.452046399Z [2024-05-25 02:54:01,448: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:54:01.468478877Z [2024-05-25 02:54:01,465: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:54:01.564705646Z [2024-05-25 02:54:01,564: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:54:01.708506893Z [2024-05-25 02:54:01,708: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T02:54:01.714126243Z [2024-05-25 02:54:01,713: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:54:01.739459356Z [2024-05-25 02:54:01,739: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:54:01.746057854Z [2024-05-25 02:54:01,745: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:54:01.746190442Z [2024-05-25 02:54:01,746: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:54:01.746276738Z [2024-05-25 02:54:01,746: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T02:54:01.746505302Z [2024-05-25 02:54:01,746: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:54:01.865291094Z [2024-05-25 02:54:01,864: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:54:02.099801223Z [2024-05-25 02:54:02,099: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[85993d25-012e-461c-a870-7f4d4c0ad0a3] succeeded in 1.1195063079994725s: None 2024-05-25T02:54:02.481126121Z [2024-05-25 02:54:02,480: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8b317e55-557f-4ff6-95f5-4584bcbc448b] succeeded in 1.4811550730009913s: None 2024-05-25T02:54:02.666039004Z [2024-05-25 02:54:02,665: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:54:02.669377006Z [2024-05-25 02:54:02,668: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:54:02.693537553Z [2024-05-25 02:54:02,693: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:54:02.695249237Z [2024-05-25 02:54:02,695: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:54:02.695441297Z [2024-05-25 02:54:02,695: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:54:02.695758429Z [2024-05-25 02:54:02,695: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:54:02.695790802Z [2024-05-25 02:54:02,695: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:54:02.696110733Z [2024-05-25 02:54:02,695: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:54:02.696235138Z [2024-05-25 02:54:02,696: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:54:02.730883654Z [2024-05-25 02:54:02,730: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:54:02.734012159Z [2024-05-25 02:54:02,733: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:54:02.756060666Z [2024-05-25 02:54:02,755: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:54:02.757287960Z [2024-05-25 02:54:02,757: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:54:02.757413089Z [2024-05-25 02:54:02,757: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:54:02.757593326Z [2024-05-25 02:54:02,757: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:54:02.757725967Z [2024-05-25 02:54:02,757: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:54:02.758003343Z [2024-05-25 02:54:02,757: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:54:02.758075093Z [2024-05-25 02:54:02,757: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:54:02.779299537Z [2024-05-25 02:54:02,779: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:54:02.854098837Z [2024-05-25 02:54:02,853: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:54:04.495741834Z [2024-05-25 02:54:04,495: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f9a5b123-dbf6-4317-9585-7c15681f9f9f] succeeded in 3.4992286000015156s: None 2024-05-25T02:54:04.823360318Z [2024-05-25 02:54:04,822: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ed47707e-0296-4fae-a15c-832e4812ec59] succeeded in 3.835944058999303s: None 2024-05-25T02:54:56.626886202Z [2024-05-25 02:54:56,626: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2033053-d809-4977-9a9d-e202ad60dca4] received 2024-05-25T02:54:56.642373573Z [2024-05-25 02:54:56,642: INFO/ForkPoolWorker-15] [c2033053-d809-4977-9a9d-e202ad60dca4] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240525025455_333497', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-05-25T02:54:56.926338947Z [2024-05-25 02:54:56,923: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-05-25T02:54:57.262215020Z [2024-05-25 02:54:57,261: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:54:58.071316173Z [2024-05-25 02:54:58,070: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c2033053-d809-4977-9a9d-e202ad60dca4] succeeded in 1.4408705160003592s: None 2024-05-25T02:55:00.997537592Z [2024-05-25 02:55:00,997: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[831b9d69-8630-4bfe-955d-eed693332329] received 2024-05-25T02:55:01.001702053Z [2024-05-25 02:55:01,001: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85463d98-acc0-4016-a088-5f3f9355e44f] received 2024-05-25T02:55:01.006936349Z [2024-05-25 02:55:01,006: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6a4efb9-60c7-4a9b-af13-5ed8b0f2915c] received 2024-05-25T02:55:01.016567003Z [2024-05-25 02:55:01,016: INFO/ForkPoolWorker-1] [c6a4efb9-60c7-4a9b-af13-5ed8b0f2915c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:55:01.023091954Z [2024-05-25 02:55:01,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2e3eb67-1286-4168-aff7-690dc553468f] received 2024-05-25T02:55:01.027594207Z [2024-05-25 02:55:01,027: INFO/ForkPoolWorker-15] [831b9d69-8630-4bfe-955d-eed693332329] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:55:01.028998338Z [2024-05-25 02:55:01,028: INFO/ForkPoolWorker-16] [85463d98-acc0-4016-a088-5f3f9355e44f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:55:01.033283465Z [2024-05-25 02:55:01,032: INFO/ForkPoolWorker-2] [a2e3eb67-1286-4168-aff7-690dc553468f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:55:01.379696088Z [2024-05-25 02:55:01,368: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:55:01.526518790Z [2024-05-25 02:55:01,523: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:55:01.532217670Z [2024-05-25 02:55:01,511: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:55:01.580386436Z [2024-05-25 02:55:01,576: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:55:01.746962586Z [2024-05-25 02:55:01,746: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T02:55:01.750911225Z [2024-05-25 02:55:01,750: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:55:01.799703695Z [2024-05-25 02:55:01,799: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:55:01.801857485Z [2024-05-25 02:55:01,801: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:55:01.802005697Z [2024-05-25 02:55:01,801: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:55:01.802126631Z [2024-05-25 02:55:01,801: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T02:55:01.802461004Z [2024-05-25 02:55:01,802: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:55:01.902959246Z [2024-05-25 02:55:01,902: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:55:02.557589610Z [2024-05-25 02:55:02,557: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a2e3eb67-1286-4168-aff7-690dc553468f] succeeded in 1.53219937600079s: None 2024-05-25T02:55:02.806691458Z [2024-05-25 02:55:02,806: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:55:02.811900882Z [2024-05-25 02:55:02,811: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:55:02.834061995Z [2024-05-25 02:55:02,833: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:55:02.835206092Z [2024-05-25 02:55:02,835: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:55:02.835221214Z [2024-05-25 02:55:02,835: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:55:02.835338043Z [2024-05-25 02:55:02,835: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:55:02.835361374Z [2024-05-25 02:55:02,835: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:55:02.835725241Z [2024-05-25 02:55:02,835: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:55:02.835767493Z [2024-05-25 02:55:02,835: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:55:02.923747504Z [2024-05-25 02:55:02,923: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:55:02.962029138Z [2024-05-25 02:55:02,961: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:55:02.965210583Z [2024-05-25 02:55:02,964: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:55:03.016227221Z [2024-05-25 02:55:03,015: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:55:03.025649680Z [2024-05-25 02:55:03,025: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:55:03.026313162Z [2024-05-25 02:55:03,025: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:55:03.027105102Z [2024-05-25 02:55:03,026: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:55:03.027719545Z [2024-05-25 02:55:03,027: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:55:03.028672878Z [2024-05-25 02:55:03,028: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:55:03.029483698Z [2024-05-25 02:55:03,029: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:55:03.033566769Z [2024-05-25 02:55:03,033: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:55:03.037299220Z [2024-05-25 02:55:03,036: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:55:03.057762431Z [2024-05-25 02:55:03,057: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:55:03.062107472Z [2024-05-25 02:55:03,061: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:55:03.062262656Z [2024-05-25 02:55:03,062: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:55:03.065528015Z [2024-05-25 02:55:03,062: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:55:03.065674940Z [2024-05-25 02:55:03,065: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:55:03.066033942Z [2024-05-25 02:55:03,065: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:55:03.066138329Z [2024-05-25 02:55:03,066: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:55:03.146336619Z [2024-05-25 02:55:03,146: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:55:03.164250079Z [2024-05-25 02:55:03,163: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:55:03.779117943Z [2024-05-25 02:55:03,778: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[831b9d69-8630-4bfe-955d-eed693332329] succeeded in 2.7620392159988114s: None 2024-05-25T02:55:03.843730712Z [2024-05-25 02:55:03,843: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[157ad611-52a0-4636-9c88-3ed261cabbc0] received 2024-05-25T02:55:03.861787953Z [2024-05-25 02:55:03,861: INFO/ForkPoolWorker-15] [157ad611-52a0-4636-9c88-3ed261cabbc0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:55:04.282577725Z [2024-05-25 02:55:04,279: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:55:04.366740915Z [2024-05-25 02:55:04,366: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c6a4efb9-60c7-4a9b-af13-5ed8b0f2915c] succeeded in 3.357622525998522s: None 2024-05-25T02:55:04.918428898Z [2024-05-25 02:55:04,918: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[85463d98-acc0-4016-a088-5f3f9355e44f] succeeded in 3.91205705900029s: None 2024-05-25T02:55:05.468314741Z [2024-05-25 02:55:05,467: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:55:05.471344900Z [2024-05-25 02:55:05,470: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:55:05.493327398Z [2024-05-25 02:55:05,493: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:55:05.494795289Z [2024-05-25 02:55:05,494: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:55:05.494893548Z [2024-05-25 02:55:05,494: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:55:05.495120850Z [2024-05-25 02:55:05,494: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:55:05.495263876Z [2024-05-25 02:55:05,495: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:55:05.495606968Z [2024-05-25 02:55:05,495: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:55:05.495763441Z [2024-05-25 02:55:05,495: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:55:05.571433328Z [2024-05-25 02:55:05,571: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:55:06.164297201Z [2024-05-25 02:55:06,163: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[157ad611-52a0-4636-9c88-3ed261cabbc0] succeeded in 2.318169924999893s: None 2024-05-25T02:55:06.365617859Z [2024-05-25 02:55:06,365: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4edbc521-5a84-49f5-91aa-91543d11dccc] received 2024-05-25T02:55:06.373431893Z [2024-05-25 02:55:06,373: INFO/ForkPoolWorker-15] [4edbc521-5a84-49f5-91aa-91543d11dccc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T02:55:06.704047386Z [2024-05-25 02:55:06,701: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:55:07.769340698Z [2024-05-25 02:55:07,768: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:55:07.772471134Z [2024-05-25 02:55:07,772: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:55:07.799274578Z [2024-05-25 02:55:07,799: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:55:07.801421536Z [2024-05-25 02:55:07,801: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:55:07.801741860Z [2024-05-25 02:55:07,801: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:55:07.803069752Z [2024-05-25 02:55:07,802: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:55:07.803473914Z [2024-05-25 02:55:07,803: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:55:07.804036460Z [2024-05-25 02:55:07,803: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:55:07.804587784Z [2024-05-25 02:55:07,804: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:55:07.887328940Z [2024-05-25 02:55:07,887: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:55:09.324335078Z [2024-05-25 02:55:09,323: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4edbc521-5a84-49f5-91aa-91543d11dccc] succeeded in 2.956339187001504s: None 2024-05-25T02:55:10.034693986Z [2024-05-25 02:55:10,034: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5bd573fd-45e7-4cb8-b897-85414662873c] received 2024-05-25T02:55:10.045746541Z [2024-05-25 02:55:10,045: INFO/ForkPoolWorker-15] [5bd573fd-45e7-4cb8-b897-85414662873c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T02:55:10.334737534Z [2024-05-25 02:55:10,331: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T02:55:11.344546398Z [2024-05-25 02:55:11,344: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:55:11.347834674Z [2024-05-25 02:55:11,347: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:55:11.369685798Z [2024-05-25 02:55:11,369: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:55:11.371227000Z [2024-05-25 02:55:11,370: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:55:11.371292737Z [2024-05-25 02:55:11,371: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:55:11.371472634Z [2024-05-25 02:55:11,371: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:55:11.371633922Z [2024-05-25 02:55:11,371: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:55:11.371990796Z [2024-05-25 02:55:11,371: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T02:55:11.372181098Z [2024-05-25 02:55:11,371: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:55:11.463338403Z [2024-05-25 02:55:11,462: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:55:12.093281178Z [2024-05-25 02:55:12,092: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5bd573fd-45e7-4cb8-b897-85414662873c] succeeded in 2.0562504949994036s: None 2024-05-25T02:56:00.852759249Z [2024-05-25 02:56:00,852: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a93e26a6-8eb8-4611-9d09-af183e0e0cd0] received 2024-05-25T02:56:00.859016918Z [2024-05-25 02:56:00,858: INFO/ForkPoolWorker-15] [a93e26a6-8eb8-4611-9d09-af183e0e0cd0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:56:00.866083985Z [2024-05-25 02:56:00,865: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c5242d5-dc4a-4cd7-ba91-702cedaf863a] received 2024-05-25T02:56:00.879168341Z [2024-05-25 02:56:00,878: INFO/ForkPoolWorker-16] [4c5242d5-dc4a-4cd7-ba91-702cedaf863a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:56:00.881867350Z [2024-05-25 02:56:00,881: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[49c3a2f6-49a6-469e-b574-40742da9ca6a] received 2024-05-25T02:56:00.887213667Z [2024-05-25 02:56:00,887: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6bd20bb-fee3-4d2d-af08-13b787398fae] received 2024-05-25T02:56:00.897275876Z [2024-05-25 02:56:00,896: INFO/ForkPoolWorker-2] [b6bd20bb-fee3-4d2d-af08-13b787398fae] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:56:00.909342925Z [2024-05-25 02:56:00,908: INFO/ForkPoolWorker-1] [49c3a2f6-49a6-469e-b574-40742da9ca6a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:56:01.202374171Z [2024-05-25 02:56:01,198: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:56:01.202733371Z [2024-05-25 02:56:01,199: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:56:01.252102433Z [2024-05-25 02:56:01,244: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:56:01.407406847Z [2024-05-25 02:56:01,375: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:56:01.520667237Z [2024-05-25 02:56:01,520: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:56:01.905996300Z [2024-05-25 02:56:01,905: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T02:56:01.914097379Z [2024-05-25 02:56:01,913: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:56:01.985074039Z [2024-05-25 02:56:01,984: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:56:01.992366987Z [2024-05-25 02:56:01,992: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:56:01.993465917Z [2024-05-25 02:56:01,992: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:56:01.993598786Z [2024-05-25 02:56:01,993: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T02:56:01.998050693Z [2024-05-25 02:56:01,997: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:56:02.157538010Z [2024-05-25 02:56:02,157: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:56:02.377971548Z [2024-05-25 02:56:02,377: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a93e26a6-8eb8-4611-9d09-af183e0e0cd0] succeeded in 1.5232045609991474s: None 2024-05-25T02:56:02.944288538Z [2024-05-25 02:56:02,943: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:56:02.947396559Z [2024-05-25 02:56:02,947: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:56:02.968904883Z [2024-05-25 02:56:02,968: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:56:02.970492981Z [2024-05-25 02:56:02,970: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:56:02.970522381Z [2024-05-25 02:56:02,970: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:56:02.970774425Z [2024-05-25 02:56:02,970: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:56:02.970842335Z [2024-05-25 02:56:02,970: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:56:02.971307393Z [2024-05-25 02:56:02,971: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:56:02.971444875Z [2024-05-25 02:56:02,971: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:56:02.996453234Z [2024-05-25 02:56:02,995: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b6bd20bb-fee3-4d2d-af08-13b787398fae] succeeded in 2.1059859180004423s: None 2024-05-25T02:56:03.063481799Z [2024-05-25 02:56:03,063: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:56:03.664928179Z [2024-05-25 02:56:03,664: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:56:03.672661122Z [2024-05-25 02:56:03,667: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:56:03.704774648Z [2024-05-25 02:56:03,704: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:56:03.706063177Z [2024-05-25 02:56:03,705: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:56:03.706093686Z [2024-05-25 02:56:03,705: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:56:03.706775324Z [2024-05-25 02:56:03,706: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:56:03.706911792Z [2024-05-25 02:56:03,706: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:56:03.707098924Z [2024-05-25 02:56:03,706: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:56:03.707117503Z [2024-05-25 02:56:03,707: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:56:03.842733328Z [2024-05-25 02:56:03,842: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:56:04.784813340Z [2024-05-25 02:56:04,784: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4c5242d5-dc4a-4cd7-ba91-702cedaf863a] succeeded in 3.916035792999537s: None 2024-05-25T02:56:05.691625707Z [2024-05-25 02:56:05,690: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[49c3a2f6-49a6-469e-b574-40742da9ca6a] succeeded in 4.806337163001444s: None 2024-05-25T02:56:30.160585406Z [2024-05-25 02:56:30,159: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3cba1957-b509-4bb8-904d-959b7291a625] received 2024-05-25T02:56:30.169567089Z [2024-05-25 02:56:30,169: INFO/ForkPoolWorker-15] [3cba1957-b509-4bb8-904d-959b7291a625] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240525025629_402011', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-05-25T02:56:30.536061475Z [2024-05-25 02:56:30,531: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-05-25T02:56:30.789514749Z [2024-05-25 02:56:30,789: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:56:31.379927433Z [2024-05-25 02:56:31,379: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3cba1957-b509-4bb8-904d-959b7291a625] succeeded in 1.215220070000214s: None 2024-05-25T02:57:00.724992080Z [2024-05-25 02:57:00,724: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e59fd4fc-4298-48b1-9df7-8d26429dddf5] received 2024-05-25T02:57:00.729004728Z [2024-05-25 02:57:00,728: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[231c53bd-0c14-4ac6-bf8b-a85a829a07cb] received 2024-05-25T02:57:00.740824806Z [2024-05-25 02:57:00,740: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cde4b01e-a96f-4816-8bdc-a8a67adf432d] received 2024-05-25T02:57:00.745429881Z [2024-05-25 02:57:00,740: INFO/ForkPoolWorker-15] [e59fd4fc-4298-48b1-9df7-8d26429dddf5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:57:00.746418124Z [2024-05-25 02:57:00,746: INFO/ForkPoolWorker-16] [231c53bd-0c14-4ac6-bf8b-a85a829a07cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:57:00.748867119Z [2024-05-25 02:57:00,748: INFO/ForkPoolWorker-1] [cde4b01e-a96f-4816-8bdc-a8a67adf432d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:57:00.998501301Z [2024-05-25 02:57:00,995: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:57:01.031152497Z [2024-05-25 02:57:01,028: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:57:01.103509694Z [2024-05-25 02:57:01,098: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:57:01.183805815Z [2024-05-25 02:57:01,183: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T02:57:01.187917876Z [2024-05-25 02:57:01,187: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:57:01.210709343Z [2024-05-25 02:57:01,210: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:57:01.211533927Z [2024-05-25 02:57:01,211: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:57:01.211650817Z [2024-05-25 02:57:01,211: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:57:01.211724488Z [2024-05-25 02:57:01,211: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T02:57:01.212089627Z [2024-05-25 02:57:01,211: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:57:01.307902468Z [2024-05-25 02:57:01,307: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:57:01.950419828Z [2024-05-25 02:57:01,949: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cde4b01e-a96f-4816-8bdc-a8a67adf432d] succeeded in 1.2073535029994673s: None 2024-05-25T02:57:02.090296569Z [2024-05-25 02:57:02,089: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:57:02.093513851Z [2024-05-25 02:57:02,093: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:57:02.116637355Z [2024-05-25 02:57:02,116: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:57:02.118173312Z [2024-05-25 02:57:02,117: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:57:02.118358620Z [2024-05-25 02:57:02,118: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:57:02.118783705Z [2024-05-25 02:57:02,118: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:57:02.118939979Z [2024-05-25 02:57:02,118: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:57:02.119278825Z [2024-05-25 02:57:02,119: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:57:02.119851647Z [2024-05-25 02:57:02,119: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:57:02.221372098Z [2024-05-25 02:57:02,219: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:57:02.461827664Z [2024-05-25 02:57:02,461: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:57:02.464949816Z [2024-05-25 02:57:02,464: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:57:02.482840689Z [2024-05-25 02:57:02,482: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:57:02.484497327Z [2024-05-25 02:57:02,484: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:57:02.484510294Z [2024-05-25 02:57:02,484: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:57:02.484621516Z [2024-05-25 02:57:02,484: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:57:02.484638068Z [2024-05-25 02:57:02,484: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:57:02.484856997Z [2024-05-25 02:57:02,484: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:57:02.484864482Z [2024-05-25 02:57:02,484: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:57:02.573751276Z [2024-05-25 02:57:02,573: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:57:04.595185553Z [2024-05-25 02:57:04,594: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e59fd4fc-4298-48b1-9df7-8d26429dddf5] succeeded in 3.863879022999754s: None 2024-05-25T02:57:04.809858969Z [2024-05-25 02:57:04,808: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[231c53bd-0c14-4ac6-bf8b-a85a829a07cb] succeeded in 4.0686551590006275s: None 2024-05-25T02:58:00.254017234Z [2024-05-25 02:58:00,253: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f50a92a8-18cb-40b5-ad47-8d1bc407bb0a] received 2024-05-25T02:58:00.255871319Z [2024-05-25 02:58:00,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4b7dde7-d60d-4a72-b6c9-76cfa611e2fc] received 2024-05-25T02:58:00.264560244Z [2024-05-25 02:58:00,264: INFO/ForkPoolWorker-16] [a4b7dde7-d60d-4a72-b6c9-76cfa611e2fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:58:00.265114692Z [2024-05-25 02:58:00,264: INFO/ForkPoolWorker-15] [f50a92a8-18cb-40b5-ad47-8d1bc407bb0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T02:58:00.272326973Z [2024-05-25 02:58:00,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[133869d6-613e-4f07-ad9c-caecd9300eec] received 2024-05-25T02:58:00.274479535Z [2024-05-25 02:58:00,274: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25dfca24-84ae-4744-8573-5f5844867353] received 2024-05-25T02:58:00.283825755Z [2024-05-25 02:58:00,283: INFO/ForkPoolWorker-2] [25dfca24-84ae-4744-8573-5f5844867353] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:58:00.290807394Z [2024-05-25 02:58:00,290: INFO/ForkPoolWorker-1] [133869d6-613e-4f07-ad9c-caecd9300eec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:58:00.586545854Z [2024-05-25 02:58:00,583: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:58:00.598041126Z [2024-05-25 02:58:00,594: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:58:00.665103551Z [2024-05-25 02:58:00,661: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:58:00.700546625Z [2024-05-25 02:58:00,696: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T02:58:00.762461496Z [2024-05-25 02:58:00,762: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T02:58:00.767064109Z [2024-05-25 02:58:00,766: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:58:00.813446226Z [2024-05-25 02:58:00,813: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T02:58:00.816785336Z [2024-05-25 02:58:00,816: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:58:00.817344871Z [2024-05-25 02:58:00,816: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:58:00.817671479Z [2024-05-25 02:58:00,817: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T02:58:00.818964222Z [2024-05-25 02:58:00,818: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:58:00.922602698Z [2024-05-25 02:58:00,922: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:58:00.952703383Z [2024-05-25 02:58:00,952: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:58:01.527711647Z [2024-05-25 02:58:01,527: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f50a92a8-18cb-40b5-ad47-8d1bc407bb0a] succeeded in 1.2706816190002428s: None 2024-05-25T02:58:01.577251623Z [2024-05-25 02:58:01,576: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[25dfca24-84ae-4744-8573-5f5844867353] succeeded in 1.2994641840014083s: None 2024-05-25T02:58:01.836098818Z [2024-05-25 02:58:01,835: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T02:58:01.839187532Z [2024-05-25 02:58:01,838: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:58:01.867887958Z [2024-05-25 02:58:01,867: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:58:01.869774893Z [2024-05-25 02:58:01,869: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:58:01.869799213Z [2024-05-25 02:58:01,869: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:58:01.869934695Z [2024-05-25 02:58:01,869: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:58:01.869950047Z [2024-05-25 02:58:01,869: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T02:58:01.870287452Z [2024-05-25 02:58:01,870: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:58:01.870329879Z [2024-05-25 02:58:01,870: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:58:01.964165767Z [2024-05-25 02:58:01,963: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:58:01.967410740Z [2024-05-25 02:58:01,966: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:58:01.971807131Z [2024-05-25 02:58:01,971: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:58:01.994571522Z [2024-05-25 02:58:01,993: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:58:01.996395658Z [2024-05-25 02:58:01,996: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:58:01.996634245Z [2024-05-25 02:58:01,996: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:58:01.996914185Z [2024-05-25 02:58:01,996: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:58:01.997096699Z [2024-05-25 02:58:01,996: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:58:01.997664216Z [2024-05-25 02:58:01,997: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:58:01.998982766Z [2024-05-25 02:58:01,997: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:58:02.085204963Z [2024-05-25 02:58:02,084: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:58:03.482155665Z [2024-05-25 02:58:03,481: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[133869d6-613e-4f07-ad9c-caecd9300eec] succeeded in 3.206147405999218s: None 2024-05-25T02:58:03.983425825Z [2024-05-25 02:58:03,982: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a4b7dde7-d60d-4a72-b6c9-76cfa611e2fc] succeeded in 3.725886263000575s: None 2024-05-25T02:59:00.665007380Z [2024-05-25 02:59:00,664: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1dad88a-0df4-4ab0-ac4b-20ba58792d80] received 2024-05-25T02:59:00.674639583Z [2024-05-25 02:59:00,674: INFO/ForkPoolWorker-15] [b1dad88a-0df4-4ab0-ac4b-20ba58792d80] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T02:59:00.674932322Z [2024-05-25 02:59:00,674: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e1ada11-a5e0-486b-9334-340bfe53d4a8] received 2024-05-25T02:59:00.685926138Z [2024-05-25 02:59:00,685: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa0cb69b-0aba-4e12-857a-9897940b9f17] received 2024-05-25T02:59:00.703978808Z [2024-05-25 02:59:00,703: INFO/ForkPoolWorker-1] [fa0cb69b-0aba-4e12-857a-9897940b9f17] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T02:59:00.705846796Z [2024-05-25 02:59:00,702: INFO/ForkPoolWorker-16] [5e1ada11-a5e0-486b-9334-340bfe53d4a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T02:59:01.099559239Z [2024-05-25 02:59:01,096: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T02:59:01.143290380Z [2024-05-25 02:59:01,139: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T02:59:01.293839129Z [2024-05-25 02:59:01,290: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T02:59:01.315752991Z [2024-05-25 02:59:01,315: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T02:59:01.321038033Z [2024-05-25 02:59:01,320: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:59:01.442770075Z [2024-05-25 02:59:01,442: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T02:59:01.448205060Z [2024-05-25 02:59:01,447: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T02:59:01.448558410Z [2024-05-25 02:59:01,448: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T02:59:01.448635612Z [2024-05-25 02:59:01,448: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T02:59:01.448905963Z [2024-05-25 02:59:01,448: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T02:59:01.623847217Z [2024-05-25 02:59:01,623: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:59:02.379500870Z [2024-05-25 02:59:02,374: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fa0cb69b-0aba-4e12-857a-9897940b9f17] succeeded in 1.6817290159997356s: None 2024-05-25T02:59:02.622567641Z [2024-05-25 02:59:02,622: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T02:59:02.625982652Z [2024-05-25 02:59:02,625: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:59:02.654124858Z [2024-05-25 02:59:02,653: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T02:59:02.655549643Z [2024-05-25 02:59:02,655: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:59:02.655721957Z [2024-05-25 02:59:02,655: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:59:02.655920876Z [2024-05-25 02:59:02,655: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:59:02.656045883Z [2024-05-25 02:59:02,655: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T02:59:02.656382836Z [2024-05-25 02:59:02,656: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T02:59:02.656520379Z [2024-05-25 02:59:02,656: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:59:02.736030962Z [2024-05-25 02:59:02,735: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:59:02.810817471Z [2024-05-25 02:59:02,810: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T02:59:02.814302830Z [2024-05-25 02:59:02,813: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T02:59:02.833107509Z [2024-05-25 02:59:02,832: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T02:59:02.834487599Z [2024-05-25 02:59:02,834: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T02:59:02.834599789Z [2024-05-25 02:59:02,834: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T02:59:02.834779887Z [2024-05-25 02:59:02,834: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T02:59:02.835318194Z [2024-05-25 02:59:02,835: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T02:59:02.835926515Z [2024-05-25 02:59:02,835: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T02:59:02.836257535Z [2024-05-25 02:59:02,835: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T02:59:02.906626191Z [2024-05-25 02:59:02,906: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T02:59:04.705983125Z [2024-05-25 02:59:04,705: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b1dad88a-0df4-4ab0-ac4b-20ba58792d80] succeeded in 4.03842565100058s: None 2024-05-25T02:59:04.724740073Z [2024-05-25 02:59:04,724: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5e1ada11-a5e0-486b-9334-340bfe53d4a8] succeeded in 4.0455199150001135s: None 2024-05-25T03:00:01.182197669Z [2024-05-25 03:00:01,181: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a3826ad-ebd2-4212-88c6-98fd1456c3e9] received 2024-05-25T03:00:01.185484106Z [2024-05-25 03:00:01,185: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[efaf5eb1-dc60-468a-bcad-4264f061f76c] received 2024-05-25T03:00:01.187572161Z [2024-05-25 03:00:01,187: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b3f5d91-e990-4b50-91a3-161621b141ad] received 2024-05-25T03:00:01.189843484Z [2024-05-25 03:00:01,189: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f69237c-efce-484b-846a-6cbf69e724c4] received 2024-05-25T03:00:01.194887975Z [2024-05-25 03:00:01,194: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e62ec4e-8b9c-439b-ab1c-cea432912e46] received 2024-05-25T03:00:01.200207862Z [2024-05-25 03:00:01,199: INFO/ForkPoolWorker-16] [efaf5eb1-dc60-468a-bcad-4264f061f76c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T03:00:01.200295732Z [2024-05-25 03:00:01,200: INFO/ForkPoolWorker-1] [8b3f5d91-e990-4b50-91a3-161621b141ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T03:00:01.202035242Z [2024-05-25 03:00:01,201: INFO/ForkPoolWorker-15] [7a3826ad-ebd2-4212-88c6-98fd1456c3e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:00:01.208427122Z [2024-05-25 03:00:01,207: INFO/ForkPoolWorker-2] [1f69237c-efce-484b-846a-6cbf69e724c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:00:01.216977499Z [2024-05-25 03:00:01,216: INFO/ForkPoolWorker-3] [4e62ec4e-8b9c-439b-ab1c-cea432912e46] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:00:01.650390659Z [2024-05-25 03:00:01,646: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T03:00:01.685052226Z [2024-05-25 03:00:01,681: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T03:00:01.705499536Z [2024-05-25 03:00:01,701: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T03:00:01.723529205Z [2024-05-25 03:00:01,718: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T03:00:01.785777400Z [2024-05-25 03:00:01,782: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T03:00:01.838931810Z [2024-05-25 03:00:01,838: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T03:00:01.843445621Z [2024-05-25 03:00:01,843: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:00:01.893304136Z [2024-05-25 03:00:01,893: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:00:01.897802185Z [2024-05-25 03:00:01,897: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T03:00:01.897972149Z [2024-05-25 03:00:01,897: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T03:00:01.898009238Z [2024-05-25 03:00:01,897: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T03:00:01.898195664Z [2024-05-25 03:00:01,898: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T03:00:02.104389446Z [2024-05-25 03:00:02,104: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:00:02.330444594Z [2024-05-25 03:00:02,330: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:00:03.134425027Z [2024-05-25 03:00:03,134: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7a3826ad-ebd2-4212-88c6-98fd1456c3e9] succeeded in 1.9505810880000354s: None 2024-05-25T03:00:03.143902655Z [2024-05-25 03:00:03,143: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T03:00:03.147268577Z [2024-05-25 03:00:03,146: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:00:03.184522903Z [2024-05-25 03:00:03,184: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T03:00:03.186505287Z [2024-05-25 03:00:03,186: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:00:03.186745347Z [2024-05-25 03:00:03,186: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:00:03.187005568Z [2024-05-25 03:00:03,186: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:00:03.187188053Z [2024-05-25 03:00:03,187: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T03:00:03.187536380Z [2024-05-25 03:00:03,187: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T03:00:03.187757182Z [2024-05-25 03:00:03,187: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:00:03.214563764Z [2024-05-25 03:00:03,214: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8b3f5d91-e990-4b50-91a3-161621b141ad] succeeded in 2.0251326840007096s: None 2024-05-25T03:00:03.287661075Z [2024-05-25 03:00:03,287: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:00:03.326639999Z [2024-05-25 03:00:03,326: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T03:00:03.329990850Z [2024-05-25 03:00:03,329: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:00:03.350651771Z [2024-05-25 03:00:03,350: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T03:00:03.351694225Z [2024-05-25 03:00:03,351: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:00:03.351708924Z [2024-05-25 03:00:03,351: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:00:03.351802323Z [2024-05-25 03:00:03,351: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:00:03.351890652Z [2024-05-25 03:00:03,351: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T03:00:03.352099603Z [2024-05-25 03:00:03,351: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T03:00:03.352103904Z [2024-05-25 03:00:03,352: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:00:03.430200589Z [2024-05-25 03:00:03,429: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:00:03.680869713Z [2024-05-25 03:00:03,680: INFO/ForkPoolWorker-3] Getting VIM list 2024-05-25T03:00:03.684056904Z [2024-05-25 03:00:03,683: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:00:03.717138941Z [2024-05-25 03:00:03,716: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T03:00:03.718917515Z [2024-05-25 03:00:03,718: INFO/ForkPoolWorker-3] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:00:03.718944472Z [2024-05-25 03:00:03,718: INFO/ForkPoolWorker-3] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:00:03.719130113Z [2024-05-25 03:00:03,718: INFO/ForkPoolWorker-3] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:00:03.719187370Z [2024-05-25 03:00:03,719: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-05-25T03:00:03.719466708Z [2024-05-25 03:00:03,719: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T03:00:03.719518185Z [2024-05-25 03:00:03,719: INFO/ForkPoolWorker-3] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:00:03.851581656Z [2024-05-25 03:00:03,851: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:00:04.170895768Z [2024-05-25 03:00:04,170: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[efaf5eb1-dc60-468a-bcad-4264f061f76c] succeeded in 2.983302606000507s: None 2024-05-25T03:00:05.190662060Z [2024-05-25 03:00:05,190: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b11501e-19d4-4bbe-890e-bef5e8bbada5] received 2024-05-25T03:00:05.203374797Z [2024-05-25 03:00:05,203: INFO/ForkPoolWorker-15] [8b11501e-19d4-4bbe-890e-bef5e8bbada5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T03:00:05.272410574Z [2024-05-25 03:00:05,272: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1f69237c-efce-484b-846a-6cbf69e724c4] succeeded in 4.07761137000125s: None 2024-05-25T03:00:05.449137169Z [2024-05-25 03:00:05,448: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[4e62ec4e-8b9c-439b-ab1c-cea432912e46] succeeded in 4.249890529999902s: None 2024-05-25T03:00:05.491071116Z [2024-05-25 03:00:05,487: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T03:00:06.645518792Z [2024-05-25 03:00:06,643: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T03:00:06.647353548Z [2024-05-25 03:00:06,646: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:00:06.673418477Z [2024-05-25 03:00:06,672: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:00:06.674554785Z [2024-05-25 03:00:06,674: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:00:06.674825056Z [2024-05-25 03:00:06,674: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:00:06.675101772Z [2024-05-25 03:00:06,674: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:00:06.675551793Z [2024-05-25 03:00:06,675: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T03:00:06.675891388Z [2024-05-25 03:00:06,675: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T03:00:06.676159430Z [2024-05-25 03:00:06,675: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:00:06.780604811Z [2024-05-25 03:00:06,780: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:00:07.470201313Z [2024-05-25 03:00:07,469: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8b11501e-19d4-4bbe-890e-bef5e8bbada5] succeeded in 2.2762456910004403s: None 2024-05-25T03:00:07.605737230Z [2024-05-25 03:00:07,605: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c36aed55-4e0d-4f0b-a233-ae0dbf98d862] received 2024-05-25T03:00:07.613053879Z [2024-05-25 03:00:07,612: INFO/ForkPoolWorker-15] [c36aed55-4e0d-4f0b-a233-ae0dbf98d862] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T03:00:07.990812511Z [2024-05-25 03:00:07,987: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T03:00:09.203782739Z [2024-05-25 03:00:09,203: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T03:00:09.206871472Z [2024-05-25 03:00:09,206: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:00:09.230437868Z [2024-05-25 03:00:09,230: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:00:09.231583057Z [2024-05-25 03:00:09,231: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:00:09.231787962Z [2024-05-25 03:00:09,231: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:00:09.232019708Z [2024-05-25 03:00:09,231: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:00:09.232158676Z [2024-05-25 03:00:09,232: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T03:00:09.232509341Z [2024-05-25 03:00:09,232: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T03:00:09.232638743Z [2024-05-25 03:00:09,232: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:00:09.332151390Z [2024-05-25 03:00:09,331: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:00:09.918950307Z [2024-05-25 03:00:09,918: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c36aed55-4e0d-4f0b-a233-ae0dbf98d862] succeeded in 2.310518801999933s: None 2024-05-25T03:00:09.947207694Z [2024-05-25 03:00:09,946: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2dde633a-1789-4af7-993b-6b5c748c199e] received 2024-05-25T03:00:09.961076771Z [2024-05-25 03:00:09,960: INFO/ForkPoolWorker-15] [2dde633a-1789-4af7-993b-6b5c748c199e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T03:00:10.219106266Z [2024-05-25 03:00:10,215: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T03:00:11.263578573Z [2024-05-25 03:00:11,263: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T03:00:11.266767799Z [2024-05-25 03:00:11,266: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:00:11.284768818Z [2024-05-25 03:00:11,284: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:00:11.286369386Z [2024-05-25 03:00:11,286: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:00:11.286398079Z [2024-05-25 03:00:11,286: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:00:11.286486000Z [2024-05-25 03:00:11,286: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:00:11.286511057Z [2024-05-25 03:00:11,286: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T03:00:11.286831461Z [2024-05-25 03:00:11,286: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T03:00:11.287012747Z [2024-05-25 03:00:11,286: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:00:11.445586777Z [2024-05-25 03:00:11,445: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:00:12.053379809Z [2024-05-25 03:00:12,052: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2dde633a-1789-4af7-993b-6b5c748c199e] succeeded in 2.1008201679997s: None 2024-05-25T03:00:30.091155006Z [2024-05-25 03:00:30,090: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93f0d34a-5db9-4107-ae36-4c3349a48efd] received 2024-05-25T03:00:30.103858292Z [2024-05-25 03:00:30,103: INFO/ForkPoolWorker-15] [93f0d34a-5db9-4107-ae36-4c3349a48efd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240525030029_830642', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-05-25T03:00:30.388320549Z [2024-05-25 03:00:30,384: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-05-25T03:00:30.671415029Z [2024-05-25 03:00:30,671: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:00:31.334958872Z [2024-05-25 03:00:31,334: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[93f0d34a-5db9-4107-ae36-4c3349a48efd] succeeded in 1.2393947939999634s: None 2024-05-25T03:01:00.450644177Z [2024-05-25 03:01:00,450: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[096be35e-cdd0-407e-b036-9e4bc36770fb] received 2024-05-25T03:01:00.458727114Z [2024-05-25 03:01:00,458: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[878c9d06-b111-4457-9a7f-c1f9020d813c] received 2024-05-25T03:01:00.459608183Z [2024-05-25 03:01:00,459: INFO/ForkPoolWorker-15] [096be35e-cdd0-407e-b036-9e4bc36770fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:01:00.461365972Z [2024-05-25 03:01:00,461: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f6671c3-5eb7-486e-a9c6-826348c4f1ef] received 2024-05-25T03:01:00.474169036Z [2024-05-25 03:01:00,473: INFO/ForkPoolWorker-16] [878c9d06-b111-4457-9a7f-c1f9020d813c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:01:00.488559575Z [2024-05-25 03:01:00,488: INFO/ForkPoolWorker-1] [6f6671c3-5eb7-486e-a9c6-826348c4f1ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:01:00.745611354Z [2024-05-25 03:01:00,742: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T03:01:00.786354815Z [2024-05-25 03:01:00,783: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T03:01:00.852069305Z [2024-05-25 03:01:00,848: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T03:01:00.994590794Z [2024-05-25 03:01:00,994: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T03:01:00.999254577Z [2024-05-25 03:01:00,998: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:01:01.036852779Z [2024-05-25 03:01:01,036: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T03:01:01.038649460Z [2024-05-25 03:01:01,038: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T03:01:01.038827062Z [2024-05-25 03:01:01,038: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T03:01:01.038895275Z [2024-05-25 03:01:01,038: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T03:01:01.039686405Z [2024-05-25 03:01:01,039: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T03:01:01.164863242Z [2024-05-25 03:01:01,164: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:01:01.767153624Z [2024-05-25 03:01:01,766: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[878c9d06-b111-4457-9a7f-c1f9020d813c] succeeded in 1.3046131009996316s: None 2024-05-25T03:01:01.946975801Z [2024-05-25 03:01:01,946: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T03:01:01.951198500Z [2024-05-25 03:01:01,950: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:01:01.980073382Z [2024-05-25 03:01:01,979: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:01:01.982341636Z [2024-05-25 03:01:01,982: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:01:01.982558444Z [2024-05-25 03:01:01,982: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:01:01.982853072Z [2024-05-25 03:01:01,982: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:01:01.983078753Z [2024-05-25 03:01:01,982: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T03:01:01.983478806Z [2024-05-25 03:01:01,983: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T03:01:01.983767262Z [2024-05-25 03:01:01,983: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:01:02.067703959Z [2024-05-25 03:01:02,067: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:01:02.194104707Z [2024-05-25 03:01:02,189: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T03:01:02.195697822Z [2024-05-25 03:01:02,194: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:01:02.295165140Z [2024-05-25 03:01:02,294: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T03:01:02.318172879Z [2024-05-25 03:01:02,317: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:01:02.318235043Z [2024-05-25 03:01:02,318: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:01:02.318415749Z [2024-05-25 03:01:02,318: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:01:02.318559903Z [2024-05-25 03:01:02,318: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T03:01:02.318795585Z [2024-05-25 03:01:02,318: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T03:01:02.318858778Z [2024-05-25 03:01:02,318: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:01:02.472062981Z [2024-05-25 03:01:02,471: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:01:03.586971774Z [2024-05-25 03:01:03,586: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[096be35e-cdd0-407e-b036-9e4bc36770fb] succeeded in 3.132766682998408s: None 2024-05-25T03:01:04.534672907Z [2024-05-25 03:01:04,534: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6f6671c3-5eb7-486e-a9c6-826348c4f1ef] succeeded in 4.070537793000767s: None 2024-05-25T03:02:00.923889127Z [2024-05-25 03:02:00,923: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53a5eeb6-e864-40f7-9bfe-c91daa0de531] received 2024-05-25T03:02:00.926134977Z [2024-05-25 03:02:00,925: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c709c7b-c07d-4059-8d36-295001b72f66] received 2024-05-25T03:02:00.927804655Z [2024-05-25 03:02:00,927: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d71de4b4-1627-457f-921d-e337e67e12e4] received 2024-05-25T03:02:00.933999735Z [2024-05-25 03:02:00,933: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[300825bf-a2c7-4690-bc07-96b0d2dd6250] received 2024-05-25T03:02:00.937324993Z [2024-05-25 03:02:00,936: INFO/ForkPoolWorker-1] [d71de4b4-1627-457f-921d-e337e67e12e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:02:00.941007575Z [2024-05-25 03:02:00,940: INFO/ForkPoolWorker-16] [1c709c7b-c07d-4059-8d36-295001b72f66] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:02:00.959543881Z [2024-05-25 03:02:00,958: INFO/ForkPoolWorker-15] [53a5eeb6-e864-40f7-9bfe-c91daa0de531] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T03:02:00.962253468Z [2024-05-25 03:02:00,961: INFO/ForkPoolWorker-2] [300825bf-a2c7-4690-bc07-96b0d2dd6250] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:02:01.298681816Z [2024-05-25 03:02:01,294: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T03:02:01.384878614Z [2024-05-25 03:02:01,375: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T03:02:01.427948940Z [2024-05-25 03:02:01,423: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T03:02:01.435387522Z [2024-05-25 03:02:01,431: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T03:02:01.599195107Z [2024-05-25 03:02:01,598: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:02:01.608976831Z [2024-05-25 03:02:01,608: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T03:02:01.613086144Z [2024-05-25 03:02:01,612: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:02:01.643509794Z [2024-05-25 03:02:01,643: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T03:02:01.646572375Z [2024-05-25 03:02:01,646: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T03:02:01.646650381Z [2024-05-25 03:02:01,646: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T03:02:01.646723085Z [2024-05-25 03:02:01,646: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T03:02:01.646964217Z [2024-05-25 03:02:01,646: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T03:02:01.746476253Z [2024-05-25 03:02:01,746: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:02:02.372249325Z [2024-05-25 03:02:02,371: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[53a5eeb6-e864-40f7-9bfe-c91daa0de531] succeeded in 1.4440293210009258s: None 2024-05-25T03:02:02.613767015Z [2024-05-25 03:02:02,613: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[300825bf-a2c7-4690-bc07-96b0d2dd6250] succeeded in 1.6659309650003706s: None 2024-05-25T03:02:02.830228094Z [2024-05-25 03:02:02,829: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T03:02:02.834916636Z [2024-05-25 03:02:02,834: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:02:02.864205334Z [2024-05-25 03:02:02,863: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T03:02:02.865845063Z [2024-05-25 03:02:02,865: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:02:02.865860270Z [2024-05-25 03:02:02,865: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:02:02.866104751Z [2024-05-25 03:02:02,865: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:02:02.866240410Z [2024-05-25 03:02:02,866: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T03:02:02.866683190Z [2024-05-25 03:02:02,866: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T03:02:02.866691312Z [2024-05-25 03:02:02,866: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:02:02.895906059Z [2024-05-25 03:02:02,895: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T03:02:02.899289614Z [2024-05-25 03:02:02,898: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:02:02.941331207Z [2024-05-25 03:02:02,940: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T03:02:02.944693601Z [2024-05-25 03:02:02,944: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:02:02.944761719Z [2024-05-25 03:02:02,944: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:02:02.944851909Z [2024-05-25 03:02:02,944: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:02:02.944925390Z [2024-05-25 03:02:02,944: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T03:02:02.946371313Z [2024-05-25 03:02:02,945: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T03:02:02.946495278Z [2024-05-25 03:02:02,946: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:02:02.959311333Z [2024-05-25 03:02:02,958: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:02:03.058381614Z [2024-05-25 03:02:03,058: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:02:04.527887108Z [2024-05-25 03:02:04,527: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1c709c7b-c07d-4059-8d36-295001b72f66] succeeded in 3.5982191589992s: None 2024-05-25T03:02:05.042407964Z [2024-05-25 03:02:05,041: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d71de4b4-1627-457f-921d-e337e67e12e4] succeeded in 4.112660038001195s: None 2024-05-25T03:03:00.883149835Z [2024-05-25 03:03:00,882: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5fa16212-7b70-48ee-88a6-9ef8f6ec8ca5] received 2024-05-25T03:03:00.887551889Z [2024-05-25 03:03:00,887: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab95374f-ac8b-4ffc-bd7e-3821970e9d34] received 2024-05-25T03:03:00.890964327Z [2024-05-25 03:03:00,890: INFO/ForkPoolWorker-15] [5fa16212-7b70-48ee-88a6-9ef8f6ec8ca5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:03:00.893907917Z [2024-05-25 03:03:00,893: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3aaf08a6-4b99-4ec6-ac6b-3676791eb7a8] received 2024-05-25T03:03:00.912190779Z [2024-05-25 03:03:00,911: INFO/ForkPoolWorker-16] [ab95374f-ac8b-4ffc-bd7e-3821970e9d34] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:03:00.914803091Z [2024-05-25 03:03:00,913: INFO/ForkPoolWorker-1] [3aaf08a6-4b99-4ec6-ac6b-3676791eb7a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:03:01.212165803Z [2024-05-25 03:03:01,209: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T03:03:01.212196508Z [2024-05-25 03:03:01,208: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T03:03:01.256073176Z [2024-05-25 03:03:01,250: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T03:03:01.480773440Z [2024-05-25 03:03:01,480: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T03:03:01.485674659Z [2024-05-25 03:03:01,485: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:03:01.507629707Z [2024-05-25 03:03:01,507: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T03:03:01.509737651Z [2024-05-25 03:03:01,509: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T03:03:01.509955730Z [2024-05-25 03:03:01,509: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T03:03:01.510106239Z [2024-05-25 03:03:01,509: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T03:03:01.510510119Z [2024-05-25 03:03:01,510: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T03:03:01.633772419Z [2024-05-25 03:03:01,633: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:03:02.304665293Z [2024-05-25 03:03:02,304: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3aaf08a6-4b99-4ec6-ac6b-3676791eb7a8] succeeded in 1.40757878399927s: None 2024-05-25T03:03:02.360275729Z [2024-05-25 03:03:02,359: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T03:03:02.363781004Z [2024-05-25 03:03:02,363: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:03:02.382203733Z [2024-05-25 03:03:02,382: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T03:03:02.383166738Z [2024-05-25 03:03:02,382: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:03:02.383177588Z [2024-05-25 03:03:02,383: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:03:02.383284547Z [2024-05-25 03:03:02,383: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:03:02.383309177Z [2024-05-25 03:03:02,383: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T03:03:02.383502273Z [2024-05-25 03:03:02,383: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T03:03:02.383586348Z [2024-05-25 03:03:02,383: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:03:02.467517990Z [2024-05-25 03:03:02,467: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:03:02.494800344Z [2024-05-25 03:03:02,494: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T03:03:02.497854298Z [2024-05-25 03:03:02,497: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:03:02.520267214Z [2024-05-25 03:03:02,519: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:03:02.521768904Z [2024-05-25 03:03:02,521: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:03:02.521888135Z [2024-05-25 03:03:02,521: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:03:02.522075789Z [2024-05-25 03:03:02,521: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:03:02.522178321Z [2024-05-25 03:03:02,522: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T03:03:02.522512483Z [2024-05-25 03:03:02,522: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T03:03:02.522666148Z [2024-05-25 03:03:02,522: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:03:02.609156798Z [2024-05-25 03:03:02,608: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:03:03.943800534Z [2024-05-25 03:03:03,943: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ab95374f-ac8b-4ffc-bd7e-3821970e9d34] succeeded in 3.0522531990009156s: None 2024-05-25T03:03:04.409483578Z [2024-05-25 03:03:04,408: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5fa16212-7b70-48ee-88a6-9ef8f6ec8ca5] succeeded in 3.5240090179995605s: None 2024-05-25T03:04:00.590580703Z [2024-05-25 03:04:00,590: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[870e2ef4-ef46-4816-a3f3-9191992defe5] received 2024-05-25T03:04:00.593172399Z [2024-05-25 03:04:00,592: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75e874a2-0022-4c75-9cca-6b6ea854f858] received 2024-05-25T03:04:00.602692481Z [2024-05-25 03:04:00,602: INFO/ForkPoolWorker-15] [870e2ef4-ef46-4816-a3f3-9191992defe5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T03:04:00.612868176Z [2024-05-25 03:04:00,612: INFO/ForkPoolWorker-16] [75e874a2-0022-4c75-9cca-6b6ea854f858] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:04:00.623825291Z [2024-05-25 03:04:00,623: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7dc591ae-deaa-4649-8f1d-c58a0ee40ee3] received 2024-05-25T03:04:00.629406178Z [2024-05-25 03:04:00,629: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[202d059f-9772-497d-9f8d-89895eba37a3] received 2024-05-25T03:04:00.649689261Z [2024-05-25 03:04:00,649: INFO/ForkPoolWorker-2] [202d059f-9772-497d-9f8d-89895eba37a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:04:00.650441751Z [2024-05-25 03:04:00,650: INFO/ForkPoolWorker-1] [7dc591ae-deaa-4649-8f1d-c58a0ee40ee3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:04:00.987733154Z [2024-05-25 03:04:00,983: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T03:04:01.068394595Z [2024-05-25 03:04:01,064: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T03:04:01.150678631Z [2024-05-25 03:04:01,150: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T03:04:01.154912205Z [2024-05-25 03:04:01,154: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:04:01.176941124Z [2024-05-25 03:04:01,176: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T03:04:01.177868522Z [2024-05-25 03:04:01,177: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T03:04:01.177942224Z [2024-05-25 03:04:01,177: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T03:04:01.177960032Z [2024-05-25 03:04:01,177: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T03:04:01.178196555Z [2024-05-25 03:04:01,178: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T03:04:01.287791281Z [2024-05-25 03:04:01,287: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:04:01.318458757Z [2024-05-25 03:04:01,314: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T03:04:01.376543846Z [2024-05-25 03:04:01,373: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T03:04:01.675536713Z [2024-05-25 03:04:01,675: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:04:01.950004483Z [2024-05-25 03:04:01,949: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[202d059f-9772-497d-9f8d-89895eba37a3] succeeded in 1.3120423710006435s: None 2024-05-25T03:04:02.348749417Z [2024-05-25 03:04:02,348: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[870e2ef4-ef46-4816-a3f3-9191992defe5] succeeded in 1.7551911709997512s: None 2024-05-25T03:04:02.644261199Z [2024-05-25 03:04:02,643: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T03:04:02.647482217Z [2024-05-25 03:04:02,647: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:04:02.669469795Z [2024-05-25 03:04:02,669: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T03:04:02.670785232Z [2024-05-25 03:04:02,670: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:04:02.670968421Z [2024-05-25 03:04:02,670: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:04:02.671059788Z [2024-05-25 03:04:02,670: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:04:02.671151555Z [2024-05-25 03:04:02,671: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T03:04:02.671429432Z [2024-05-25 03:04:02,671: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T03:04:02.671496817Z [2024-05-25 03:04:02,671: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:04:02.764763426Z [2024-05-25 03:04:02,764: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:04:02.770685600Z [2024-05-25 03:04:02,770: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T03:04:02.773945390Z [2024-05-25 03:04:02,773: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:04:02.802635246Z [2024-05-25 03:04:02,802: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T03:04:02.806262007Z [2024-05-25 03:04:02,805: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:04:02.806276683Z [2024-05-25 03:04:02,806: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:04:02.806443400Z [2024-05-25 03:04:02,806: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:04:02.806463097Z [2024-05-25 03:04:02,806: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T03:04:02.806757005Z [2024-05-25 03:04:02,806: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T03:04:02.806761375Z [2024-05-25 03:04:02,806: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:04:02.891009387Z [2024-05-25 03:04:02,890: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:04:04.358520224Z [2024-05-25 03:04:04,357: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7dc591ae-deaa-4649-8f1d-c58a0ee40ee3] succeeded in 3.727704463999544s: None 2024-05-25T03:04:04.870130312Z [2024-05-25 03:04:04,869: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[75e874a2-0022-4c75-9cca-6b6ea854f858] succeeded in 4.271411350000562s: None 2024-05-25T03:05:00.930155500Z [2024-05-25 03:05:00,929: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d547c23f-b3eb-4f3b-b366-095810959942] received 2024-05-25T03:05:00.933881493Z [2024-05-25 03:05:00,933: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bebab6dc-8e52-4271-ab4a-0149e01d9711] received 2024-05-25T03:05:00.944704326Z [2024-05-25 03:05:00,944: INFO/ForkPoolWorker-15] [d547c23f-b3eb-4f3b-b366-095810959942] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T03:05:00.945484022Z [2024-05-25 03:05:00,945: INFO/ForkPoolWorker-16] [bebab6dc-8e52-4271-ab4a-0149e01d9711] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:05:00.976608634Z [2024-05-25 03:05:00,976: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3cf0f221-ba23-485c-8dbd-f47af5319ed9] received 2024-05-25T03:05:00.981109014Z [2024-05-25 03:05:00,980: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf9328e4-0dea-407e-81c3-afb8376f4bf8] received 2024-05-25T03:05:00.985337681Z [2024-05-25 03:05:00,985: INFO/ForkPoolWorker-1] [3cf0f221-ba23-485c-8dbd-f47af5319ed9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:05:00.991076304Z [2024-05-25 03:05:00,990: INFO/ForkPoolWorker-2] [cf9328e4-0dea-407e-81c3-afb8376f4bf8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:05:01.289062907Z [2024-05-25 03:05:01,286: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T03:05:01.386038048Z [2024-05-25 03:05:01,381: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T03:05:01.516391217Z [2024-05-25 03:05:01,513: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T03:05:02.085706543Z [2024-05-25 03:05:02,065: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T03:05:02.463512360Z [2024-05-25 03:05:02,463: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T03:05:02.467490169Z [2024-05-25 03:05:02,467: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:05:02.494107529Z [2024-05-25 03:05:02,493: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T03:05:02.495388671Z [2024-05-25 03:05:02,495: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T03:05:02.495637461Z [2024-05-25 03:05:02,495: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T03:05:02.495865893Z [2024-05-25 03:05:02,495: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T03:05:02.496183307Z [2024-05-25 03:05:02,496: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T03:05:02.691925363Z [2024-05-25 03:05:02,691: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:05:03.281607317Z [2024-05-25 03:05:03,281: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T03:05:03.291644344Z [2024-05-25 03:05:03,285: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:05:03.362414134Z [2024-05-25 03:05:03,362: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T03:05:03.366827704Z [2024-05-25 03:05:03,366: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:05:03.366853728Z [2024-05-25 03:05:03,366: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:05:03.366931880Z [2024-05-25 03:05:03,366: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:05:03.366958342Z [2024-05-25 03:05:03,366: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T03:05:03.367168894Z [2024-05-25 03:05:03,367: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T03:05:03.367196201Z [2024-05-25 03:05:03,367: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:05:03.506837868Z [2024-05-25 03:05:03,506: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:05:03.510495033Z [2024-05-25 03:05:03,509: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cf9328e4-0dea-407e-81c3-afb8376f4bf8] succeeded in 2.5259668350008724s: None 2024-05-25T03:05:03.551155296Z [2024-05-25 03:05:03,550: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T03:05:03.554422737Z [2024-05-25 03:05:03,554: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:05:03.586351697Z [2024-05-25 03:05:03,586: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T03:05:03.587539668Z [2024-05-25 03:05:03,587: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:05:03.587662004Z [2024-05-25 03:05:03,587: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:05:03.587867595Z [2024-05-25 03:05:03,587: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:05:03.587987206Z [2024-05-25 03:05:03,587: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T03:05:03.588253769Z [2024-05-25 03:05:03,588: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T03:05:03.588381090Z [2024-05-25 03:05:03,588: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:05:03.683799337Z [2024-05-25 03:05:03,683: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:05:03.975319379Z [2024-05-25 03:05:03,974: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T03:05:03.982992279Z [2024-05-25 03:05:03,982: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:05:04.056767446Z [2024-05-25 03:05:04,056: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:05:04.058284368Z [2024-05-25 03:05:04,058: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:05:04.058310888Z [2024-05-25 03:05:04,058: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:05:04.058439635Z [2024-05-25 03:05:04,058: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:05:04.058467651Z [2024-05-25 03:05:04,058: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T03:05:04.058692640Z [2024-05-25 03:05:04,058: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T03:05:04.058713097Z [2024-05-25 03:05:04,058: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:05:04.168538609Z [2024-05-25 03:05:04,168: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:05:04.781904083Z [2024-05-25 03:05:04,781: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d547c23f-b3eb-4f3b-b366-095810959942] succeeded in 3.846283807000873s: None 2024-05-25T03:05:05.502858424Z [2024-05-25 03:05:05,502: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cea3ceb8-db59-4a6b-8690-4a4254feff4a] received 2024-05-25T03:05:05.513537551Z [2024-05-25 03:05:05,513: INFO/ForkPoolWorker-15] [cea3ceb8-db59-4a6b-8690-4a4254feff4a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T03:05:05.632697382Z [2024-05-25 03:05:05,632: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3cf0f221-ba23-485c-8dbd-f47af5319ed9] succeeded in 4.65450039300049s: None 2024-05-25T03:05:05.731458541Z [2024-05-25 03:05:05,731: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bebab6dc-8e52-4271-ab4a-0149e01d9711] succeeded in 4.79431182100052s: None 2024-05-25T03:05:05.841665011Z [2024-05-25 03:05:05,838: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T03:05:06.973585836Z [2024-05-25 03:05:06,973: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T03:05:06.977585823Z [2024-05-25 03:05:06,976: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:05:07.006556159Z [2024-05-25 03:05:07,006: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:05:07.007941346Z [2024-05-25 03:05:07,007: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:05:07.008030011Z [2024-05-25 03:05:07,007: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:05:07.008117800Z [2024-05-25 03:05:07,007: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:05:07.008244028Z [2024-05-25 03:05:07,008: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T03:05:07.008618905Z [2024-05-25 03:05:07,008: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T03:05:07.008731140Z [2024-05-25 03:05:07,008: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:05:07.113441590Z [2024-05-25 03:05:07,113: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:05:07.884470933Z [2024-05-25 03:05:07,884: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cea3ceb8-db59-4a6b-8690-4a4254feff4a] succeeded in 2.37898183300058s: None 2024-05-25T03:05:07.891105110Z [2024-05-25 03:05:07,890: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dce53892-d571-448e-b125-d4c7c9e24732] received 2024-05-25T03:05:07.897924282Z [2024-05-25 03:05:07,897: INFO/ForkPoolWorker-15] [dce53892-d571-448e-b125-d4c7c9e24732] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T03:05:08.354226441Z [2024-05-25 03:05:08,350: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T03:05:09.400030314Z [2024-05-25 03:05:09,399: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T03:05:09.403102110Z [2024-05-25 03:05:09,402: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:05:09.428041697Z [2024-05-25 03:05:09,427: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:05:09.429707528Z [2024-05-25 03:05:09,429: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:05:09.429744212Z [2024-05-25 03:05:09,429: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:05:09.429934399Z [2024-05-25 03:05:09,429: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:05:09.429980058Z [2024-05-25 03:05:09,429: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T03:05:09.430273358Z [2024-05-25 03:05:09,430: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T03:05:09.430357313Z [2024-05-25 03:05:09,430: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:05:09.524111068Z [2024-05-25 03:05:09,523: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:05:10.153398296Z [2024-05-25 03:05:10,152: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dce53892-d571-448e-b125-d4c7c9e24732] succeeded in 2.2603802230005385s: None 2024-05-25T03:05:10.527782957Z [2024-05-25 03:05:10,527: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45f0812b-ecad-4ff3-b5fc-27d9fa93109c] received 2024-05-25T03:05:10.541771710Z [2024-05-25 03:05:10,540: INFO/ForkPoolWorker-15] [45f0812b-ecad-4ff3-b5fc-27d9fa93109c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T03:05:10.837637035Z [2024-05-25 03:05:10,834: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T03:05:11.895881074Z [2024-05-25 03:05:11,889: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T03:05:11.895907966Z [2024-05-25 03:05:11,892: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:05:11.918809104Z [2024-05-25 03:05:11,918: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:05:11.921352678Z [2024-05-25 03:05:11,920: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:05:11.921404317Z [2024-05-25 03:05:11,920: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:05:11.921411031Z [2024-05-25 03:05:11,920: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:05:11.921416823Z [2024-05-25 03:05:11,920: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T03:05:11.921421821Z [2024-05-25 03:05:11,920: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T03:05:11.921426873Z [2024-05-25 03:05:11,920: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:05:12.049733136Z [2024-05-25 03:05:12,049: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:05:12.712765719Z [2024-05-25 03:05:12,712: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[45f0812b-ecad-4ff3-b5fc-27d9fa93109c] succeeded in 2.1832266219989833s: None 2024-05-25T03:06:00.407330468Z [2024-05-25 03:06:00,406: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e30e633-3edc-4fef-b31d-1e25dd86be8f] received 2024-05-25T03:06:00.413852902Z [2024-05-25 03:06:00,413: INFO/ForkPoolWorker-15] [7e30e633-3edc-4fef-b31d-1e25dd86be8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:06:00.421833841Z [2024-05-25 03:06:00,421: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edff44ac-0b97-447a-bdc3-1a54fa4fc264] received 2024-05-25T03:06:00.423955125Z [2024-05-25 03:06:00,423: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[164724de-b6a1-4106-b08e-7b189fd6835c] received 2024-05-25T03:06:00.425659697Z [2024-05-25 03:06:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90811dff-051b-444d-b4e7-ca129b66d263] received 2024-05-25T03:06:00.431705396Z [2024-05-25 03:06:00,431: INFO/ForkPoolWorker-16] [edff44ac-0b97-447a-bdc3-1a54fa4fc264] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T03:06:00.438851846Z [2024-05-25 03:06:00,438: INFO/ForkPoolWorker-2] [90811dff-051b-444d-b4e7-ca129b66d263] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:06:00.450931183Z [2024-05-25 03:06:00,450: INFO/ForkPoolWorker-1] [164724de-b6a1-4106-b08e-7b189fd6835c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:06:00.747712455Z [2024-05-25 03:06:00,742: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T03:06:00.749708944Z [2024-05-25 03:06:00,746: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T03:06:00.792006391Z [2024-05-25 03:06:00,788: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T03:06:00.805538981Z [2024-05-25 03:06:00,802: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T03:06:00.966459669Z [2024-05-25 03:06:00,966: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T03:06:00.975009973Z [2024-05-25 03:06:00,974: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:06:01.008737531Z [2024-05-25 03:06:01,008: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T03:06:01.014060285Z [2024-05-25 03:06:01,013: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T03:06:01.014246936Z [2024-05-25 03:06:01,014: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T03:06:01.014337177Z [2024-05-25 03:06:01,014: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T03:06:01.014570023Z [2024-05-25 03:06:01,014: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T03:06:01.122121912Z [2024-05-25 03:06:01,119: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:06:01.128203085Z [2024-05-25 03:06:01,127: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:06:01.733660721Z [2024-05-25 03:06:01,731: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[edff44ac-0b97-447a-bdc3-1a54fa4fc264] succeeded in 1.3078941750009108s: None 2024-05-25T03:06:01.795328474Z [2024-05-25 03:06:01,794: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[164724de-b6a1-4106-b08e-7b189fd6835c] succeeded in 1.3681461310006853s: None 2024-05-25T03:06:02.041628760Z [2024-05-25 03:06:02,041: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T03:06:02.044966963Z [2024-05-25 03:06:02,044: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:06:02.070994268Z [2024-05-25 03:06:02,070: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T03:06:02.072890268Z [2024-05-25 03:06:02,072: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:06:02.073129675Z [2024-05-25 03:06:02,072: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:06:02.073407278Z [2024-05-25 03:06:02,073: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:06:02.073597804Z [2024-05-25 03:06:02,073: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T03:06:02.073984205Z [2024-05-25 03:06:02,073: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T03:06:02.074168138Z [2024-05-25 03:06:02,073: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:06:02.105620621Z [2024-05-25 03:06:02,105: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T03:06:02.109147394Z [2024-05-25 03:06:02,108: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:06:02.135696184Z [2024-05-25 03:06:02,135: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:06:02.138008969Z [2024-05-25 03:06:02,137: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:06:02.138063574Z [2024-05-25 03:06:02,137: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:06:02.138261475Z [2024-05-25 03:06:02,138: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:06:02.138319258Z [2024-05-25 03:06:02,138: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T03:06:02.138811527Z [2024-05-25 03:06:02,138: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T03:06:02.138899700Z [2024-05-25 03:06:02,138: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:06:02.168026246Z [2024-05-25 03:06:02,167: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:06:02.310097409Z [2024-05-25 03:06:02,309: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:06:03.963274581Z [2024-05-25 03:06:03,962: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7e30e633-3edc-4fef-b31d-1e25dd86be8f] succeeded in 3.553659475001041s: None 2024-05-25T03:06:04.038530906Z [2024-05-25 03:06:04,037: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[90811dff-051b-444d-b4e7-ca129b66d263] succeeded in 3.6106647350006824s: None 2024-05-25T03:07:01.244085737Z [2024-05-25 03:07:01,243: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8eb6604-7fca-40c4-b206-51393007636b] received 2024-05-25T03:07:01.255490726Z [2024-05-25 03:07:01,255: INFO/ForkPoolWorker-15] [e8eb6604-7fca-40c4-b206-51393007636b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:07:01.260561621Z [2024-05-25 03:07:01,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5540bf62-70c9-4c63-8169-49f684382925] received 2024-05-25T03:07:01.267196966Z [2024-05-25 03:07:01,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a53a232-44a6-4572-8233-5e53c6210384] received 2024-05-25T03:07:01.271444481Z [2024-05-25 03:07:01,271: INFO/ForkPoolWorker-16] [5540bf62-70c9-4c63-8169-49f684382925] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:07:01.274068939Z [2024-05-25 03:07:01,273: INFO/ForkPoolWorker-1] [5a53a232-44a6-4572-8233-5e53c6210384] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:07:01.580743339Z [2024-05-25 03:07:01,577: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T03:07:01.607795773Z [2024-05-25 03:07:01,604: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T03:07:01.614519600Z [2024-05-25 03:07:01,611: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T03:07:01.786602501Z [2024-05-25 03:07:01,786: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T03:07:01.790803628Z [2024-05-25 03:07:01,790: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:07:01.811524337Z [2024-05-25 03:07:01,811: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T03:07:01.812759744Z [2024-05-25 03:07:01,812: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T03:07:01.812838607Z [2024-05-25 03:07:01,812: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T03:07:01.812923197Z [2024-05-25 03:07:01,812: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T03:07:01.813579108Z [2024-05-25 03:07:01,813: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T03:07:01.909863990Z [2024-05-25 03:07:01,909: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:07:02.587117292Z [2024-05-25 03:07:02,586: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5540bf62-70c9-4c63-8169-49f684382925] succeeded in 1.3225055530001555s: None 2024-05-25T03:07:02.764741349Z [2024-05-25 03:07:02,764: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T03:07:02.767760405Z [2024-05-25 03:07:02,767: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:07:02.794049078Z [2024-05-25 03:07:02,793: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:07:02.796064427Z [2024-05-25 03:07:02,795: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:07:02.796103385Z [2024-05-25 03:07:02,796: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:07:02.796263240Z [2024-05-25 03:07:02,796: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:07:02.796305548Z [2024-05-25 03:07:02,796: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T03:07:02.796912370Z [2024-05-25 03:07:02,796: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T03:07:02.796971979Z [2024-05-25 03:07:02,796: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:07:02.816651324Z [2024-05-25 03:07:02,816: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T03:07:02.819832608Z [2024-05-25 03:07:02,819: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:07:02.841650763Z [2024-05-25 03:07:02,841: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T03:07:02.843357060Z [2024-05-25 03:07:02,843: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:07:02.843469564Z [2024-05-25 03:07:02,843: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:07:02.843806889Z [2024-05-25 03:07:02,843: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:07:02.843983113Z [2024-05-25 03:07:02,843: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T03:07:02.844377938Z [2024-05-25 03:07:02,844: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T03:07:02.844394756Z [2024-05-25 03:07:02,844: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:07:02.881434976Z [2024-05-25 03:07:02,881: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:07:02.925292520Z [2024-05-25 03:07:02,924: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:07:04.428629740Z [2024-05-25 03:07:04,427: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5a53a232-44a6-4572-8233-5e53c6210384] succeeded in 3.158192283999597s: None 2024-05-25T03:07:04.643179940Z [2024-05-25 03:07:04,642: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e8eb6604-7fca-40c4-b206-51393007636b] succeeded in 3.3957560250000824s: None 2024-05-25T03:08:00.577603945Z [2024-05-25 03:08:00,577: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[901e0454-2854-4ae3-9ae9-fa54a466486a] received 2024-05-25T03:08:00.579100734Z [2024-05-25 03:08:00,578: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3cd89d0d-3e93-4e45-8c38-b7b5b1eddc04] received 2024-05-25T03:08:00.583611793Z [2024-05-25 03:08:00,583: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cac6ef0e-c793-469d-9503-7da71db6bcb1] received 2024-05-25T03:08:00.585252221Z [2024-05-25 03:08:00,585: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4201a757-1697-46ce-af14-945a88e492a8] received 2024-05-25T03:08:00.604521317Z [2024-05-25 03:08:00,604: INFO/ForkPoolWorker-2] [4201a757-1697-46ce-af14-945a88e492a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:08:00.607802833Z [2024-05-25 03:08:00,607: INFO/ForkPoolWorker-1] [cac6ef0e-c793-469d-9503-7da71db6bcb1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:08:00.609896897Z [2024-05-25 03:08:00,609: INFO/ForkPoolWorker-16] [3cd89d0d-3e93-4e45-8c38-b7b5b1eddc04] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:08:00.610016795Z [2024-05-25 03:08:00,608: INFO/ForkPoolWorker-15] [901e0454-2854-4ae3-9ae9-fa54a466486a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T03:08:00.879233911Z [2024-05-25 03:08:00,874: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T03:08:00.895378917Z [2024-05-25 03:08:00,890: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T03:08:00.907902299Z [2024-05-25 03:08:00,904: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T03:08:01.017778585Z [2024-05-25 03:08:01,010: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T03:08:01.079331573Z [2024-05-25 03:08:01,078: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T03:08:01.083150338Z [2024-05-25 03:08:01,082: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:08:01.115630514Z [2024-05-25 03:08:01,115: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T03:08:01.118833139Z [2024-05-25 03:08:01,117: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T03:08:01.119072471Z [2024-05-25 03:08:01,118: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T03:08:01.119371754Z [2024-05-25 03:08:01,119: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T03:08:01.121506892Z [2024-05-25 03:08:01,121: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T03:08:01.231774542Z [2024-05-25 03:08:01,231: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:08:01.326883474Z [2024-05-25 03:08:01,326: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:08:02.009569330Z [2024-05-25 03:08:02,008: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4201a757-1697-46ce-af14-945a88e492a8] succeeded in 1.4212006800007657s: None 2024-05-25T03:08:02.018132708Z [2024-05-25 03:08:02,017: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[901e0454-2854-4ae3-9ae9-fa54a466486a] succeeded in 1.4382308459989872s: None 2024-05-25T03:08:02.412356388Z [2024-05-25 03:08:02,411: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T03:08:02.416029151Z [2024-05-25 03:08:02,414: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:08:02.436989115Z [2024-05-25 03:08:02,436: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T03:08:02.440355240Z [2024-05-25 03:08:02,440: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:08:02.440423106Z [2024-05-25 03:08:02,440: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:08:02.440479733Z [2024-05-25 03:08:02,440: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:08:02.440549184Z [2024-05-25 03:08:02,440: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T03:08:02.440872238Z [2024-05-25 03:08:02,440: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T03:08:02.440923496Z [2024-05-25 03:08:02,440: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:08:02.471222746Z [2024-05-25 03:08:02,470: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T03:08:02.474419134Z [2024-05-25 03:08:02,473: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:08:02.497461522Z [2024-05-25 03:08:02,496: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T03:08:02.502473667Z [2024-05-25 03:08:02,502: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:08:02.502767028Z [2024-05-25 03:08:02,502: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:08:02.503102202Z [2024-05-25 03:08:02,502: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:08:02.503398687Z [2024-05-25 03:08:02,503: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T03:08:02.504053341Z [2024-05-25 03:08:02,503: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T03:08:02.504314345Z [2024-05-25 03:08:02,504: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:08:02.511661640Z [2024-05-25 03:08:02,511: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:08:02.600171337Z [2024-05-25 03:08:02,599: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:08:04.108645553Z [2024-05-25 03:08:04,108: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cac6ef0e-c793-469d-9503-7da71db6bcb1] succeeded in 3.5221343579996756s: None 2024-05-25T03:08:04.524204465Z [2024-05-25 03:08:04,523: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3cd89d0d-3e93-4e45-8c38-b7b5b1eddc04] succeeded in 3.941086318000089s: None 2024-05-25T03:09:00.815546435Z [2024-05-25 03:09:00,815: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c883c92c-317c-4963-a375-3ed8da13436c] received 2024-05-25T03:09:00.816832881Z [2024-05-25 03:09:00,816: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f265207-da90-4c91-9789-7b41e7d77be8] received 2024-05-25T03:09:00.826054045Z [2024-05-25 03:09:00,825: INFO/ForkPoolWorker-15] [c883c92c-317c-4963-a375-3ed8da13436c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:09:00.826293164Z [2024-05-25 03:09:00,826: INFO/ForkPoolWorker-16] [2f265207-da90-4c91-9789-7b41e7d77be8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:09:00.836472962Z [2024-05-25 03:09:00,836: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[173f9e3a-432c-4f63-9717-0a4db1eb485d] received 2024-05-25T03:09:00.852140236Z [2024-05-25 03:09:00,851: INFO/ForkPoolWorker-1] [173f9e3a-432c-4f63-9717-0a4db1eb485d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:09:01.157266207Z [2024-05-25 03:09:01,154: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T03:09:01.161446254Z [2024-05-25 03:09:01,158: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T03:09:01.175504928Z [2024-05-25 03:09:01,171: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T03:09:01.357318820Z [2024-05-25 03:09:01,355: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T03:09:01.377618893Z [2024-05-25 03:09:01,360: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:09:01.430729342Z [2024-05-25 03:09:01,430: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T03:09:01.437360817Z [2024-05-25 03:09:01,437: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T03:09:01.437563114Z [2024-05-25 03:09:01,437: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T03:09:01.437627167Z [2024-05-25 03:09:01,437: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T03:09:01.437789939Z [2024-05-25 03:09:01,437: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T03:09:01.552171452Z [2024-05-25 03:09:01,551: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:09:02.123473334Z [2024-05-25 03:09:02,123: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[173f9e3a-432c-4f63-9717-0a4db1eb485d] succeeded in 1.283999909999693s: None 2024-05-25T03:09:02.284490245Z [2024-05-25 03:09:02,283: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T03:09:02.289307828Z [2024-05-25 03:09:02,288: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:09:02.306239730Z [2024-05-25 03:09:02,306: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:09:02.307359176Z [2024-05-25 03:09:02,307: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:09:02.307466118Z [2024-05-25 03:09:02,307: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:09:02.307600266Z [2024-05-25 03:09:02,307: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:09:02.307677456Z [2024-05-25 03:09:02,307: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T03:09:02.307926002Z [2024-05-25 03:09:02,307: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T03:09:02.308016597Z [2024-05-25 03:09:02,307: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:09:02.406310439Z [2024-05-25 03:09:02,405: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T03:09:02.409609756Z [2024-05-25 03:09:02,409: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:09:02.446681464Z [2024-05-25 03:09:02,446: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:09:02.446883887Z [2024-05-25 03:09:02,446: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T03:09:02.449127006Z [2024-05-25 03:09:02,448: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:09:02.449469833Z [2024-05-25 03:09:02,449: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:09:02.449810570Z [2024-05-25 03:09:02,449: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:09:02.450028444Z [2024-05-25 03:09:02,449: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T03:09:02.450389027Z [2024-05-25 03:09:02,450: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T03:09:02.450575430Z [2024-05-25 03:09:02,450: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:09:02.522570727Z [2024-05-25 03:09:02,522: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:09:04.024050649Z [2024-05-25 03:09:04,023: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2f265207-da90-4c91-9789-7b41e7d77be8] succeeded in 3.2054360109996196s: None 2024-05-25T03:09:04.369442942Z [2024-05-25 03:09:04,368: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c883c92c-317c-4963-a375-3ed8da13436c] succeeded in 3.5500424049987487s: None 2024-05-25T03:10:01.197951372Z [2024-05-25 03:10:01,197: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ac88213-cc28-4c1e-b390-f4b76182ba9a] received 2024-05-25T03:10:01.199863526Z [2024-05-25 03:10:01,199: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a39138d6-a06d-4b51-b789-97ec475627e4] received 2024-05-25T03:10:01.210372357Z [2024-05-25 03:10:01,210: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd6a79c1-09da-44f4-946b-a38f510cf76a] received 2024-05-25T03:10:01.211004736Z [2024-05-25 03:10:01,210: INFO/ForkPoolWorker-15] [4ac88213-cc28-4c1e-b390-f4b76182ba9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T03:10:01.213621055Z [2024-05-25 03:10:01,213: INFO/ForkPoolWorker-16] [a39138d6-a06d-4b51-b789-97ec475627e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T03:10:01.216659619Z [2024-05-25 03:10:01,216: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c215b33f-3374-480d-bc8f-3464bfaa07f0] received 2024-05-25T03:10:01.217929140Z [2024-05-25 03:10:01,217: INFO/ForkPoolWorker-1] [fd6a79c1-09da-44f4-946b-a38f510cf76a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:10:01.218869032Z [2024-05-25 03:10:01,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[662a4d9b-79e2-4be4-ac1c-f1371fa72938] received 2024-05-25T03:10:01.228207278Z [2024-05-25 03:10:01,227: INFO/ForkPoolWorker-2] [c215b33f-3374-480d-bc8f-3464bfaa07f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:10:01.233787925Z [2024-05-25 03:10:01,233: INFO/ForkPoolWorker-3] [662a4d9b-79e2-4be4-ac1c-f1371fa72938] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:10:01.620704331Z [2024-05-25 03:10:01,616: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T03:10:01.681527041Z [2024-05-25 03:10:01,678: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T03:10:01.683198119Z [2024-05-25 03:10:01,676: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T03:10:01.747783087Z [2024-05-25 03:10:01,744: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T03:10:01.827425192Z [2024-05-25 03:10:01,824: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T03:10:01.919518222Z [2024-05-25 03:10:01,919: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:10:01.974585654Z [2024-05-25 03:10:01,974: INFO/ForkPoolWorker-3] Getting SDNC list 2024-05-25T03:10:01.978575252Z [2024-05-25 03:10:01,978: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:10:02.035739179Z [2024-05-25 03:10:02,035: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-05-25T03:10:02.054150865Z [2024-05-25 03:10:02,053: INFO/ForkPoolWorker-3] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T03:10:02.054390319Z [2024-05-25 03:10:02,054: INFO/ForkPoolWorker-3] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T03:10:02.054568191Z [2024-05-25 03:10:02,054: INFO/ForkPoolWorker-3] Getting SDNC list OK 2024-05-25T03:10:02.054858359Z [2024-05-25 03:10:02,054: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T03:10:02.233347175Z [2024-05-25 03:10:02,224: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:10:02.728563568Z [2024-05-25 03:10:02,728: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a39138d6-a06d-4b51-b789-97ec475627e4] succeeded in 1.5211927430009382s: None 2024-05-25T03:10:02.981432825Z [2024-05-25 03:10:02,981: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[662a4d9b-79e2-4be4-ac1c-f1371fa72938] succeeded in 1.7593239060006454s: None 2024-05-25T03:10:03.141839032Z [2024-05-25 03:10:03,141: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T03:10:03.144919771Z [2024-05-25 03:10:03,144: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:10:03.175096957Z [2024-05-25 03:10:03,174: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:10:03.177442865Z [2024-05-25 03:10:03,177: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:10:03.177534350Z [2024-05-25 03:10:03,177: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:10:03.177759186Z [2024-05-25 03:10:03,177: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:10:03.177956005Z [2024-05-25 03:10:03,177: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T03:10:03.178400235Z [2024-05-25 03:10:03,178: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T03:10:03.178486133Z [2024-05-25 03:10:03,178: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:10:03.202644822Z [2024-05-25 03:10:03,202: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T03:10:03.206013341Z [2024-05-25 03:10:03,205: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:10:03.225978033Z [2024-05-25 03:10:03,225: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T03:10:03.227092348Z [2024-05-25 03:10:03,226: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:10:03.227240059Z [2024-05-25 03:10:03,227: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:10:03.227433230Z [2024-05-25 03:10:03,227: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:10:03.227573381Z [2024-05-25 03:10:03,227: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T03:10:03.227973982Z [2024-05-25 03:10:03,227: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T03:10:03.228130529Z [2024-05-25 03:10:03,227: INFO/ForkPoolWorker-2] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:10:03.276327755Z [2024-05-25 03:10:03,276: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:10:03.300208318Z [2024-05-25 03:10:03,299: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:10:03.339182440Z [2024-05-25 03:10:03,338: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T03:10:03.342505839Z [2024-05-25 03:10:03,342: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:10:03.377675501Z [2024-05-25 03:10:03,377: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T03:10:03.379504990Z [2024-05-25 03:10:03,379: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:10:03.379702391Z [2024-05-25 03:10:03,379: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:10:03.379989361Z [2024-05-25 03:10:03,379: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:10:03.380179574Z [2024-05-25 03:10:03,380: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T03:10:03.382391918Z [2024-05-25 03:10:03,382: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T03:10:03.382605565Z [2024-05-25 03:10:03,382: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:10:03.497699172Z [2024-05-25 03:10:03,497: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:10:04.028425808Z [2024-05-25 03:10:04,027: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4ac88213-cc28-4c1e-b390-f4b76182ba9a] succeeded in 2.8261078510004154s: None 2024-05-25T03:10:04.893139042Z [2024-05-25 03:10:04,892: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c215b33f-3374-480d-bc8f-3464bfaa07f0] succeeded in 3.6735775870001817s: None 2024-05-25T03:10:04.922105209Z [2024-05-25 03:10:04,921: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15e6a2b5-ecd8-4e81-abc3-db3e9aea1853] received 2024-05-25T03:10:04.938937230Z [2024-05-25 03:10:04,938: INFO/ForkPoolWorker-15] [15e6a2b5-ecd8-4e81-abc3-db3e9aea1853] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T03:10:05.234641539Z [2024-05-25 03:10:05,231: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T03:10:05.453910615Z [2024-05-25 03:10:05,451: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fd6a79c1-09da-44f4-946b-a38f510cf76a] succeeded in 4.240184329999465s: None 2024-05-25T03:10:06.603456523Z [2024-05-25 03:10:06,603: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T03:10:06.606600023Z [2024-05-25 03:10:06,606: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:10:06.635738275Z [2024-05-25 03:10:06,635: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:10:06.637099195Z [2024-05-25 03:10:06,636: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:10:06.637144922Z [2024-05-25 03:10:06,637: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:10:06.637236248Z [2024-05-25 03:10:06,637: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:10:06.637329076Z [2024-05-25 03:10:06,637: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T03:10:06.637543621Z [2024-05-25 03:10:06,637: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T03:10:06.637580838Z [2024-05-25 03:10:06,637: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:10:06.730186311Z [2024-05-25 03:10:06,729: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:10:07.355452755Z [2024-05-25 03:10:07,355: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[15e6a2b5-ecd8-4e81-abc3-db3e9aea1853] succeeded in 2.425987595001061s: None 2024-05-25T03:10:08.081369651Z [2024-05-25 03:10:08,075: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2fe11b60-fcfc-433b-9965-bc4918883c74] received 2024-05-25T03:10:08.093336592Z [2024-05-25 03:10:08,085: INFO/ForkPoolWorker-15] [2fe11b60-fcfc-433b-9965-bc4918883c74] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T03:10:08.418988027Z [2024-05-25 03:10:08,415: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T03:10:09.491262599Z [2024-05-25 03:10:09,490: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T03:10:09.494401177Z [2024-05-25 03:10:09,493: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:10:09.520508909Z [2024-05-25 03:10:09,520: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:10:09.522191264Z [2024-05-25 03:10:09,521: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:10:09.522229141Z [2024-05-25 03:10:09,522: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:10:09.522478640Z [2024-05-25 03:10:09,522: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:10:09.522507684Z [2024-05-25 03:10:09,522: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T03:10:09.522852223Z [2024-05-25 03:10:09,522: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T03:10:09.522905712Z [2024-05-25 03:10:09,522: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:10:09.654352596Z [2024-05-25 03:10:09,653: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:10:10.267893084Z [2024-05-25 03:10:10,267: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2fe11b60-fcfc-433b-9965-bc4918883c74] succeeded in 2.1894281980003143s: None 2024-05-25T03:10:10.425702050Z [2024-05-25 03:10:10,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[178fb612-0adc-4d21-b9fc-61002c1a8176] received 2024-05-25T03:10:10.438867133Z [2024-05-25 03:10:10,438: INFO/ForkPoolWorker-15] [178fb612-0adc-4d21-b9fc-61002c1a8176] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T03:10:10.761576837Z [2024-05-25 03:10:10,758: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T03:10:11.819892516Z [2024-05-25 03:10:11,819: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T03:10:11.822896789Z [2024-05-25 03:10:11,822: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:10:11.845439114Z [2024-05-25 03:10:11,845: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:10:11.846760571Z [2024-05-25 03:10:11,846: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:10:11.846855096Z [2024-05-25 03:10:11,846: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:10:11.847020816Z [2024-05-25 03:10:11,846: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:10:11.847088145Z [2024-05-25 03:10:11,846: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T03:10:11.847460576Z [2024-05-25 03:10:11,847: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T03:10:11.847592359Z [2024-05-25 03:10:11,847: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:10:11.929020309Z [2024-05-25 03:10:11,928: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:10:12.637016181Z [2024-05-25 03:10:12,636: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[178fb612-0adc-4d21-b9fc-61002c1a8176] succeeded in 2.206995939999615s: None 2024-05-25T03:11:00.209897212Z [2024-05-25 03:11:00,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75baf8ae-e957-4c51-9962-442f4e1ff90c] received 2024-05-25T03:11:00.217795121Z [2024-05-25 03:11:00,217: INFO/ForkPoolWorker-15] [75baf8ae-e957-4c51-9962-442f4e1ff90c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:11:00.221894858Z [2024-05-25 03:11:00,217: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dcd28b27-0e2a-4388-b518-729baff7c69a] received 2024-05-25T03:11:00.223391104Z [2024-05-25 03:11:00,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a9c4b1f-a401-48b2-a76d-794296c776f3] received 2024-05-25T03:11:00.244669598Z [2024-05-25 03:11:00,243: INFO/ForkPoolWorker-16] [dcd28b27-0e2a-4388-b518-729baff7c69a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:11:00.251881345Z [2024-05-25 03:11:00,251: INFO/ForkPoolWorker-1] [2a9c4b1f-a401-48b2-a76d-794296c776f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:11:00.547763957Z [2024-05-25 03:11:00,544: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T03:11:00.604854349Z [2024-05-25 03:11:00,600: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T03:11:00.648093917Z [2024-05-25 03:11:00,644: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T03:11:00.761761505Z [2024-05-25 03:11:00,761: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T03:11:00.766146975Z [2024-05-25 03:11:00,765: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:11:00.788047097Z [2024-05-25 03:11:00,787: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T03:11:00.789322748Z [2024-05-25 03:11:00,788: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T03:11:00.789385108Z [2024-05-25 03:11:00,789: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T03:11:00.789482599Z [2024-05-25 03:11:00,789: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T03:11:00.789928971Z [2024-05-25 03:11:00,789: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T03:11:00.885995867Z [2024-05-25 03:11:00,885: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:11:01.458549880Z [2024-05-25 03:11:01,458: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2a9c4b1f-a401-48b2-a76d-794296c776f3] succeeded in 1.2219215969998913s: None 2024-05-25T03:11:01.668924846Z [2024-05-25 03:11:01,668: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T03:11:01.672234284Z [2024-05-25 03:11:01,671: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:11:01.688249910Z [2024-05-25 03:11:01,688: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:11:01.689985084Z [2024-05-25 03:11:01,689: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:11:01.690779090Z [2024-05-25 03:11:01,690: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:11:01.691022411Z [2024-05-25 03:11:01,690: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:11:01.691073960Z [2024-05-25 03:11:01,690: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T03:11:01.691470070Z [2024-05-25 03:11:01,691: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T03:11:01.691653653Z [2024-05-25 03:11:01,691: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:11:01.784834260Z [2024-05-25 03:11:01,784: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:11:01.786892736Z [2024-05-25 03:11:01,786: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T03:11:01.790339088Z [2024-05-25 03:11:01,789: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:11:01.817985924Z [2024-05-25 03:11:01,817: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T03:11:01.819667705Z [2024-05-25 03:11:01,819: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:11:01.819897643Z [2024-05-25 03:11:01,819: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:11:01.820200597Z [2024-05-25 03:11:01,819: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:11:01.820383581Z [2024-05-25 03:11:01,820: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T03:11:01.820825446Z [2024-05-25 03:11:01,820: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T03:11:01.821071646Z [2024-05-25 03:11:01,820: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:11:01.926087420Z [2024-05-25 03:11:01,925: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:11:03.418646051Z [2024-05-25 03:11:03,417: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dcd28b27-0e2a-4388-b518-729baff7c69a] succeeded in 3.1892992180000874s: None 2024-05-25T03:11:03.818144259Z [2024-05-25 03:11:03,817: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[75baf8ae-e957-4c51-9962-442f4e1ff90c] succeeded in 3.606397850999201s: None 2024-05-25T03:12:00.857558436Z [2024-05-25 03:12:00,857: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[848157d5-20a5-438e-a179-4d9d40954d26] received 2024-05-25T03:12:00.859626778Z [2024-05-25 03:12:00,859: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7403c93-cfbe-4318-a964-bc1fd490c814] received 2024-05-25T03:12:00.865489990Z [2024-05-25 03:12:00,865: INFO/ForkPoolWorker-15] [848157d5-20a5-438e-a179-4d9d40954d26] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:12:00.869130340Z [2024-05-25 03:12:00,868: INFO/ForkPoolWorker-16] [a7403c93-cfbe-4318-a964-bc1fd490c814] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T03:12:00.877929044Z [2024-05-25 03:12:00,877: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72c4e6e8-51df-4e64-a51a-d368bbaa4298] received 2024-05-25T03:12:00.879559298Z [2024-05-25 03:12:00,879: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5d844e5-2c1e-42c9-9d08-e946b95bb0d6] received 2024-05-25T03:12:00.885821575Z [2024-05-25 03:12:00,885: INFO/ForkPoolWorker-1] [72c4e6e8-51df-4e64-a51a-d368bbaa4298] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:12:00.888415782Z [2024-05-25 03:12:00,888: INFO/ForkPoolWorker-2] [b5d844e5-2c1e-42c9-9d08-e946b95bb0d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:12:01.179873391Z [2024-05-25 03:12:01,176: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T03:12:01.229420886Z [2024-05-25 03:12:01,225: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T03:12:01.245905300Z [2024-05-25 03:12:01,242: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T03:12:01.445666374Z [2024-05-25 03:12:01,441: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T03:12:01.518375142Z [2024-05-25 03:12:01,518: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:12:01.645802149Z [2024-05-25 03:12:01,645: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T03:12:01.649945404Z [2024-05-25 03:12:01,649: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:12:01.690205400Z [2024-05-25 03:12:01,689: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T03:12:01.691554327Z [2024-05-25 03:12:01,691: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T03:12:01.691832206Z [2024-05-25 03:12:01,691: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T03:12:01.692024151Z [2024-05-25 03:12:01,691: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T03:12:01.692295384Z [2024-05-25 03:12:01,692: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T03:12:01.784262412Z [2024-05-25 03:12:01,784: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:12:02.093875341Z [2024-05-25 03:12:02,093: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a7403c93-cfbe-4318-a964-bc1fd490c814] succeeded in 1.2320558210012678s: None 2024-05-25T03:12:02.444158087Z [2024-05-25 03:12:02,443: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[72c4e6e8-51df-4e64-a51a-d368bbaa4298] succeeded in 1.5643840480006475s: None 2024-05-25T03:12:02.462161672Z [2024-05-25 03:12:02,461: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T03:12:02.471113205Z [2024-05-25 03:12:02,470: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:12:02.497394196Z [2024-05-25 03:12:02,497: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:12:02.499465217Z [2024-05-25 03:12:02,499: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:12:02.499494890Z [2024-05-25 03:12:02,499: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:12:02.500103383Z [2024-05-25 03:12:02,499: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:12:02.503571140Z [2024-05-25 03:12:02,499: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T03:12:02.504042694Z [2024-05-25 03:12:02,503: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T03:12:02.504128110Z [2024-05-25 03:12:02,503: INFO/ForkPoolWorker-15] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:12:02.504506140Z [2024-05-25 03:12:02,504: INFO/ForkPoolWorker-2] Getting VIM list 2024-05-25T03:12:02.507753344Z [2024-05-25 03:12:02,507: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:12:02.533987101Z [2024-05-25 03:12:02,533: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T03:12:02.543272689Z [2024-05-25 03:12:02,542: INFO/ForkPoolWorker-2] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:12:02.543421905Z [2024-05-25 03:12:02,543: INFO/ForkPoolWorker-2] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:12:02.543675410Z [2024-05-25 03:12:02,543: INFO/ForkPoolWorker-2] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:12:02.543816440Z [2024-05-25 03:12:02,543: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-05-25T03:12:02.544285006Z [2024-05-25 03:12:02,544: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-05-25T03:12:02.544451741Z [2024-05-25 03:12:02,544: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:12:02.612664140Z [2024-05-25 03:12:02,612: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:12:02.678256481Z [2024-05-25 03:12:02,677: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:12:04.776196823Z [2024-05-25 03:12:04,775: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b5d844e5-2c1e-42c9-9d08-e946b95bb0d6] succeeded in 3.8938757110008737s: None 2024-05-25T03:12:05.670165346Z [2024-05-25 03:12:05,669: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[848157d5-20a5-438e-a179-4d9d40954d26] succeeded in 4.810151446999953s: None 2024-05-25T03:13:00.320766108Z [2024-05-25 03:13:00,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eedb6440-bf39-43ee-844e-a4b8222f1f41] received 2024-05-25T03:13:00.328524443Z [2024-05-25 03:13:00,328: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bb020cc-34ad-4c30-97a5-aeb4538b80c5] received 2024-05-25T03:13:00.330103932Z [2024-05-25 03:13:00,329: INFO/ForkPoolWorker-15] [eedb6440-bf39-43ee-844e-a4b8222f1f41] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:13:00.337549626Z [2024-05-25 03:13:00,337: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a05791e-8afb-4424-a6c2-97bd5437f828] received 2024-05-25T03:13:00.338311537Z [2024-05-25 03:13:00,338: INFO/ForkPoolWorker-16] [9bb020cc-34ad-4c30-97a5-aeb4538b80c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:13:00.351529379Z [2024-05-25 03:13:00,351: INFO/ForkPoolWorker-1] [9a05791e-8afb-4424-a6c2-97bd5437f828] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:13:00.683470880Z [2024-05-25 03:13:00,679: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T03:13:00.730842818Z [2024-05-25 03:13:00,726: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T03:13:00.737974042Z [2024-05-25 03:13:00,732: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T03:13:00.926935818Z [2024-05-25 03:13:00,926: INFO/ForkPoolWorker-16] Getting SDNC list 2024-05-25T03:13:00.930831076Z [2024-05-25 03:13:00,930: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:13:00.992436069Z [2024-05-25 03:13:00,992: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T03:13:00.994370852Z [2024-05-25 03:13:00,994: INFO/ForkPoolWorker-16] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T03:13:00.994458933Z [2024-05-25 03:13:00,994: INFO/ForkPoolWorker-16] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T03:13:00.994467352Z [2024-05-25 03:13:00,994: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-05-25T03:13:00.994663348Z [2024-05-25 03:13:00,994: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T03:13:01.150185180Z [2024-05-25 03:13:01,149: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:13:01.775200931Z [2024-05-25 03:13:01,774: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9bb020cc-34ad-4c30-97a5-aeb4538b80c5] succeeded in 1.4446600030005357s: None 2024-05-25T03:13:02.011354209Z [2024-05-25 03:13:02,010: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T03:13:02.014666032Z [2024-05-25 03:13:02,014: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:13:02.041133039Z [2024-05-25 03:13:02,040: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:13:02.042641114Z [2024-05-25 03:13:02,042: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:13:02.042686520Z [2024-05-25 03:13:02,042: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:13:02.042821484Z [2024-05-25 03:13:02,042: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:13:02.042926221Z [2024-05-25 03:13:02,042: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T03:13:02.043206778Z [2024-05-25 03:13:02,042: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T03:13:02.043264888Z [2024-05-25 03:13:02,043: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:13:02.125502444Z [2024-05-25 03:13:02,121: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T03:13:02.129000089Z [2024-05-25 03:13:02,128: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:13:02.135790365Z [2024-05-25 03:13:02,135: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:13:02.187362590Z [2024-05-25 03:13:02,184: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T03:13:02.211564993Z [2024-05-25 03:13:02,189: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:13:02.211594050Z [2024-05-25 03:13:02,190: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:13:02.211598338Z [2024-05-25 03:13:02,190: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:13:02.211602640Z [2024-05-25 03:13:02,190: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T03:13:02.211605980Z [2024-05-25 03:13:02,190: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T03:13:02.211614320Z [2024-05-25 03:13:02,190: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:13:02.431786112Z [2024-05-25 03:13:02,431: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:13:04.696818850Z [2024-05-25 03:13:04,696: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9a05791e-8afb-4424-a6c2-97bd5437f828] succeeded in 4.356714154999281s: None 2024-05-25T03:13:05.127624229Z [2024-05-25 03:13:05,126: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eedb6440-bf39-43ee-844e-a4b8222f1f41] succeeded in 4.803637140999854s: None 2024-05-25T03:14:01.240098816Z [2024-05-25 03:14:01,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8d3535a-be10-4ec7-8cf4-6c50459e3bd2] received 2024-05-25T03:14:01.248486981Z [2024-05-25 03:14:01,248: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8c49e9d-cfef-42de-9d1f-b1eb09772105] received 2024-05-25T03:14:01.249441434Z [2024-05-25 03:14:01,249: INFO/ForkPoolWorker-15] [f8d3535a-be10-4ec7-8cf4-6c50459e3bd2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T03:14:01.278678448Z [2024-05-25 03:14:01,278: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb88089d-6132-4516-a9d2-3e393fe2ddbf] received 2024-05-25T03:14:01.280415773Z [2024-05-25 03:14:01,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10716d66-fa30-44b6-b35b-430636e0c558] received 2024-05-25T03:14:01.291454661Z [2024-05-25 03:14:01,291: INFO/ForkPoolWorker-16] [e8c49e9d-cfef-42de-9d1f-b1eb09772105] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:14:01.300686318Z [2024-05-25 03:14:01,299: INFO/ForkPoolWorker-1] [cb88089d-6132-4516-a9d2-3e393fe2ddbf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:14:01.314842575Z [2024-05-25 03:14:01,314: INFO/ForkPoolWorker-2] [10716d66-fa30-44b6-b35b-430636e0c558] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:14:01.725962759Z [2024-05-25 03:14:01,721: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T03:14:01.767653827Z [2024-05-25 03:14:01,764: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T03:14:01.806325294Z [2024-05-25 03:14:01,803: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T03:14:02.042661967Z [2024-05-25 03:14:02,027: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T03:14:02.409049830Z [2024-05-25 03:14:02,408: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T03:14:02.415730062Z [2024-05-25 03:14:02,415: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:14:02.509125957Z [2024-05-25 03:14:02,508: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:14:02.510395324Z [2024-05-25 03:14:02,510: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T03:14:02.512671424Z [2024-05-25 03:14:02,512: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T03:14:02.512788278Z [2024-05-25 03:14:02,512: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T03:14:02.513369601Z [2024-05-25 03:14:02,512: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T03:14:02.513602835Z [2024-05-25 03:14:02,513: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T03:14:02.677468768Z [2024-05-25 03:14:02,677: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:14:03.422676256Z [2024-05-25 03:14:03,422: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f8d3535a-be10-4ec7-8cf4-6c50459e3bd2] succeeded in 2.1805967970012716s: None 2024-05-25T03:14:03.430489369Z [2024-05-25 03:14:03,430: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[10716d66-fa30-44b6-b35b-430636e0c558] succeeded in 2.1390613399998983s: None 2024-05-25T03:14:03.529297348Z [2024-05-25 03:14:03,528: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T03:14:03.532489784Z [2024-05-25 03:14:03,532: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:14:03.572813396Z [2024-05-25 03:14:03,572: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T03:14:03.577956015Z [2024-05-25 03:14:03,577: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:14:03.577973764Z [2024-05-25 03:14:03,577: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:14:03.578140743Z [2024-05-25 03:14:03,577: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:14:03.578190758Z [2024-05-25 03:14:03,578: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T03:14:03.578496577Z [2024-05-25 03:14:03,578: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T03:14:03.578560349Z [2024-05-25 03:14:03,578: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:14:03.646285020Z [2024-05-25 03:14:03,645: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T03:14:03.652424896Z [2024-05-25 03:14:03,651: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:14:03.664544278Z [2024-05-25 03:14:03,664: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:14:03.676605606Z [2024-05-25 03:14:03,676: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T03:14:03.678610956Z [2024-05-25 03:14:03,678: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:14:03.678641571Z [2024-05-25 03:14:03,678: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:14:03.678811370Z [2024-05-25 03:14:03,678: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:14:03.678875459Z [2024-05-25 03:14:03,678: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T03:14:03.681423671Z [2024-05-25 03:14:03,679: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T03:14:03.681635501Z [2024-05-25 03:14:03,681: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:14:03.800535233Z [2024-05-25 03:14:03,800: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:14:05.261997275Z [2024-05-25 03:14:05,261: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cb88089d-6132-4516-a9d2-3e393fe2ddbf] succeeded in 3.978841652999108s: None 2024-05-25T03:14:05.712213142Z [2024-05-25 03:14:05,711: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e8c49e9d-cfef-42de-9d1f-b1eb09772105] succeeded in 4.458826277999833s: None 2024-05-25T03:15:01.114628201Z [2024-05-25 03:15:01,114: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10a87ed7-d1b9-4b32-9ad9-c64c6db31b22] received 2024-05-25T03:15:01.116924867Z [2024-05-25 03:15:01,116: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4874c365-5d00-4864-b65c-a5d37a5f07bf] received 2024-05-25T03:15:01.132043005Z [2024-05-25 03:15:01,131: INFO/ForkPoolWorker-16] [4874c365-5d00-4864-b65c-a5d37a5f07bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:15:01.135129645Z [2024-05-25 03:15:01,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe6232b8-ee80-42db-a632-45a399b1c45e] received 2024-05-25T03:15:01.135148668Z [2024-05-25 03:15:01,134: INFO/ForkPoolWorker-15] [10a87ed7-d1b9-4b32-9ad9-c64c6db31b22] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'extract_metrics_from_vnfrs', 'scheduled__2024-05-25T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T03:15:01.141925231Z [2024-05-25 03:15:01,141: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[737bedc1-8b31-4704-aaa6-509d92dbd410] received 2024-05-25T03:15:01.145507684Z [2024-05-25 03:15:01,145: INFO/ForkPoolWorker-1] [fe6232b8-ee80-42db-a632-45a399b1c45e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:15:01.151977681Z [2024-05-25 03:15:01,151: INFO/ForkPoolWorker-2] [737bedc1-8b31-4704-aaa6-509d92dbd410] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:15:01.434965946Z [2024-05-25 03:15:01,431: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T03:15:01.488914377Z [2024-05-25 03:15:01,486: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T03:15:01.512056131Z [2024-05-25 03:15:01,508: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T03:15:01.543461817Z [2024-05-25 03:15:01,540: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T03:15:01.683595266Z [2024-05-25 03:15:01,683: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T03:15:01.687289033Z [2024-05-25 03:15:01,686: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:15:01.706838087Z [2024-05-25 03:15:01,706: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T03:15:01.708252965Z [2024-05-25 03:15:01,708: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T03:15:01.708330864Z [2024-05-25 03:15:01,708: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T03:15:01.708372021Z [2024-05-25 03:15:01,708: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T03:15:01.708556386Z [2024-05-25 03:15:01,708: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T03:15:01.808393973Z [2024-05-25 03:15:01,808: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:15:02.593566508Z [2024-05-25 03:15:02,593: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[737bedc1-8b31-4704-aaa6-509d92dbd410] succeeded in 1.4504812410013983s: None 2024-05-25T03:15:02.816620109Z [2024-05-25 03:15:02,816: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T03:15:02.819866406Z [2024-05-25 03:15:02,819: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:15:02.849053796Z [2024-05-25 03:15:02,848: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:15:02.850647481Z [2024-05-25 03:15:02,850: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:15:02.850660319Z [2024-05-25 03:15:02,850: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:15:02.850746262Z [2024-05-25 03:15:02,850: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:15:02.850771181Z [2024-05-25 03:15:02,850: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T03:15:02.851162937Z [2024-05-25 03:15:02,851: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T03:15:02.851175362Z [2024-05-25 03:15:02,851: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:15:02.954248810Z [2024-05-25 03:15:02,953: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:15:02.972946753Z [2024-05-25 03:15:02,972: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T03:15:02.976285012Z [2024-05-25 03:15:02,975: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:15:03.007644601Z [2024-05-25 03:15:03,007: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T03:15:03.009091444Z [2024-05-25 03:15:03,008: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:15:03.009158867Z [2024-05-25 03:15:03,009: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:15:03.009382776Z [2024-05-25 03:15:03,009: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:15:03.009442450Z [2024-05-25 03:15:03,009: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T03:15:03.009780950Z [2024-05-25 03:15:03,009: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T03:15:03.009828128Z [2024-05-25 03:15:03,009: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:15:03.099657791Z [2024-05-25 03:15:03,099: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T03:15:03.102933064Z [2024-05-25 03:15:03,102: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:15:03.109049377Z [2024-05-25 03:15:03,108: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:15:03.121303750Z [2024-05-25 03:15:03,121: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T03:15:03.123584204Z [2024-05-25 03:15:03,123: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:15:03.123743251Z [2024-05-25 03:15:03,123: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:15:03.124002262Z [2024-05-25 03:15:03,123: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:15:03.124145800Z [2024-05-25 03:15:03,123: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T03:15:03.124469732Z [2024-05-25 03:15:03,124: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T03:15:03.124533909Z [2024-05-25 03:15:03,124: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:15:03.213998407Z [2024-05-25 03:15:03,213: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:15:03.567521259Z [2024-05-25 03:15:03,567: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[10a87ed7-d1b9-4b32-9ad9-c64c6db31b22] succeeded in 2.4484765739998693s: None 2024-05-25T03:15:03.972722186Z [2024-05-25 03:15:03,972: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8eb6c81e-6581-4f32-b32f-d53ae57f4cf0] received 2024-05-25T03:15:03.981481486Z [2024-05-25 03:15:03,981: INFO/ForkPoolWorker-15] [8eb6c81e-6581-4f32-b32f-d53ae57f4cf0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'split_metrics', 'scheduled__2024-05-25T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T03:15:04.350768216Z [2024-05-25 03:15:04,347: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T03:15:04.677024805Z [2024-05-25 03:15:04,676: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fe6232b8-ee80-42db-a632-45a399b1c45e] succeeded in 3.540238588999273s: None 2024-05-25T03:15:04.994955147Z [2024-05-25 03:15:04,994: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4874c365-5d00-4864-b65c-a5d37a5f07bf] succeeded in 3.8743040730005305s: None 2024-05-25T03:15:05.511950174Z [2024-05-25 03:15:05,511: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T03:15:05.515229212Z [2024-05-25 03:15:05,514: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:15:05.539250345Z [2024-05-25 03:15:05,538: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:15:05.540749659Z [2024-05-25 03:15:05,540: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:15:05.540922810Z [2024-05-25 03:15:05,540: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:15:05.541189203Z [2024-05-25 03:15:05,540: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:15:05.541242171Z [2024-05-25 03:15:05,541: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T03:15:05.541776568Z [2024-05-25 03:15:05,541: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T03:15:05.542067316Z [2024-05-25 03:15:05,541: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:15:05.618992437Z [2024-05-25 03:15:05,618: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:15:06.278281312Z [2024-05-25 03:15:06,277: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8eb6c81e-6581-4f32-b32f-d53ae57f4cf0] succeeded in 2.3040554859999247s: None 2024-05-25T03:15:07.228211676Z [2024-05-25 03:15:07,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bacb332a-6e25-4e57-acd5-43d6443f28b0] received 2024-05-25T03:15:07.248680299Z [2024-05-25 03:15:07,248: INFO/ForkPoolWorker-15] [bacb332a-6e25-4e57-acd5-43d6443f28b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'collect_metrics', 'scheduled__2024-05-25T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-05-25T03:15:07.575203367Z [2024-05-25 03:15:07,572: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T03:15:08.895223257Z [2024-05-25 03:15:08,894: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T03:15:08.898524695Z [2024-05-25 03:15:08,897: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:15:08.920349932Z [2024-05-25 03:15:08,920: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:15:08.921714645Z [2024-05-25 03:15:08,921: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:15:08.921739314Z [2024-05-25 03:15:08,921: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:15:08.921868807Z [2024-05-25 03:15:08,921: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:15:08.921886491Z [2024-05-25 03:15:08,921: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T03:15:08.922159289Z [2024-05-25 03:15:08,921: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T03:15:08.922184920Z [2024-05-25 03:15:08,922: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:15:09.036762057Z [2024-05-25 03:15:09,036: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:15:09.682995180Z [2024-05-25 03:15:09,682: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bacb332a-6e25-4e57-acd5-43d6443f28b0] succeeded in 2.448749069999394s: None 2024-05-25T03:15:10.154022637Z [2024-05-25 03:15:10,153: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[47a2771f-3c2f-4cd6-873d-fbd99b572643] received 2024-05-25T03:15:10.161745920Z [2024-05-25 03:15:10,161: INFO/ForkPoolWorker-15] [47a2771f-3c2f-4cd6-873d-fbd99b572643] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'send_prometheus', 'scheduled__2024-05-25T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-05-25T03:15:10.458193973Z [2024-05-25 03:15:10,455: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-05-25T03:15:11.521738207Z [2024-05-25 03:15:11,521: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T03:15:11.524897925Z [2024-05-25 03:15:11,524: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:15:11.548806209Z [2024-05-25 03:15:11,548: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:15:11.550153902Z [2024-05-25 03:15:11,549: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:15:11.550281914Z [2024-05-25 03:15:11,550: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:15:11.550478717Z [2024-05-25 03:15:11,550: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:15:11.550568657Z [2024-05-25 03:15:11,550: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T03:15:11.550989894Z [2024-05-25 03:15:11,550: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-05-25T03:15:11.551130745Z [2024-05-25 03:15:11,550: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:15:11.642280192Z [2024-05-25 03:15:11,641: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:15:12.288979854Z [2024-05-25 03:15:12,288: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[47a2771f-3c2f-4cd6-873d-fbd99b572643] succeeded in 2.1324214229989593s: None 2024-05-25T03:16:01.030206061Z [2024-05-25 03:16:01,029: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91dbef3d-fd51-4a8c-8bb8-2a9ce581a997] received 2024-05-25T03:16:01.032429415Z [2024-05-25 03:16:01,032: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a6dbd1c-3e66-4fd5-88a8-1646daa15c95] received 2024-05-25T03:16:01.036878421Z [2024-05-25 03:16:01,036: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b506ad2-815d-4451-bffb-feebf45d3770] received 2024-05-25T03:16:01.038942989Z [2024-05-25 03:16:01,038: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9588493-4402-4140-93dd-f990b596de2f] received 2024-05-25T03:16:01.053582243Z [2024-05-25 03:16:01,052: INFO/ForkPoolWorker-15] [91dbef3d-fd51-4a8c-8bb8-2a9ce581a997] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T03:16:01.053705116Z [2024-05-25 03:16:01,053: INFO/ForkPoolWorker-1] [8b506ad2-815d-4451-bffb-feebf45d3770] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:16:01.053711564Z [2024-05-25 03:16:01,053: INFO/ForkPoolWorker-2] [b9588493-4402-4140-93dd-f990b596de2f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:16:01.061708371Z [2024-05-25 03:16:01,061: INFO/ForkPoolWorker-16] [0a6dbd1c-3e66-4fd5-88a8-1646daa15c95] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:16:01.454977064Z [2024-05-25 03:16:01,451: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T03:16:01.472059174Z [2024-05-25 03:16:01,466: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T03:16:01.478677046Z [2024-05-25 03:16:01,475: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T03:16:01.537438466Z [2024-05-25 03:16:01,533: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T03:16:01.643437792Z [2024-05-25 03:16:01,642: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T03:16:01.647597859Z [2024-05-25 03:16:01,647: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:16:01.690376333Z [2024-05-25 03:16:01,690: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T03:16:01.692005171Z [2024-05-25 03:16:01,691: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T03:16:01.692181484Z [2024-05-25 03:16:01,691: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T03:16:01.692281396Z [2024-05-25 03:16:01,692: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T03:16:01.692600153Z [2024-05-25 03:16:01,692: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T03:16:01.786281424Z [2024-05-25 03:16:01,786: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:16:01.812663201Z [2024-05-25 03:16:01,812: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:16:02.438826897Z [2024-05-25 03:16:02,438: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[91dbef3d-fd51-4a8c-8bb8-2a9ce581a997] succeeded in 1.4066330730001937s: None 2024-05-25T03:16:02.634535304Z [2024-05-25 03:16:02,634: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b9588493-4402-4140-93dd-f990b596de2f] succeeded in 1.5935759929998312s: None 2024-05-25T03:16:02.827869848Z [2024-05-25 03:16:02,827: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T03:16:02.833022239Z [2024-05-25 03:16:02,832: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:16:02.863450396Z [2024-05-25 03:16:02,863: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T03:16:02.864956357Z [2024-05-25 03:16:02,864: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:16:02.864984102Z [2024-05-25 03:16:02,864: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:16:02.865062712Z [2024-05-25 03:16:02,864: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:16:02.865080680Z [2024-05-25 03:16:02,864: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T03:16:02.865489783Z [2024-05-25 03:16:02,865: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-05-25T03:16:02.865679011Z [2024-05-25 03:16:02,865: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:16:02.975140671Z [2024-05-25 03:16:02,973: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:16:03.042414404Z [2024-05-25 03:16:03,041: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T03:16:03.054078349Z [2024-05-25 03:16:03,051: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:16:03.095274333Z [2024-05-25 03:16:03,094: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T03:16:03.096956258Z [2024-05-25 03:16:03,096: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:16:03.097175191Z [2024-05-25 03:16:03,097: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:16:03.097483427Z [2024-05-25 03:16:03,097: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:16:03.097666734Z [2024-05-25 03:16:03,097: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T03:16:03.098191597Z [2024-05-25 03:16:03,097: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T03:16:03.098382195Z [2024-05-25 03:16:03,098: INFO/ForkPoolWorker-1] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:16:03.186754435Z [2024-05-25 03:16:03,186: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:16:04.909652695Z [2024-05-25 03:16:04,908: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8b506ad2-815d-4451-bffb-feebf45d3770] succeeded in 3.8666783359985857s: None 2024-05-25T03:16:04.960698353Z [2024-05-25 03:16:04,959: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0a6dbd1c-3e66-4fd5-88a8-1646daa15c95] succeeded in 3.925009381999189s: None 2024-05-25T03:17:00.961702959Z [2024-05-25 03:17:00,961: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15c34048-9a67-45fc-b68c-7a5310695643] received 2024-05-25T03:17:00.964056958Z [2024-05-25 03:17:00,963: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d8afc82-ea3b-419d-8a75-3b4222a69477] received 2024-05-25T03:17:00.966185720Z [2024-05-25 03:17:00,966: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a6791c3-bbb0-4fd9-9199-d5dacc1167ee] received 2024-05-25T03:17:00.977657666Z [2024-05-25 03:17:00,977: INFO/ForkPoolWorker-1] [0a6791c3-bbb0-4fd9-9199-d5dacc1167ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:17:00.978009397Z [2024-05-25 03:17:00,977: INFO/ForkPoolWorker-15] [15c34048-9a67-45fc-b68c-7a5310695643] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:17:00.981146168Z [2024-05-25 03:17:00,980: INFO/ForkPoolWorker-16] [9d8afc82-ea3b-419d-8a75-3b4222a69477] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:17:01.271430828Z [2024-05-25 03:17:01,268: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T03:17:01.289786467Z [2024-05-25 03:17:01,286: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T03:17:01.336736920Z [2024-05-25 03:17:01,332: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T03:17:01.442293432Z [2024-05-25 03:17:01,441: INFO/ForkPoolWorker-15] Getting SDNC list 2024-05-25T03:17:01.446268455Z [2024-05-25 03:17:01,445: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:17:01.469482727Z [2024-05-25 03:17:01,469: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:17:01.473870600Z [2024-05-25 03:17:01,473: INFO/ForkPoolWorker-15] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T03:17:01.474044028Z [2024-05-25 03:17:01,473: INFO/ForkPoolWorker-15] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T03:17:01.474140876Z [2024-05-25 03:17:01,473: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-05-25T03:17:01.474858051Z [2024-05-25 03:17:01,474: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T03:17:01.594599386Z [2024-05-25 03:17:01,594: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:17:02.392566233Z [2024-05-25 03:17:02,391: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[15c34048-9a67-45fc-b68c-7a5310695643] succeeded in 1.4252243600003567s: None 2024-05-25T03:17:02.613234619Z [2024-05-25 03:17:02,612: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T03:17:02.614033132Z [2024-05-25 03:17:02,613: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T03:17:02.617302004Z [2024-05-25 03:17:02,616: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:17:02.620467142Z [2024-05-25 03:17:02,619: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:17:02.642467152Z [2024-05-25 03:17:02,642: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T03:17:02.644511339Z [2024-05-25 03:17:02,644: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:17:02.644528285Z [2024-05-25 03:17:02,644: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:17:02.645203078Z [2024-05-25 03:17:02,644: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:17:02.645382584Z [2024-05-25 03:17:02,645: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T03:17:02.645745157Z [2024-05-25 03:17:02,645: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T03:17:02.645856479Z [2024-05-25 03:17:02,645: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:17:02.650787070Z [2024-05-25 03:17:02,650: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T03:17:02.652962247Z [2024-05-25 03:17:02,652: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:17:02.653176730Z [2024-05-25 03:17:02,652: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:17:02.653529602Z [2024-05-25 03:17:02,653: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:17:02.653748312Z [2024-05-25 03:17:02,653: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T03:17:02.654293288Z [2024-05-25 03:17:02,654: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T03:17:02.654551039Z [2024-05-25 03:17:02,654: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:17:02.741779517Z [2024-05-25 03:17:02,741: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:17:02.762459440Z [2024-05-25 03:17:02,762: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:17:05.094320574Z [2024-05-25 03:17:05,093: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9d8afc82-ea3b-419d-8a75-3b4222a69477] succeeded in 4.128056782001295s: None 2024-05-25T03:17:05.454558623Z [2024-05-25 03:17:05,453: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0a6791c3-bbb0-4fd9-9199-d5dacc1167ee] succeeded in 4.485467643000447s: None 2024-05-25T03:18:00.728395178Z [2024-05-25 03:18:00,727: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[350645fe-c019-445a-a741-ab50954c2793] received 2024-05-25T03:18:00.739697620Z [2024-05-25 03:18:00,739: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d87da8d-b55c-4c81-afa8-140c50a8c46a] received 2024-05-25T03:18:00.748237459Z [2024-05-25 03:18:00,747: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22691088-595b-489b-bee0-664b992d8f4c] received 2024-05-25T03:18:00.750024793Z [2024-05-25 03:18:00,749: INFO/ForkPoolWorker-15] [350645fe-c019-445a-a741-ab50954c2793] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-05-25T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-05-25T03:18:00.756540920Z [2024-05-25 03:18:00,756: INFO/ForkPoolWorker-16] [1d87da8d-b55c-4c81-afa8-140c50a8c46a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:18:00.757935020Z [2024-05-25 03:18:00,757: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1dd1ab5-056c-40da-a6ec-58c56c7636be] received 2024-05-25T03:18:00.769309481Z [2024-05-25 03:18:00,768: INFO/ForkPoolWorker-2] [f1dd1ab5-056c-40da-a6ec-58c56c7636be] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:18:00.770422154Z [2024-05-25 03:18:00,770: INFO/ForkPoolWorker-1] [22691088-595b-489b-bee0-664b992d8f4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:18:01.093848690Z [2024-05-25 03:18:01,090: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T03:18:01.100739964Z [2024-05-25 03:18:01,097: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T03:18:01.239100184Z [2024-05-25 03:18:01,235: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-05-25T03:18:01.258078134Z [2024-05-25 03:18:01,254: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T03:18:01.441471193Z [2024-05-25 03:18:01,441: INFO/ForkPoolWorker-2] Getting SDNC list 2024-05-25T03:18:01.445870327Z [2024-05-25 03:18:01,445: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:18:01.478125029Z [2024-05-25 03:18:01,477: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-05-25T03:18:01.483068801Z [2024-05-25 03:18:01,482: INFO/ForkPoolWorker-2] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T03:18:01.483289788Z [2024-05-25 03:18:01,483: INFO/ForkPoolWorker-2] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T03:18:01.484608308Z [2024-05-25 03:18:01,483: INFO/ForkPoolWorker-2] Getting SDNC list OK 2024-05-25T03:18:01.485604070Z [2024-05-25 03:18:01,484: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T03:18:01.499639898Z [2024-05-25 03:18:01,499: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:18:01.606614568Z [2024-05-25 03:18:01,606: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:18:02.213524773Z [2024-05-25 03:18:02,204: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[350645fe-c019-445a-a741-ab50954c2793] succeeded in 1.4708348579988524s: None 2024-05-25T03:18:02.306324522Z [2024-05-25 03:18:02,305: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f1dd1ab5-056c-40da-a6ec-58c56c7636be] succeeded in 1.5446486059991003s: None 2024-05-25T03:18:02.621287229Z [2024-05-25 03:18:02,620: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T03:18:02.624360889Z [2024-05-25 03:18:02,623: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:18:02.654165591Z [2024-05-25 03:18:02,653: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T03:18:02.655823843Z [2024-05-25 03:18:02,655: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:18:02.655875095Z [2024-05-25 03:18:02,655: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:18:02.656060109Z [2024-05-25 03:18:02,655: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:18:02.656123721Z [2024-05-25 03:18:02,656: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T03:18:02.656384724Z [2024-05-25 03:18:02,656: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T03:18:02.656435246Z [2024-05-25 03:18:02,656: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:18:02.722770908Z [2024-05-25 03:18:02,722: INFO/ForkPoolWorker-1] Getting VIM list 2024-05-25T03:18:02.726005451Z [2024-05-25 03:18:02,725: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:18:02.746015691Z [2024-05-25 03:18:02,745: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:18:02.750141907Z [2024-05-25 03:18:02,749: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T03:18:02.751527751Z [2024-05-25 03:18:02,751: INFO/ForkPoolWorker-1] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:18:02.751542752Z [2024-05-25 03:18:02,751: INFO/ForkPoolWorker-1] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:18:02.751758298Z [2024-05-25 03:18:02,751: INFO/ForkPoolWorker-1] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:18:02.751896673Z [2024-05-25 03:18:02,751: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-05-25T03:18:02.752366301Z [2024-05-25 03:18:02,752: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-05-25T03:18:02.752470806Z [2024-05-25 03:18:02,752: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:18:02.825594846Z [2024-05-25 03:18:02,825: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:18:04.322149363Z [2024-05-25 03:18:04,321: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1d87da8d-b55c-4c81-afa8-140c50a8c46a] succeeded in 3.578998663000675s: None 2024-05-25T03:18:04.986018416Z [2024-05-25 03:18:04,985: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[22691088-595b-489b-bee0-664b992d8f4c] succeeded in 4.224896357998659s: None 2024-05-25T03:19:01.086696968Z [2024-05-25 03:19:01,086: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da098174-c1f4-4ff1-94be-29304a27a5c4] received 2024-05-25T03:19:01.096596232Z [2024-05-25 03:19:01,096: INFO/ForkPoolWorker-15] [da098174-c1f4-4ff1-94be-29304a27a5c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-05-25T03:19:01.103811806Z [2024-05-25 03:19:01,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2090a300-4a35-43aa-a2e5-67f7cd1d07ae] received 2024-05-25T03:19:01.106999985Z [2024-05-25 03:19:01,106: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26e3c931-457d-4eef-a704-b586e63b4443] received 2024-05-25T03:19:01.113645370Z [2024-05-25 03:19:01,113: INFO/ForkPoolWorker-1] [26e3c931-457d-4eef-a704-b586e63b4443] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-05-25T03:19:01.118256245Z [2024-05-25 03:19:01,117: INFO/ForkPoolWorker-16] [2090a300-4a35-43aa-a2e5-67f7cd1d07ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-05-25T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-05-25T03:19:01.381386113Z [2024-05-25 03:19:01,374: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-05-25T03:19:01.425374383Z [2024-05-25 03:19:01,417: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-05-25T03:19:01.463338504Z [2024-05-25 03:19:01,460: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-05-25T03:19:01.580839429Z [2024-05-25 03:19:01,580: INFO/ForkPoolWorker-1] Getting SDNC list 2024-05-25T03:19:01.585665468Z [2024-05-25 03:19:01,585: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:19:01.614136934Z [2024-05-25 03:19:01,613: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-05-25T03:19:01.616147272Z [2024-05-25 03:19:01,615: INFO/ForkPoolWorker-1] Read SDNC 1ced5972-6f3e-4e18-9852-fca63c8275bf (sdnc-osm) 2024-05-25T03:19:01.616325298Z [2024-05-25 03:19:01,616: INFO/ForkPoolWorker-1] [{'_id': '1ced5972-6f3e-4e18-9852-fca63c8275bf', 'name': 'sdnc-osm', 'type': 'onos_vpls'}] 2024-05-25T03:19:01.616432444Z [2024-05-25 03:19:01,616: INFO/ForkPoolWorker-1] Getting SDNC list OK 2024-05-25T03:19:01.616702424Z [2024-05-25 03:19:01,616: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_1ced5972-6f3e-4e18-9852-fca63c8275bf 2024-05-25T03:19:01.734245572Z [2024-05-25 03:19:01,733: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:19:02.394404284Z [2024-05-25 03:19:02,393: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[26e3c931-457d-4eef-a704-b586e63b4443] succeeded in 1.285166109999409s: None 2024-05-25T03:19:02.666524401Z [2024-05-25 03:19:02,666: INFO/ForkPoolWorker-15] Getting VIM list 2024-05-25T03:19:02.669619409Z [2024-05-25 03:19:02,669: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:19:02.686320763Z [2024-05-25 03:19:02,685: INFO/ForkPoolWorker-16] Getting VIM list 2024-05-25T03:19:02.689592331Z [2024-05-25 03:19:02,689: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Gy6bsgc867gExb3GshQ1NaRFZIKq02rZ'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-05-25T03:19:02.693738134Z [2024-05-25 03:19:02,693: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-05-25T03:19:02.695772116Z [2024-05-25 03:19:02,695: INFO/ForkPoolWorker-15] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:19:02.695852521Z [2024-05-25 03:19:02,695: INFO/ForkPoolWorker-15] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:19:02.696136707Z [2024-05-25 03:19:02,695: INFO/ForkPoolWorker-15] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:19:02.696667123Z [2024-05-25 03:19:02,696: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-05-25T03:19:02.697505677Z [2024-05-25 03:19:02,697: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-05-25T03:19:02.697713164Z [2024-05-25 03:19:02,697: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:19:02.716981757Z [2024-05-25 03:19:02,716: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-05-25T03:19:02.718239878Z [2024-05-25 03:19:02,717: INFO/ForkPoolWorker-16] Read VIM 5df33f8a-4048-4906-8a23-32824d196181 (_system-osm-vim) 2024-05-25T03:19:02.718258920Z [2024-05-25 03:19:02,718: INFO/ForkPoolWorker-16] Read VIM af1a091b-d408-4afe-8d20-7cf4ebe11fb3 (osm) 2024-05-25T03:19:02.718318886Z [2024-05-25 03:19:02,718: INFO/ForkPoolWorker-16] [{'_id': '5df33f8a-4048-4906-8a23-32824d196181', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'af1a091b-d408-4afe-8d20-7cf4ebe11fb3', 'name': 'osm', 'vim_type': 'openstack'}] 2024-05-25T03:19:02.718332637Z [2024-05-25 03:19:02,718: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-05-25T03:19:02.718577529Z [2024-05-25 03:19:02,718: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-05-25T03:19:02.718621948Z [2024-05-25 03:19:02,718: INFO/ForkPoolWorker-16] Creating DAG vim_status_af1a091b-d408-4afe-8d20-7cf4ebe11fb3 2024-05-25T03:19:02.781806627Z [2024-05-25 03:19:02,781: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:19:02.826079868Z [2024-05-25 03:19:02,825: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-05-25T03:19:04.797726598Z [2024-05-25 03:19:04,797: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2090a300-4a35-43aa-a2e5-67f7cd1d07ae] succeeded in 3.691204475999257s: None 2024-05-25T03:19:05.525308754Z [2024-05-25 03:19:05,524: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[da098174-c1f4-4ff1-94be-29304a27a5c4] succeeded in 4.434703184997488s: None 2024-05-24T22:55:18.708549190Z 2024-05-24T22:55:18.708580274Z Cleaning logs every 900 seconds 2024-05-24T22:55:18.708585091Z Trimming airflow logs to 15 days. 2024-05-24T23:00:00.732551213Z Trimming airflow logs to 15 days. 2024-05-24T23:00:01.751948251Z Trimming airflow logs to 15 days. 2024-05-24T23:15:00.782407218Z Trimming airflow logs to 15 days. 2024-05-24T23:15:01.832428487Z Trimming airflow logs to 15 days. 2024-05-24T23:30:00.881897886Z Trimming airflow logs to 15 days. 2024-05-24T23:30:01.938657743Z Trimming airflow logs to 15 days. 2024-05-24T23:45:01.019308390Z Trimming airflow logs to 15 days. 2024-05-25T00:00:00.064977819Z Trimming airflow logs to 15 days. 2024-05-25T00:00:01.142013098Z Trimming airflow logs to 15 days. 2024-05-25T00:15:00.208931476Z Trimming airflow logs to 15 days. 2024-05-25T00:15:01.292259857Z Trimming airflow logs to 15 days. 2024-05-25T00:30:00.377436178Z Trimming airflow logs to 15 days. 2024-05-25T00:30:01.434619523Z Trimming airflow logs to 15 days. 2024-05-25T00:45:00.511402321Z Trimming airflow logs to 15 days. 2024-05-25T00:45:01.599307585Z Trimming airflow logs to 15 days. 2024-05-25T01:00:00.675302450Z Trimming airflow logs to 15 days. 2024-05-25T01:00:01.757005320Z Trimming airflow logs to 15 days. 2024-05-25T01:15:00.851451448Z Trimming airflow logs to 15 days. 2024-05-25T01:15:01.933486460Z Trimming airflow logs to 15 days. 2024-05-25T01:30:00.009767817Z Trimming airflow logs to 15 days. 2024-05-25T01:30:01.075274451Z Trimming airflow logs to 15 days. 2024-05-25T01:45:00.151485276Z Trimming airflow logs to 15 days. 2024-05-25T01:45:01.219046767Z Trimming airflow logs to 15 days. 2024-05-25T02:00:00.334149056Z Trimming airflow logs to 15 days. 2024-05-25T02:00:01.451159099Z Trimming airflow logs to 15 days. 2024-05-25T02:15:00.524927320Z Trimming airflow logs to 15 days. 2024-05-25T02:15:01.637025380Z Trimming airflow logs to 15 days. 2024-05-25T02:30:00.783159098Z Trimming airflow logs to 15 days. 2024-05-25T02:30:01.908369140Z Trimming airflow logs to 15 days. 2024-05-25T02:45:01.016726796Z Trimming airflow logs to 15 days. 2024-05-25T03:00:00.124408263Z Trimming airflow logs to 15 days. 2024-05-25T03:00:01.235290136Z Trimming airflow logs to 15 days. 2024-05-25T03:15:00.446027520Z Trimming airflow logs to 15 days. 2024-05-25T03:15:01.570491167Z Trimming airflow logs to 15 days.