2024-03-20T23:30:01.640157211Z ...
2024-03-20T23:30:02.748530490Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0.
2024-03-20T23:30:03.768480579Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings.  Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
2024-03-20T23:30:11.724265378Z [2024-03-20T23:30:11.720+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s)
2024-03-20T23:30:12.734648576Z [2024-03-20T23:30:12.734+0000] {db.py:755} INFO - Waiting for migrations... 1 second(s)
2024-03-20T23:30:28.128213451Z 
2024-03-20T23:30:28.660247392Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0.
2024-03-20T23:30:31.709054323Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings.  Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
2024-03-20T23:30:36.955552694Z [2024-03-20 23:30:36 +0000] [16] [INFO] Starting gunicorn 20.1.0
2024-03-20T23:30:36.975322533Z [2024-03-20 23:30:36 +0000] [16] [INFO] Listening at: http://[::]:8793 (16)
2024-03-20T23:30:36.976323917Z [2024-03-20 23:30:36 +0000] [16] [INFO] Using worker: sync
2024-03-20T23:30:37.006895648Z [2024-03-20 23:30:36 +0000] [17] [INFO] Booting worker with pid: 17
2024-03-20T23:30:37.091886072Z [2024-03-20 23:30:37 +0000] [18] [INFO] Booting worker with pid: 18
2024-03-20T23:30:38.755113606Z  
2024-03-20T23:30:38.755129260Z  -------------- celery@airflow-worker-0 v5.2.7 (dawn-chorus)
2024-03-20T23:30:38.755133529Z --- ***** ----- 
2024-03-20T23:30:38.755136899Z -- ******* ---- Linux-5.15.0-47-generic-x86_64-with-glibc2.31 2024-03-20 23:30:38
2024-03-20T23:30:38.755140100Z - *** --- * --- 
2024-03-20T23:30:38.755143552Z - ** ---------- [config]
2024-03-20T23:30:38.755146957Z - ** ---------- .> app:         airflow.executors.celery_executor:0x7f586f8dab60
2024-03-20T23:30:38.755150262Z - ** ---------- .> transport:   redis://:**@airflow-redis:6379/0
2024-03-20T23:30:38.755153416Z - ** ---------- .> results:     postgresql://postgres:**@airflow-postgresql.osm:5432/postgres
2024-03-20T23:30:38.755157849Z - *** --- * --- .> concurrency: 16 (prefork)
2024-03-20T23:30:38.755160975Z -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
2024-03-20T23:30:38.755163894Z --- ***** ----- 
2024-03-20T23:30:38.755166806Z  -------------- [queues]
2024-03-20T23:30:38.755169854Z                 .> default          exchange=default(direct) key=default
2024-03-20T23:30:38.755172862Z                 
2024-03-20T23:30:38.755175588Z 
2024-03-20T23:30:38.755178434Z [tasks]
2024-03-20T23:30:38.755181337Z   . airflow.executors.celery_executor.execute_command
2024-03-20T23:30:38.755184210Z 
2024-03-20T23:30:44.440779824Z [2024-03-20 23:30:44,421: INFO/MainProcess] Connected to redis://:**@airflow-redis:6379/0
2024-03-20T23:30:44.462071552Z [2024-03-20 23:30:44,460: INFO/MainProcess] mingle: searching for neighbors
2024-03-20T23:30:45.481940938Z [2024-03-20 23:30:45,481: INFO/MainProcess] mingle: all alone
2024-03-20T23:30:45.513492564Z [2024-03-20 23:30:45,513: INFO/MainProcess] celery@airflow-worker-0 ready.
2024-03-20T23:31:39.224631706Z [2024-03-20 23:31:39,221: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2112b513-7ca8-4267-b64c-59802320e990] received
2024-03-20T23:31:39.308114851Z [2024-03-20 23:31:39,307: INFO/ForkPoolWorker-15] [2112b513-7ca8-4267-b64c-59802320e990] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-20T23:31:39.682023133Z [2024-03-20 23:31:39,678: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-20T23:31:40.071015515Z [2024-03-20 23:31:40,070: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-20T23:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:32:10.677351696Z [2024-03-20 23:32:10,676: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2112b513-7ca8-4267-b64c-59802320e990] succeeded in 31.438869386999954s: None
2024-03-20T23:32:20.793613266Z [2024-03-20 23:32:20,793: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[571112f0-5124-4e81-bebd-e40aa54e78c1] received
2024-03-20T23:32:20.802938150Z [2024-03-20 23:32:20,802: INFO/ForkPoolWorker-15] [571112f0-5124-4e81-bebd-e40aa54e78c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-20T23:32:21.077827349Z [2024-03-20 23:32:21,074: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-20T23:32:21.300941426Z [2024-03-20 23:32:21,300: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-20T23:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:32:51.802932849Z [2024-03-20 23:32:51,802: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[571112f0-5124-4e81-bebd-e40aa54e78c1] succeeded in 31.007671756000036s: None
2024-03-20T23:32:53.163357040Z [2024-03-20 23:32:53,162: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[990c22e2-49de-4f1b-a80a-ab420b01fb35] received
2024-03-20T23:32:53.182574715Z [2024-03-20 23:32:53,182: INFO/ForkPoolWorker-15] [990c22e2-49de-4f1b-a80a-ab420b01fb35] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-20T23:32:53.505317030Z [2024-03-20 23:32:53,501: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-20T23:32:53.747063000Z [2024-03-20 23:32:53,746: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-20T23:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:33:06.369795795Z [2024-03-20 23:33:06,369: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[990c22e2-49de-4f1b-a80a-ab420b01fb35] succeeded in 13.204472451000015s: None
2024-03-20T23:34:00.374449506Z [2024-03-20 23:34:00,374: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5089ac66-c139-4ca4-9931-f25708c085c5] received
2024-03-20T23:34:00.382046263Z [2024-03-20 23:34:00,381: INFO/ForkPoolWorker-15] [5089ac66-c139-4ca4-9931-f25708c085c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-20T23:34:00.679067962Z [2024-03-20 23:34:00,675: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-20T23:34:00.935849954Z [2024-03-20 23:34:00,935: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-20T23:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:34:01.464661853Z [2024-03-20 23:34:01,464: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5089ac66-c139-4ca4-9931-f25708c085c5] succeeded in 1.0886200319999944s: None
2024-03-20T23:36:00.472902429Z [2024-03-20 23:36:00,472: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d7d856e-8aa6-4ddb-b1fe-aa9ac417fbb4] received
2024-03-20T23:36:00.483679285Z [2024-03-20 23:36:00,483: INFO/ForkPoolWorker-15] [2d7d856e-8aa6-4ddb-b1fe-aa9ac417fbb4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-20T23:36:00.755160873Z [2024-03-20 23:36:00,752: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-20T23:36:00.987948484Z [2024-03-20 23:36:00,987: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-20T23:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:36:01.513652118Z [2024-03-20 23:36:01,513: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2d7d856e-8aa6-4ddb-b1fe-aa9ac417fbb4] succeeded in 1.0390175270000555s: None
2024-03-20T23:38:01.107274020Z [2024-03-20 23:38:01,106: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3947b81f-ba10-4aaa-9190-65a185bc31ac] received
2024-03-20T23:38:01.116209049Z [2024-03-20 23:38:01,115: INFO/ForkPoolWorker-15] [3947b81f-ba10-4aaa-9190-65a185bc31ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-20T23:38:01.411029184Z [2024-03-20 23:38:01,407: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-20T23:38:01.711263615Z [2024-03-20 23:38:01,710: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-20T23:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:38:02.391977815Z [2024-03-20 23:38:02,391: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3947b81f-ba10-4aaa-9190-65a185bc31ac] succeeded in 1.2824835039998561s: None
2024-03-20T23:38:26.099937657Z [2024-03-20 23:38:26,099: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99f8d7ae-b19b-426c-8b73-a25134114eec] received
2024-03-20T23:38:26.103835600Z [2024-03-20 23:38:26,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f410566e-7cd2-4886-bb23-4c24f9518e37] received
2024-03-20T23:38:26.116031880Z [2024-03-20 23:38:26,115: INFO/ForkPoolWorker-15] [99f8d7ae-b19b-426c-8b73-a25134114eec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:38:26.221627792Z [2024-03-20 23:38:26,221: INFO/ForkPoolWorker-16] [f410566e-7cd2-4886-bb23-4c24f9518e37] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:38:26.605328682Z [2024-03-20 23:38:26,595: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:38:26.731835816Z [2024-03-20 23:38:26,727: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:38:26.812588456Z [2024-03-20 23:38:26,812: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3720521b-519b-4415-965a-3d1d0ce7a282] received
2024-03-20T23:38:26.874769540Z [2024-03-20 23:38:26,873: INFO/ForkPoolWorker-1] [3720521b-519b-4415-965a-3d1d0ce7a282] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-20T23:38:27.226469047Z [2024-03-20 23:38:27,222: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-20T23:38:27.411878979Z [2024-03-20 23:38:27,411: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-20T23:38:27.417413076Z [2024-03-20 23:38:27,416: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:38:27.449904783Z [2024-03-20 23:38:27,449: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-20T23:38:27.451169282Z [2024-03-20 23:38:27,450: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-20T23:38:27.451291169Z [2024-03-20 23:38:27,451: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-20T23:38:27.451377523Z [2024-03-20 23:38:27,451: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-20T23:38:27.451631457Z [2024-03-20 23:38:27,451: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-20T23:38:27.576437462Z [2024-03-20 23:38:27,576: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-20T23:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:38:28.081760504Z [2024-03-20 23:38:28,081: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:38:28.085323411Z [2024-03-20 23:38:28,084: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:38:28.138980875Z [2024-03-20 23:38:28,138: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:38:28.140340243Z [2024-03-20 23:38:28,140: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:38:28.140352581Z [2024-03-20 23:38:28,140: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:38:28.140466514Z [2024-03-20 23:38:28,140: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:38:28.140493206Z [2024-03-20 23:38:28,140: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:38:28.140903490Z [2024-03-20 23:38:28,140: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:38:28.140918428Z [2024-03-20 23:38:28,140: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:38:28.254752435Z [2024-03-20 23:38:28,254: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:38:28.278573857Z [2024-03-20 23:38:28,278: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3720521b-519b-4415-965a-3d1d0ce7a282] succeeded in 1.4632401399999253s: None
2024-03-20T23:38:28.294025893Z [2024-03-20 23:38:28,293: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:38:28.297997379Z [2024-03-20 23:38:28,297: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:38:28.323400976Z [2024-03-20 23:38:28,323: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:38:28.324746989Z [2024-03-20 23:38:28,324: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:38:28.324776576Z [2024-03-20 23:38:28,324: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:38:28.324934928Z [2024-03-20 23:38:28,324: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:38:28.324958672Z [2024-03-20 23:38:28,324: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:38:28.325143526Z [2024-03-20 23:38:28,325: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:38:28.325264017Z [2024-03-20 23:38:28,325: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:38:28.411376973Z [2024-03-20 23:38:28,411: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:38:28.918430044Z [2024-03-20 23:38:28,918: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04778655-6222-494b-9e91-269a63089974] received
2024-03-20T23:38:28.931368154Z [2024-03-20 23:38:28,931: INFO/ForkPoolWorker-1] [04778655-6222-494b-9e91-269a63089974] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:38:29.209492829Z [2024-03-20 23:38:29,206: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:38:29.718976228Z [2024-03-20 23:38:29,718: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[99f8d7ae-b19b-426c-8b73-a25134114eec] succeeded in 3.613068341999906s: None
2024-03-20T23:38:30.326367792Z [2024-03-20 23:38:30,325: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f410566e-7cd2-4886-bb23-4c24f9518e37] succeeded in 4.216542322000123s: None
2024-03-20T23:38:30.374230858Z [2024-03-20 23:38:30,373: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-20T23:38:30.377537330Z [2024-03-20 23:38:30,376: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:38:30.409369615Z [2024-03-20 23:38:30,409: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-20T23:38:30.410969005Z [2024-03-20 23:38:30,410: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:38:30.410977605Z [2024-03-20 23:38:30,410: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:38:30.411246205Z [2024-03-20 23:38:30,410: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:38:30.411270802Z [2024-03-20 23:38:30,411: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-20T23:38:30.411739877Z [2024-03-20 23:38:30,411: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:38:30.411779650Z [2024-03-20 23:38:30,411: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:38:30.495154710Z [2024-03-20 23:38:30,494: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-20T23:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:38:31.039689322Z [2024-03-20 23:38:31,039: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[04778655-6222-494b-9e91-269a63089974] succeeded in 2.117533907999814s: None
2024-03-20T23:38:31.376560274Z [2024-03-20 23:38:31,376: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[674ba855-d344-4f98-a331-4fb7e90cb55d] received
2024-03-20T23:38:31.385200535Z [2024-03-20 23:38:31,384: INFO/ForkPoolWorker-15] [674ba855-d344-4f98-a331-4fb7e90cb55d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:38:31.673324259Z [2024-03-20 23:38:31,670: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:38:32.832391619Z [2024-03-20 23:38:32,832: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:38:32.835867426Z [2024-03-20 23:38:32,835: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:38:32.857560903Z [2024-03-20 23:38:32,857: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:38:32.859052038Z [2024-03-20 23:38:32,858: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:38:32.859226492Z [2024-03-20 23:38:32,859: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:38:32.859482332Z [2024-03-20 23:38:32,859: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:38:32.859641619Z [2024-03-20 23:38:32,859: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:38:32.859934801Z [2024-03-20 23:38:32,859: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:38:32.860063602Z [2024-03-20 23:38:32,859: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:38:32.946403500Z [2024-03-20 23:38:32,946: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-20T23:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:38:33.502298090Z [2024-03-20 23:38:33,501: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[674ba855-d344-4f98-a331-4fb7e90cb55d] succeeded in 2.122250437000048s: None
2024-03-20T23:38:33.969800046Z [2024-03-20 23:38:33,969: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc2a3a14-ca4e-4ec1-a87c-2d3e9103685c] received
2024-03-20T23:38:33.987817047Z [2024-03-20 23:38:33,987: INFO/ForkPoolWorker-15] [dc2a3a14-ca4e-4ec1-a87c-2d3e9103685c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-20T23:38:34.256057248Z [2024-03-20 23:38:34,253: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:38:35.306704635Z [2024-03-20 23:38:35,306: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:38:35.309808830Z [2024-03-20 23:38:35,309: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:38:35.330297228Z [2024-03-20 23:38:35,329: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:38:35.331163343Z [2024-03-20 23:38:35,330: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:38:35.331290868Z [2024-03-20 23:38:35,331: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:38:35.331469808Z [2024-03-20 23:38:35,331: INFO/ForkPoolWorker-15] Read VIM 063ab749-b0aa-4df3-8345-4c59c0deef9d (basic01_405123)
2024-03-20T23:38:35.331642876Z [2024-03-20 23:38:35,331: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '063ab749-b0aa-4df3-8345-4c59c0deef9d', 'name': 'basic01_405123', 'vim_type': 'openstack'}]
2024-03-20T23:38:35.331684122Z [2024-03-20 23:38:35,331: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:38:35.332087179Z [2024-03-20 23:38:35,331: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:38:35.332097954Z [2024-03-20 23:38:35,332: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:38:35.338866908Z [2024-03-20 23:38:35,338: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d
2024-03-20T23:38:35.427259368Z [2024-03-20 23:38:35,426: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-20T23:30:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:38:36.022887427Z [2024-03-20 23:38:36,022: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dc2a3a14-ca4e-4ec1-a87c-2d3e9103685c] succeeded in 2.0477575550000893s: None
2024-03-20T23:38:36.197116235Z [2024-03-20 23:38:36,196: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[152853dd-15b6-4986-bf47-af7897491cbf] received
2024-03-20T23:38:36.204782917Z [2024-03-20 23:38:36,204: INFO/ForkPoolWorker-15] [152853dd-15b6-4986-bf47-af7897491cbf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:38:36.519121727Z [2024-03-20 23:38:36,516: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:38:37.623956769Z [2024-03-20 23:38:37,623: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:38:37.627300321Z [2024-03-20 23:38:37,626: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:38:37.648560990Z [2024-03-20 23:38:37,648: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:38:37.650038978Z [2024-03-20 23:38:37,649: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:38:37.650100981Z [2024-03-20 23:38:37,649: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:38:37.650122797Z [2024-03-20 23:38:37,649: INFO/ForkPoolWorker-15] Read VIM 063ab749-b0aa-4df3-8345-4c59c0deef9d (basic01_405123)
2024-03-20T23:38:37.650287863Z [2024-03-20 23:38:37,650: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '063ab749-b0aa-4df3-8345-4c59c0deef9d', 'name': 'basic01_405123', 'vim_type': 'openstack'}]
2024-03-20T23:38:37.650304162Z [2024-03-20 23:38:37,650: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:38:37.650555435Z [2024-03-20 23:38:37,650: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:38:37.650601531Z [2024-03-20 23:38:37,650: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:38:37.657213617Z [2024-03-20 23:38:37,656: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d
2024-03-20T23:38:37.737965267Z [2024-03-20 23:38:37,737: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-20T23:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:38:38.258849674Z [2024-03-20 23:38:38,258: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[152853dd-15b6-4986-bf47-af7897491cbf] succeeded in 2.057506434000061s: None
2024-03-20T23:38:57.608711465Z [2024-03-20 23:38:57,608: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[069879c0-6da2-4c8c-9278-fc801bc20694] received
2024-03-20T23:38:57.615123010Z [2024-03-20 23:38:57,614: INFO/ForkPoolWorker-15] [069879c0-6da2-4c8c-9278-fc801bc20694] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:38:57.623260458Z [2024-03-20 23:38:57,623: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db91abde-a996-4287-b707-c933493ee50d] received
2024-03-20T23:38:57.633077353Z [2024-03-20 23:38:57,632: INFO/ForkPoolWorker-16] [db91abde-a996-4287-b707-c933493ee50d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:38:58.050612150Z [2024-03-20 23:38:58,047: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:38:58.061629333Z [2024-03-20 23:38:58,054: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:38:59.905285906Z [2024-03-20 23:38:59,904: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:38:59.908801656Z [2024-03-20 23:38:59,908: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:38:59.929177891Z [2024-03-20 23:38:59,928: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:38:59.930551022Z [2024-03-20 23:38:59,930: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:38:59.930653165Z [2024-03-20 23:38:59,930: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:38:59.930741638Z [2024-03-20 23:38:59,930: INFO/ForkPoolWorker-15] Read VIM 063ab749-b0aa-4df3-8345-4c59c0deef9d (basic01_405123)
2024-03-20T23:38:59.930936220Z [2024-03-20 23:38:59,930: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '063ab749-b0aa-4df3-8345-4c59c0deef9d', 'name': 'basic01_405123', 'vim_type': 'openstack'}]
2024-03-20T23:38:59.931020931Z [2024-03-20 23:38:59,930: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:38:59.932643149Z [2024-03-20 23:38:59,932: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:38:59.932659152Z [2024-03-20 23:38:59,932: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:38:59.937927738Z [2024-03-20 23:38:59,937: INFO/ForkPoolWorker-15] Creating DAG vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d
2024-03-20T23:38:59.974577917Z [2024-03-20 23:38:59,974: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:38:59.980736296Z [2024-03-20 23:38:59,980: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:39:00.006695784Z [2024-03-20 23:39:00,006: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:39:00.020917216Z [2024-03-20 23:39:00,020: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:39:00.022318071Z [2024-03-20 23:39:00,022: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:39:00.022332955Z [2024-03-20 23:39:00,022: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:39:00.022509932Z [2024-03-20 23:39:00,022: INFO/ForkPoolWorker-16] Read VIM 063ab749-b0aa-4df3-8345-4c59c0deef9d (basic01_405123)
2024-03-20T23:39:00.022718746Z [2024-03-20 23:39:00,022: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '063ab749-b0aa-4df3-8345-4c59c0deef9d', 'name': 'basic01_405123', 'vim_type': 'openstack'}]
2024-03-20T23:39:00.022764435Z [2024-03-20 23:39:00,022: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:39:00.023019959Z [2024-03-20 23:39:00,022: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:39:00.023059566Z [2024-03-20 23:39:00,022: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:39:00.029560299Z [2024-03-20 23:39:00,029: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d
2024-03-20T23:39:00.106811537Z [2024-03-20 23:39:00,106: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:39:00.733610598Z [2024-03-20 23:39:00,733: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65a7ce44-93e9-4bab-9e54-0fee80dd66ab] received
2024-03-20T23:39:00.736849457Z [2024-03-20 23:39:00,736: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d89f7f2-a0db-4bc4-a7c0-06ce69f16598] received
2024-03-20T23:39:00.740593859Z [2024-03-20 23:39:00,740: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32e9ea7f-6e8e-4e99-a1ca-84a6d9c9511e] received
2024-03-20T23:39:00.757102496Z [2024-03-20 23:39:00,756: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[40267645-e467-430f-a9fe-151584e575de] received
2024-03-20T23:39:00.765022961Z [2024-03-20 23:39:00,764: INFO/ForkPoolWorker-1] [65a7ce44-93e9-4bab-9e54-0fee80dd66ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-20T23:39:00.789812366Z [2024-03-20 23:39:00,789: INFO/ForkPoolWorker-3] [32e9ea7f-6e8e-4e99-a1ca-84a6d9c9511e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:39:00.809833857Z [2024-03-20 23:39:00,809: INFO/ForkPoolWorker-2] [2d89f7f2-a0db-4bc4-a7c0-06ce69f16598] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:39:00.843447801Z [2024-03-20 23:39:00,843: INFO/ForkPoolWorker-4] [40267645-e467-430f-a9fe-151584e575de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:39:01.205752159Z [2024-03-20 23:39:01,202: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:39:01.277821536Z [2024-03-20 23:39:01,271: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:39:01.302373906Z [2024-03-20 23:39:01,298: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-20T23:39:01.386639199Z [2024-03-20 23:39:01,382: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:39:01.496326000Z [2024-03-20 23:39:01,495: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-20T23:39:01.502738631Z [2024-03-20 23:39:01,502: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:39:01.508409862Z [2024-03-20 23:39:01,507: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[069879c0-6da2-4c8c-9278-fc801bc20694] succeeded in 3.8980722280000464s: None
2024-03-20T23:39:01.539801192Z [2024-03-20 23:39:01,539: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-20T23:39:01.541136572Z [2024-03-20 23:39:01,540: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-20T23:39:01.541276041Z [2024-03-20 23:39:01,541: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-20T23:39:01.541413814Z [2024-03-20 23:39:01,541: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-20T23:39:01.541640322Z [2024-03-20 23:39:01,541: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-20T23:39:01.638862243Z [2024-03-20 23:39:01,638: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-20T23:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:39:01.959298826Z [2024-03-20 23:39:01,958: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[db91abde-a996-4287-b707-c933493ee50d] succeeded in 4.333836949999977s: None
2024-03-20T23:39:02.227904375Z [2024-03-20 23:39:02,227: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[65a7ce44-93e9-4bab-9e54-0fee80dd66ab] succeeded in 1.4858934429998953s: None
2024-03-20T23:39:02.614694937Z [2024-03-20 23:39:02,614: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4157be9-018b-4b5a-bef2-045e9c6a7f5a] received
2024-03-20T23:39:02.625941126Z [2024-03-20 23:39:02,625: INFO/ForkPoolWorker-15] [d4157be9-018b-4b5a-bef2-045e9c6a7f5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:39:02.884157021Z [2024-03-20 23:39:02,883: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb820f30-d09c-4b55-8400-d6e9caebb865] received
2024-03-20T23:39:02.917536047Z [2024-03-20 23:39:02,917: INFO/ForkPoolWorker-16] [fb820f30-d09c-4b55-8400-d6e9caebb865] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:39:02.931754012Z [2024-03-20 23:39:02,931: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-20T23:39:02.938486148Z [2024-03-20 23:39:02,937: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:39:02.976846227Z [2024-03-20 23:39:02,976: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-20T23:39:02.978783366Z [2024-03-20 23:39:02,978: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:39:02.978843813Z [2024-03-20 23:39:02,978: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:39:02.978944273Z [2024-03-20 23:39:02,978: INFO/ForkPoolWorker-2] Read VIM 063ab749-b0aa-4df3-8345-4c59c0deef9d (basic01_405123)
2024-03-20T23:39:02.979142027Z [2024-03-20 23:39:02,978: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '063ab749-b0aa-4df3-8345-4c59c0deef9d', 'name': 'basic01_405123', 'vim_type': 'openstack'}]
2024-03-20T23:39:02.979208671Z [2024-03-20 23:39:02,979: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-20T23:39:02.979533986Z [2024-03-20 23:39:02,979: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:39:02.979607468Z [2024-03-20 23:39:02,979: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:39:02.987335469Z [2024-03-20 23:39:02,987: INFO/ForkPoolWorker-2] Creating DAG vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d
2024-03-20T23:39:03.086238715Z [2024-03-20 23:39:03,085: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:39:03.105547159Z [2024-03-20 23:39:03,101: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:39:03.256276989Z [2024-03-20 23:39:03,255: INFO/ForkPoolWorker-4] Getting VIM list
2024-03-20T23:39:03.261789710Z [2024-03-20 23:39:03,261: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:39:03.311587239Z [2024-03-20 23:39:03,311: INFO/ForkPoolWorker-4] Connected to database osm version 1.2
2024-03-20T23:39:03.316339975Z [2024-03-20 23:39:03,316: INFO/ForkPoolWorker-4] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:39:03.317058136Z [2024-03-20 23:39:03,316: INFO/ForkPoolWorker-4] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:39:03.317304722Z [2024-03-20 23:39:03,317: INFO/ForkPoolWorker-4] Read VIM 063ab749-b0aa-4df3-8345-4c59c0deef9d (basic01_405123)
2024-03-20T23:39:03.317595639Z [2024-03-20 23:39:03,317: INFO/ForkPoolWorker-4] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '063ab749-b0aa-4df3-8345-4c59c0deef9d', 'name': 'basic01_405123', 'vim_type': 'openstack'}]
2024-03-20T23:39:03.317767062Z [2024-03-20 23:39:03,317: INFO/ForkPoolWorker-4] Getting VIM list OK
2024-03-20T23:39:03.318220791Z [2024-03-20 23:39:03,317: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:39:03.318479138Z [2024-03-20 23:39:03,318: INFO/ForkPoolWorker-4] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:39:03.323325049Z [2024-03-20 23:39:03,322: INFO/ForkPoolWorker-3] Getting VIM list
2024-03-20T23:39:03.323919151Z [2024-03-20 23:39:03,323: INFO/ForkPoolWorker-4] Creating DAG vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d
2024-03-20T23:39:03.327838841Z [2024-03-20 23:39:03,326: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:39:03.353306086Z [2024-03-20 23:39:03,353: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-20T23:39:03.354975390Z [2024-03-20 23:39:03,354: INFO/ForkPoolWorker-3] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:39:03.355101831Z [2024-03-20 23:39:03,354: INFO/ForkPoolWorker-3] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:39:03.355271095Z [2024-03-20 23:39:03,355: INFO/ForkPoolWorker-3] Read VIM 063ab749-b0aa-4df3-8345-4c59c0deef9d (basic01_405123)
2024-03-20T23:39:03.355434298Z [2024-03-20 23:39:03,355: INFO/ForkPoolWorker-3] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '063ab749-b0aa-4df3-8345-4c59c0deef9d', 'name': 'basic01_405123', 'vim_type': 'openstack'}]
2024-03-20T23:39:03.355479205Z [2024-03-20 23:39:03,355: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-03-20T23:39:03.355768998Z [2024-03-20 23:39:03,355: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:39:03.355840028Z [2024-03-20 23:39:03,355: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:39:03.361152208Z [2024-03-20 23:39:03,360: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d
2024-03-20T23:39:03.422876040Z [2024-03-20 23:39:03,416: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:39:03.437332092Z [2024-03-20 23:39:03,437: INFO/ForkPoolWorker-4] Running <TaskInstance: vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:39:03.464046455Z [2024-03-20 23:39:03,463: INFO/ForkPoolWorker-3] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:39:04.551507325Z [2024-03-20 23:39:04,551: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:39:04.556123071Z [2024-03-20 23:39:04,555: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:39:04.583090900Z [2024-03-20 23:39:04,582: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:39:04.585202512Z [2024-03-20 23:39:04,584: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:39:04.585549564Z [2024-03-20 23:39:04,585: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:39:04.585852854Z [2024-03-20 23:39:04,585: INFO/ForkPoolWorker-15] Read VIM 063ab749-b0aa-4df3-8345-4c59c0deef9d (basic01_405123)
2024-03-20T23:39:04.586310571Z [2024-03-20 23:39:04,585: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '063ab749-b0aa-4df3-8345-4c59c0deef9d', 'name': 'basic01_405123', 'vim_type': 'openstack'}]
2024-03-20T23:39:04.586843335Z [2024-03-20 23:39:04,586: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:39:04.587337970Z [2024-03-20 23:39:04,587: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:39:04.588023300Z [2024-03-20 23:39:04,587: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:39:04.596018284Z [2024-03-20 23:39:04,595: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d
2024-03-20T23:39:04.707984102Z [2024-03-20 23:39:04,707: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.extract_metrics_from_vnfrs scheduled__2024-03-20T23:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:39:04.803445190Z [2024-03-20 23:39:04,803: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:39:04.807056160Z [2024-03-20 23:39:04,806: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:39:04.836515266Z [2024-03-20 23:39:04,836: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:39:04.895976404Z [2024-03-20 23:39:04,895: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:39:04.895998697Z [2024-03-20 23:39:04,895: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:39:04.896002451Z [2024-03-20 23:39:04,895: INFO/ForkPoolWorker-16] Read VIM 063ab749-b0aa-4df3-8345-4c59c0deef9d (basic01_405123)
2024-03-20T23:39:04.896007407Z [2024-03-20 23:39:04,895: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '063ab749-b0aa-4df3-8345-4c59c0deef9d', 'name': 'basic01_405123', 'vim_type': 'openstack'}]
2024-03-20T23:39:04.896012089Z [2024-03-20 23:39:04,895: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:39:04.913097434Z [2024-03-20 23:39:04,912: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:39:04.913113560Z [2024-03-20 23:39:04,913: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:39:04.945077578Z [2024-03-20 23:39:04,944: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d
2024-03-20T23:39:05.024794874Z [2024-03-20 23:39:05,024: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:39:05.163380882Z [2024-03-20 23:39:05,162: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2d89f7f2-a0db-4bc4-a7c0-06ce69f16598] succeeded in 4.424046109999836s: None
2024-03-20T23:39:05.395885789Z [2024-03-20 23:39:05,395: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d4157be9-018b-4b5a-bef2-045e9c6a7f5a] succeeded in 2.7784776349999447s: None
2024-03-20T23:39:05.571260763Z [2024-03-20 23:39:05,570: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[32e9ea7f-6e8e-4e99-a1ca-84a6d9c9511e] succeeded in 4.825297766999938s: None
2024-03-20T23:39:06.107177829Z [2024-03-20 23:39:06,106: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[40267645-e467-430f-a9fe-151584e575de] succeeded in 5.346595197999932s: None
2024-03-20T23:39:06.217633954Z [2024-03-20 23:39:06,217: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc913e25-bbff-475f-ab3f-7d750ca4c9e8] received
2024-03-20T23:39:06.228969885Z [2024-03-20 23:39:06,228: INFO/ForkPoolWorker-15] [fc913e25-bbff-475f-ab3f-7d750ca4c9e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'split_metrics', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:39:06.510036115Z [2024-03-20 23:39:06,506: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:39:07.568844763Z [2024-03-20 23:39:07,568: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:39:07.572184232Z [2024-03-20 23:39:07,571: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:39:07.595045331Z [2024-03-20 23:39:07,594: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:39:07.596436795Z [2024-03-20 23:39:07,596: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:39:07.596490804Z [2024-03-20 23:39:07,596: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:39:07.596564357Z [2024-03-20 23:39:07,596: INFO/ForkPoolWorker-15] Read VIM 063ab749-b0aa-4df3-8345-4c59c0deef9d (basic01_405123)
2024-03-20T23:39:07.596801874Z [2024-03-20 23:39:07,596: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '063ab749-b0aa-4df3-8345-4c59c0deef9d', 'name': 'basic01_405123', 'vim_type': 'openstack'}]
2024-03-20T23:39:07.596827289Z [2024-03-20 23:39:07,596: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:39:07.597085639Z [2024-03-20 23:39:07,596: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:39:07.597098923Z [2024-03-20 23:39:07,596: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:39:07.604106496Z [2024-03-20 23:39:07,603: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d
2024-03-20T23:39:07.687495578Z [2024-03-20 23:39:07,687: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.split_metrics scheduled__2024-03-20T23:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:39:08.120964059Z [2024-03-20 23:39:08,120: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fb820f30-d09c-4b55-8400-d6e9caebb865] succeeded in 5.235217559000148s: None
2024-03-20T23:39:08.296223284Z [2024-03-20 23:39:08,295: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fc913e25-bbff-475f-ab3f-7d750ca4c9e8] succeeded in 2.0759070060000795s: None
2024-03-20T23:39:08.865032520Z [2024-03-20 23:39:08,864: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fb14610-5c1e-4b74-8df6-81d938895ea3] received
2024-03-20T23:39:08.873198460Z [2024-03-20 23:39:08,871: INFO/ForkPoolWorker-15] [8fb14610-5c1e-4b74-8df6-81d938895ea3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'collect_metrics', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-20T23:39:09.209505761Z [2024-03-20 23:39:09,206: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:39:10.273212060Z [2024-03-20 23:39:10,272: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:39:10.276464836Z [2024-03-20 23:39:10,276: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:39:10.308828223Z [2024-03-20 23:39:10,308: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:39:10.310368796Z [2024-03-20 23:39:10,310: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:39:10.310380988Z [2024-03-20 23:39:10,310: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:39:10.310552516Z [2024-03-20 23:39:10,310: INFO/ForkPoolWorker-15] Read VIM 063ab749-b0aa-4df3-8345-4c59c0deef9d (basic01_405123)
2024-03-20T23:39:10.310916080Z [2024-03-20 23:39:10,310: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '063ab749-b0aa-4df3-8345-4c59c0deef9d', 'name': 'basic01_405123', 'vim_type': 'openstack'}]
2024-03-20T23:39:10.311021770Z [2024-03-20 23:39:10,310: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:39:10.311540073Z [2024-03-20 23:39:10,311: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:39:10.311554445Z [2024-03-20 23:39:10,311: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:39:10.318632535Z [2024-03-20 23:39:10,318: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d
2024-03-20T23:39:10.394215807Z [2024-03-20 23:39:10,393: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.collect_metrics scheduled__2024-03-20T23:30:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:39:10.917305670Z [2024-03-20 23:39:10,916: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8fb14610-5c1e-4b74-8df6-81d938895ea3] succeeded in 2.050085523000007s: None
2024-03-20T23:39:11.768959259Z [2024-03-20 23:39:11,768: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2977c547-6618-4149-8004-e10a7f94ac51] received
2024-03-20T23:39:11.785945789Z [2024-03-20 23:39:11,785: INFO/ForkPoolWorker-15] [2977c547-6618-4149-8004-e10a7f94ac51] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'send_prometheus', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:39:12.099006236Z [2024-03-20 23:39:12,095: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:39:13.306101045Z [2024-03-20 23:39:13,305: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:39:13.309303029Z [2024-03-20 23:39:13,308: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:39:13.326607167Z [2024-03-20 23:39:13,326: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:39:13.327619211Z [2024-03-20 23:39:13,327: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:39:13.327627026Z [2024-03-20 23:39:13,327: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:39:13.327743143Z [2024-03-20 23:39:13,327: INFO/ForkPoolWorker-15] Read VIM 063ab749-b0aa-4df3-8345-4c59c0deef9d (basic01_405123)
2024-03-20T23:39:13.327859030Z [2024-03-20 23:39:13,327: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '063ab749-b0aa-4df3-8345-4c59c0deef9d', 'name': 'basic01_405123', 'vim_type': 'openstack'}]
2024-03-20T23:39:13.327870278Z [2024-03-20 23:39:13,327: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:39:13.328078030Z [2024-03-20 23:39:13,327: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:39:13.328090536Z [2024-03-20 23:39:13,328: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:39:13.333566730Z [2024-03-20 23:39:13,333: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d
2024-03-20T23:39:13.398171485Z [2024-03-20 23:39:13,397: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d.send_prometheus scheduled__2024-03-20T23:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:39:13.832379794Z [2024-03-20 23:39:13,831: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2977c547-6618-4149-8004-e10a7f94ac51] succeeded in 2.0594392330001483s: None
2024-03-20T23:39:29.356536214Z [2024-03-20 23:39:29,356: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bea7437a-872c-409b-91b6-99b347d09cfe] received
2024-03-20T23:39:29.362081096Z [2024-03-20 23:39:29,361: INFO/ForkPoolWorker-15] [bea7437a-872c-409b-91b6-99b347d09cfe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:39:29.379226516Z [2024-03-20 23:39:29,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0bf23a22-09bb-498a-a388-90c7703a3f50] received
2024-03-20T23:39:29.415734607Z [2024-03-20 23:39:29,411: INFO/ForkPoolWorker-16] [0bf23a22-09bb-498a-a388-90c7703a3f50] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:39:29.744504074Z [2024-03-20 23:39:29,738: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:39:29.855212854Z [2024-03-20 23:39:29,852: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:39:31.106598819Z [2024-03-20 23:39:31,106: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:39:31.117999468Z [2024-03-20 23:39:31,116: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:39:31.142395465Z [2024-03-20 23:39:31,142: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:39:31.143639870Z [2024-03-20 23:39:31,143: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:39:31.146095439Z [2024-03-20 23:39:31,145: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:39:31.149501548Z [2024-03-20 23:39:31,149: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:39:31.149552953Z [2024-03-20 23:39:31,149: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:39:31.149646908Z [2024-03-20 23:39:31,149: INFO/ForkPoolWorker-15] Read VIM adb67b55-d8af-4988-ac97-e77af9a2ed0d (basic01_324769)
2024-03-20T23:39:31.149820747Z [2024-03-20 23:39:31,149: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'name': 'basic01_324769', 'vim_type': 'openstack'}]
2024-03-20T23:39:31.149861239Z [2024-03-20 23:39:31,149: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:39:31.150097089Z [2024-03-20 23:39:31,150: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:39:31.150147316Z [2024-03-20 23:39:31,150: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:39:31.157243531Z [2024-03-20 23:39:31,157: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d
2024-03-20T23:39:31.163087595Z [2024-03-20 23:39:31,162: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:39:31.164240840Z [2024-03-20 23:39:31,164: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:39:31.164353289Z [2024-03-20 23:39:31,164: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:39:31.164442297Z [2024-03-20 23:39:31,164: INFO/ForkPoolWorker-16] Read VIM adb67b55-d8af-4988-ac97-e77af9a2ed0d (basic01_324769)
2024-03-20T23:39:31.164597223Z [2024-03-20 23:39:31,164: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'name': 'basic01_324769', 'vim_type': 'openstack'}]
2024-03-20T23:39:31.164660095Z [2024-03-20 23:39:31,164: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:39:31.164947599Z [2024-03-20 23:39:31,164: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:39:31.165008066Z [2024-03-20 23:39:31,164: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:39:31.169195774Z [2024-03-20 23:39:31,168: INFO/ForkPoolWorker-16] Creating DAG vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d
2024-03-20T23:39:31.231327816Z [2024-03-20 23:39:31,231: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:39:31.240424055Z [2024-03-20 23:39:31,240: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:39:32.565519169Z [2024-03-20 23:39:32,565: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0bf23a22-09bb-498a-a388-90c7703a3f50] succeeded in 3.182109895000167s: None
2024-03-20T23:39:33.031336558Z [2024-03-20 23:39:33,030: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bea7437a-872c-409b-91b6-99b347d09cfe] succeeded in 3.6734599689998504s: None
2024-03-20T23:39:34.141004852Z [2024-03-20 23:39:34,140: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[225443d2-b1ca-4dec-9129-d66322888208] received
2024-03-20T23:39:34.148262275Z [2024-03-20 23:39:34,147: INFO/ForkPoolWorker-15] [225443d2-b1ca-4dec-9129-d66322888208] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:39:34.438842114Z [2024-03-20 23:39:34,435: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:39:35.533541790Z [2024-03-20 23:39:35,533: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:39:35.536932498Z [2024-03-20 23:39:35,536: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:39:35.556301962Z [2024-03-20 23:39:35,555: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:39:35.559124352Z [2024-03-20 23:39:35,558: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:39:35.559594499Z [2024-03-20 23:39:35,559: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:39:35.560091090Z [2024-03-20 23:39:35,559: INFO/ForkPoolWorker-15] Read VIM adb67b55-d8af-4988-ac97-e77af9a2ed0d (basic01_324769)
2024-03-20T23:39:35.560731268Z [2024-03-20 23:39:35,560: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'name': 'basic01_324769', 'vim_type': 'openstack'}]
2024-03-20T23:39:35.561019805Z [2024-03-20 23:39:35,560: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:39:35.561634125Z [2024-03-20 23:39:35,561: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:39:35.561924336Z [2024-03-20 23:39:35,561: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:39:35.572982156Z [2024-03-20 23:39:35,572: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d
2024-03-20T23:39:35.655636238Z [2024-03-20 23:39:35,655: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d.extract_metrics_from_vnfrs scheduled__2024-03-20T23:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:39:36.180732347Z [2024-03-20 23:39:36,180: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[225443d2-b1ca-4dec-9129-d66322888208] succeeded in 2.0378248780000376s: None
2024-03-20T23:39:36.341191502Z [2024-03-20 23:39:36,340: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb9bf3fa-aaf2-46eb-95bd-2dce1f35b74c] received
2024-03-20T23:39:36.354609918Z [2024-03-20 23:39:36,354: INFO/ForkPoolWorker-15] [cb9bf3fa-aaf2-46eb-95bd-2dce1f35b74c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'split_metrics', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:39:36.653068797Z [2024-03-20 23:39:36,650: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:39:37.739159861Z [2024-03-20 23:39:37,738: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:39:37.742772761Z [2024-03-20 23:39:37,742: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:39:37.761022841Z [2024-03-20 23:39:37,760: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:39:37.762413670Z [2024-03-20 23:39:37,762: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:39:37.762422761Z [2024-03-20 23:39:37,762: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:39:37.762501714Z [2024-03-20 23:39:37,762: INFO/ForkPoolWorker-15] Read VIM adb67b55-d8af-4988-ac97-e77af9a2ed0d (basic01_324769)
2024-03-20T23:39:37.762683749Z [2024-03-20 23:39:37,762: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'name': 'basic01_324769', 'vim_type': 'openstack'}]
2024-03-20T23:39:37.762716681Z [2024-03-20 23:39:37,762: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:39:37.762983523Z [2024-03-20 23:39:37,762: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:39:37.762989538Z [2024-03-20 23:39:37,762: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:39:37.769258535Z [2024-03-20 23:39:37,768: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d
2024-03-20T23:39:37.842312600Z [2024-03-20 23:39:37,841: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d.split_metrics scheduled__2024-03-20T23:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:39:38.364250140Z [2024-03-20 23:39:38,363: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cb9bf3fa-aaf2-46eb-95bd-2dce1f35b74c] succeeded in 2.0210272819999773s: None
2024-03-20T23:39:39.075928481Z [2024-03-20 23:39:39,075: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08d9f2f4-c470-4aa1-9d1c-35e012bf1fed] received
2024-03-20T23:39:39.083790449Z [2024-03-20 23:39:39,083: INFO/ForkPoolWorker-15] [08d9f2f4-c470-4aa1-9d1c-35e012bf1fed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'collect_metrics', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-20T23:39:39.372499044Z [2024-03-20 23:39:39,368: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:39:40.542341193Z [2024-03-20 23:39:40,541: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:39:40.545848709Z [2024-03-20 23:39:40,545: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:39:40.562615385Z [2024-03-20 23:39:40,562: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:39:40.563705591Z [2024-03-20 23:39:40,563: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:39:40.563770772Z [2024-03-20 23:39:40,563: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:39:40.563782334Z [2024-03-20 23:39:40,563: INFO/ForkPoolWorker-15] Read VIM adb67b55-d8af-4988-ac97-e77af9a2ed0d (basic01_324769)
2024-03-20T23:39:40.563943241Z [2024-03-20 23:39:40,563: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'name': 'basic01_324769', 'vim_type': 'openstack'}]
2024-03-20T23:39:40.563968958Z [2024-03-20 23:39:40,563: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:39:40.564259274Z [2024-03-20 23:39:40,564: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:39:40.564272813Z [2024-03-20 23:39:40,564: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:39:40.569976858Z [2024-03-20 23:39:40,569: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d
2024-03-20T23:39:40.658430149Z [2024-03-20 23:39:40,658: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d.collect_metrics scheduled__2024-03-20T23:30:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:39:41.189922520Z [2024-03-20 23:39:41,189: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[08d9f2f4-c470-4aa1-9d1c-35e012bf1fed] succeeded in 2.109736878999911s: None
2024-03-20T23:39:41.932933796Z [2024-03-20 23:39:41,932: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5efabd11-2e8f-40b2-91c2-a5964309da90] received
2024-03-20T23:39:41.938535183Z [2024-03-20 23:39:41,938: INFO/ForkPoolWorker-15] [5efabd11-2e8f-40b2-91c2-a5964309da90] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'send_prometheus', 'scheduled__2024-03-20T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:39:42.251438892Z [2024-03-20 23:39:42,243: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:39:43.364686173Z [2024-03-20 23:39:43,364: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:39:43.368115927Z [2024-03-20 23:39:43,367: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:39:43.387422804Z [2024-03-20 23:39:43,387: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:39:43.388686732Z [2024-03-20 23:39:43,388: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:39:43.389183657Z [2024-03-20 23:39:43,389: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:39:43.389277827Z [2024-03-20 23:39:43,389: INFO/ForkPoolWorker-15] Read VIM adb67b55-d8af-4988-ac97-e77af9a2ed0d (basic01_324769)
2024-03-20T23:39:43.389449167Z [2024-03-20 23:39:43,389: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'name': 'basic01_324769', 'vim_type': 'openstack'}]
2024-03-20T23:39:43.389507484Z [2024-03-20 23:39:43,389: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:39:43.389760427Z [2024-03-20 23:39:43,389: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:39:43.390079705Z [2024-03-20 23:39:43,389: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:39:43.396564241Z [2024-03-20 23:39:43,396: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d
2024-03-20T23:39:43.459460248Z [2024-03-20 23:39:43,459: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d.send_prometheus scheduled__2024-03-20T23:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:39:44.018159831Z [2024-03-20 23:39:44,017: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5efabd11-2e8f-40b2-91c2-a5964309da90] succeeded in 2.083578606999936s: None
2024-03-20T23:40:00.399434103Z [2024-03-20 23:40:00,399: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e61a159-eb1f-42ed-8bd7-f3f38d964d11] received
2024-03-20T23:40:00.407497491Z [2024-03-20 23:40:00,407: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e9ca1ee-b545-4c1f-8ddb-e7c3c4dbd781] received
2024-03-20T23:40:00.408137494Z [2024-03-20 23:40:00,407: INFO/ForkPoolWorker-15] [7e61a159-eb1f-42ed-8bd7-f3f38d964d11] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:40:00.421774179Z [2024-03-20 23:40:00,421: INFO/ForkPoolWorker-16] [0e9ca1ee-b545-4c1f-8ddb-e7c3c4dbd781] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:40:00.427397983Z [2024-03-20 23:40:00,427: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90e7c75c-57cf-46dc-8b9d-df06f9eea401] received
2024-03-20T23:40:00.429353065Z [2024-03-20 23:40:00,429: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62b0195c-6956-43e7-b2f2-7e69fe36200c] received
2024-03-20T23:40:00.430795930Z [2024-03-20 23:40:00,430: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8e62444-8e47-4174-be70-5e71f35a06e9] received
2024-03-20T23:40:00.432136002Z [2024-03-20 23:40:00,431: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1b96991-832d-426a-bbe6-21adf0eef443] received
2024-03-20T23:40:00.433335413Z [2024-03-20 23:40:00,433: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21b83276-2dba-46ed-8da8-3eb0d88092fd] received
2024-03-20T23:40:00.439441200Z [2024-03-20 23:40:00,439: INFO/ForkPoolWorker-1] [90e7c75c-57cf-46dc-8b9d-df06f9eea401] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:40:00.442644663Z [2024-03-20 23:40:00,442: INFO/ForkPoolWorker-2] [62b0195c-6956-43e7-b2f2-7e69fe36200c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:40:00.457153462Z [2024-03-20 23:40:00,456: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a581e2f-20c7-410f-800e-03f31ebd8bd8] received
2024-03-20T23:40:00.465692953Z [2024-03-20 23:40:00,465: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[728b3676-b6de-4829-888e-7a9fbe6f9004] received
2024-03-20T23:40:00.472948555Z [2024-03-20 23:40:00,472: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b90b48f-7cd4-4ff4-8898-d495426f4f55] received
2024-03-20T23:40:00.488968334Z [2024-03-20 23:40:00,488: INFO/ForkPoolWorker-4] [d1b96991-832d-426a-bbe6-21adf0eef443] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:40:00.493263992Z [2024-03-20 23:40:00,493: INFO/ForkPoolWorker-3] [c8e62444-8e47-4174-be70-5e71f35a06e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-20T23:40:00.517461043Z [2024-03-20 23:40:00,516: INFO/ForkPoolWorker-5] [21b83276-2dba-46ed-8da8-3eb0d88092fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-20T23:40:00.610736261Z [2024-03-20 23:40:00,610: INFO/ForkPoolWorker-8] [7b90b48f-7cd4-4ff4-8898-d495426f4f55] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:40:00.636527245Z [2024-03-20 23:40:00,610: INFO/ForkPoolWorker-7] [728b3676-b6de-4829-888e-7a9fbe6f9004] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:40:00.817686829Z [2024-03-20 23:40:00,817: INFO/ForkPoolWorker-6] [4a581e2f-20c7-410f-800e-03f31ebd8bd8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:40:00.925683729Z [2024-03-20 23:40:00,922: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:40:01.271886894Z [2024-03-20 23:40:01,268: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:40:01.461995307Z [2024-03-20 23:40:01,458: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:40:01.997765369Z [2024-03-20 23:40:01,994: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-20T23:40:02.054111349Z [2024-03-20 23:40:02,044: INFO/ForkPoolWorker-7] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:40:02.231004980Z [2024-03-20 23:40:02,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff7a0b8e-50a0-4755-955b-a6b05765712a] received
2024-03-20T23:40:02.304739524Z [2024-03-20 23:40:02,296: INFO/ForkPoolWorker-9] [ff7a0b8e-50a0-4755-955b-a6b05765712a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:40:02.510794255Z [2024-03-20 23:40:02,507: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:40:02.903815750Z [2024-03-20 23:40:02,903: INFO/ForkPoolWorker-5] Getting SDNC list
2024-03-20T23:40:02.908904930Z [2024-03-20 23:40:02,908: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:02.925585656Z [2024-03-20 23:40:02,913: INFO/ForkPoolWorker-9] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:40:02.943139687Z [2024-03-20 23:40:02,939: INFO/ForkPoolWorker-8] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:40:02.995140662Z [2024-03-20 23:40:02,994: INFO/ForkPoolWorker-5] Connected to database osm version 1.2
2024-03-20T23:40:03.000518444Z [2024-03-20 23:40:03,000: INFO/ForkPoolWorker-5] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-20T23:40:03.000764170Z [2024-03-20 23:40:03,000: INFO/ForkPoolWorker-5] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-20T23:40:03.000939238Z [2024-03-20 23:40:03,000: INFO/ForkPoolWorker-5] Getting SDNC list OK
2024-03-20T23:40:03.001269582Z [2024-03-20 23:40:03,001: INFO/ForkPoolWorker-5] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-20T23:40:03.065369460Z [2024-03-20 23:40:03,061: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:40:03.200618835Z [2024-03-20 23:40:03,200: INFO/ForkPoolWorker-5] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-20T23:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:40:03.231717549Z [2024-03-20 23:40:03,215: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-20T23:40:03.283220062Z [2024-03-20 23:40:03,270: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:40:03.530730212Z [2024-03-20 23:40:03,530: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:40:03.534377286Z [2024-03-20 23:40:03,533: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:03.561335494Z [2024-03-20 23:40:03,561: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:40:03.563319553Z [2024-03-20 23:40:03,563: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:03.563513993Z [2024-03-20 23:40:03,563: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:03.563670522Z [2024-03-20 23:40:03,563: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:03.563747133Z [2024-03-20 23:40:03,563: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:40:03.564037830Z [2024-03-20 23:40:03,563: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:40:03.564119999Z [2024-03-20 23:40:03,564: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:03.792134556Z [2024-03-20 23:40:03,791: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-20T23:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:40:04.480146965Z [2024-03-20 23:40:04,479: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-20T23:40:04.500610478Z [2024-03-20 23:40:04,499: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:04.538732382Z [2024-03-20 23:40:04,538: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[21b83276-2dba-46ed-8da8-3eb0d88092fd] succeeded in 4.103668120999828s: None
2024-03-20T23:40:04.566073198Z [2024-03-20 23:40:04,565: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-20T23:40:04.569372850Z [2024-03-20 23:40:04,569: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:04.569543952Z [2024-03-20 23:40:04,569: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:04.569821506Z [2024-03-20 23:40:04,569: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:04.569949958Z [2024-03-20 23:40:04,569: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-20T23:40:04.570268742Z [2024-03-20 23:40:04,570: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:40:04.570722037Z [2024-03-20 23:40:04,570: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:04.729497084Z [2024-03-20 23:40:04,729: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:40:04.804348344Z [2024-03-20 23:40:04,803: INFO/ForkPoolWorker-3] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-20T23:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:40:05.590514015Z [2024-03-20 23:40:05,590: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0e9ca1ee-b545-4c1f-8ddb-e7c3c4dbd781] succeeded in 5.17590700300002s: None
2024-03-20T23:40:05.882739623Z [2024-03-20 23:40:05,882: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e63197a-85e6-48bb-a8a8-f1155b496049] received
2024-03-20T23:40:05.899715768Z [2024-03-20 23:40:05,899: INFO/ForkPoolWorker-16] [5e63197a-85e6-48bb-a8a8-f1155b496049] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-20T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:40:06.341483535Z [2024-03-20 23:40:06,341: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-20T23:40:06.345600224Z [2024-03-20 23:40:06,345: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:06.359298790Z [2024-03-20 23:40:06,351: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:40:06.409483475Z [2024-03-20 23:40:06,409: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-20T23:40:06.414256048Z [2024-03-20 23:40:06,413: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:06.414479932Z [2024-03-20 23:40:06,414: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:06.415183409Z [2024-03-20 23:40:06,414: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:06.415607736Z [2024-03-20 23:40:06,415: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-20T23:40:06.416153342Z [2024-03-20 23:40:06,415: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:40:06.418302499Z [2024-03-20 23:40:06,418: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:06.437905987Z [2024-03-20 23:40:06,437: WARNING/ForkPoolWorker-1] Dag 'vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:40:06.445574439Z [2024-03-20 23:40:06,444: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:40:06.446923920Z [2024-03-20 23:40:06,446: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-20T23:40:06.455959302Z [2024-03-20 23:40:06,455: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:06.537254980Z [2024-03-20 23:40:06,537: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-20T23:40:06.541731529Z [2024-03-20 23:40:06,541: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:06.541945661Z [2024-03-20 23:40:06,541: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:06.542231700Z [2024-03-20 23:40:06,542: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:06.542401061Z [2024-03-20 23:40:06,542: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-20T23:40:06.542776603Z [2024-03-20 23:40:06,542: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:40:06.543050662Z [2024-03-20 23:40:06,542: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:06.552834827Z [2024-03-20 23:40:06,546: ERROR/ForkPoolWorker-1] [90e7c75c-57cf-46dc-8b9d-df06f9eea401] Failed to execute task Dag 'vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d' could not be found; either it does not exist or it failed to parse..
2024-03-20T23:40:06.552855686Z Traceback (most recent call last):
2024-03-20T23:40:06.552860634Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-20T23:40:06.552864871Z     args.func(args)
2024-03-20T23:40:06.552868560Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-20T23:40:06.552872314Z     return func(*args, **kwargs)
2024-03-20T23:40:06.552875448Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-20T23:40:06.552878617Z     return f(*args, **kwargs)
2024-03-20T23:40:06.552881795Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-20T23:40:06.552884908Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-20T23:40:06.552887996Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-20T23:40:06.552891071Z     raise AirflowException(
2024-03-20T23:40:06.552894888Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d' could not be found; either it does not exist or it failed to parse.
2024-03-20T23:40:06.612835316Z [2024-03-20 23:40:06,610: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[90e7c75c-57cf-46dc-8b9d-df06f9eea401] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 90e7c75c-57cf-46dc-8b9d-df06f9eea401')
2024-03-20T23:40:06.612873280Z Traceback (most recent call last):
2024-03-20T23:40:06.612877403Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-20T23:40:06.612880432Z     R = retval = fun(*args, **kwargs)
2024-03-20T23:40:06.612883728Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-20T23:40:06.612886727Z     return self.run(*args, **kwargs)
2024-03-20T23:40:06.612890615Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-20T23:40:06.612894006Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-20T23:40:06.612897159Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-20T23:40:06.612900742Z     raise AirflowException(msg)
2024-03-20T23:40:06.612904638Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 90e7c75c-57cf-46dc-8b9d-df06f9eea401
2024-03-20T23:40:07.022323493Z [2024-03-20 23:40:07,021: INFO/ForkPoolWorker-8] Getting VIM list
2024-03-20T23:40:07.026003415Z [2024-03-20 23:40:07,025: INFO/ForkPoolWorker-8] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:07.064885358Z [2024-03-20 23:40:07,064: INFO/ForkPoolWorker-8] Connected to database osm version 1.2
2024-03-20T23:40:07.068781701Z [2024-03-20 23:40:07,068: INFO/ForkPoolWorker-8] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:07.068804246Z [2024-03-20 23:40:07,068: INFO/ForkPoolWorker-8] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:07.068952006Z [2024-03-20 23:40:07,068: INFO/ForkPoolWorker-8] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:07.068958852Z [2024-03-20 23:40:07,068: INFO/ForkPoolWorker-8] Getting VIM list OK
2024-03-20T23:40:07.069178271Z [2024-03-20 23:40:07,069: INFO/ForkPoolWorker-8] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:40:07.069184936Z [2024-03-20 23:40:07,069: INFO/ForkPoolWorker-8] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:07.069341091Z [2024-03-20 23:40:07,069: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[c8e62444-8e47-4174-be70-5e71f35a06e9] succeeded in 6.636379612000155s: None
2024-03-20T23:40:07.275253556Z [2024-03-20 23:40:07,274: INFO/ForkPoolWorker-8] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:40:07.498872576Z [2024-03-20 23:40:07,498: INFO/ForkPoolWorker-9] Getting VIM list
2024-03-20T23:40:07.503540170Z [2024-03-20 23:40:07,502: INFO/ForkPoolWorker-9] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:07.541354789Z [2024-03-20 23:40:07,541: INFO/ForkPoolWorker-9] Connected to database osm version 1.2
2024-03-20T23:40:07.545465875Z [2024-03-20 23:40:07,545: INFO/ForkPoolWorker-9] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:07.545498014Z [2024-03-20 23:40:07,545: INFO/ForkPoolWorker-9] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:07.545563932Z [2024-03-20 23:40:07,545: INFO/ForkPoolWorker-9] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:07.545639494Z [2024-03-20 23:40:07,545: INFO/ForkPoolWorker-9] Getting VIM list OK
2024-03-20T23:40:07.545978673Z [2024-03-20 23:40:07,545: INFO/ForkPoolWorker-9] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:40:07.545991329Z [2024-03-20 23:40:07,545: INFO/ForkPoolWorker-9] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:07.549901138Z [2024-03-20 23:40:07,549: INFO/ForkPoolWorker-6] Getting VIM list
2024-03-20T23:40:07.553551775Z [2024-03-20 23:40:07,553: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:07.556927923Z [2024-03-20 23:40:07,556: WARNING/ForkPoolWorker-9] Dag 'vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:40:07.561934448Z [2024-03-20 23:40:07,560: INFO/ForkPoolWorker-9] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:40:07.565841558Z [2024-03-20 23:40:07,565: INFO/ForkPoolWorker-9] Getting VIM list
2024-03-20T23:40:07.569142428Z [2024-03-20 23:40:07,568: INFO/ForkPoolWorker-9] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:07.580862529Z [2024-03-20 23:40:07,578: INFO/ForkPoolWorker-6] Connected to database osm version 1.2
2024-03-20T23:40:07.581217509Z [2024-03-20 23:40:07,580: INFO/ForkPoolWorker-6] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:07.581270353Z [2024-03-20 23:40:07,581: INFO/ForkPoolWorker-6] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:07.581430787Z [2024-03-20 23:40:07,581: INFO/ForkPoolWorker-6] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:07.581484754Z [2024-03-20 23:40:07,581: INFO/ForkPoolWorker-6] Getting VIM list OK
2024-03-20T23:40:07.582516521Z [2024-03-20 23:40:07,582: INFO/ForkPoolWorker-6] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:40:07.582611041Z [2024-03-20 23:40:07,582: INFO/ForkPoolWorker-6] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:07.589999853Z [2024-03-20 23:40:07,589: WARNING/ForkPoolWorker-6] Dag 'vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:40:07.590814080Z [2024-03-20 23:40:07,590: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:40:07.591618352Z [2024-03-20 23:40:07,591: INFO/ForkPoolWorker-6] Getting VIM list
2024-03-20T23:40:07.595716722Z [2024-03-20 23:40:07,595: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:07.612054524Z [2024-03-20 23:40:07,611: INFO/ForkPoolWorker-9] Connected to database osm version 1.2
2024-03-20T23:40:07.614843553Z [2024-03-20 23:40:07,614: INFO/ForkPoolWorker-9] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:07.614855173Z [2024-03-20 23:40:07,614: INFO/ForkPoolWorker-9] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:07.615003548Z [2024-03-20 23:40:07,614: INFO/ForkPoolWorker-9] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:07.615009938Z [2024-03-20 23:40:07,614: INFO/ForkPoolWorker-6] Connected to database osm version 1.2
2024-03-20T23:40:07.615017197Z [2024-03-20 23:40:07,614: INFO/ForkPoolWorker-9] Getting VIM list OK
2024-03-20T23:40:07.615217531Z [2024-03-20 23:40:07,615: INFO/ForkPoolWorker-9] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:40:07.615236736Z [2024-03-20 23:40:07,615: INFO/ForkPoolWorker-9] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:07.616539945Z [2024-03-20 23:40:07,616: INFO/ForkPoolWorker-6] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:07.616600251Z [2024-03-20 23:40:07,616: INFO/ForkPoolWorker-6] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:07.616735693Z [2024-03-20 23:40:07,616: INFO/ForkPoolWorker-6] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:07.616746604Z [2024-03-20 23:40:07,616: INFO/ForkPoolWorker-6] Getting VIM list OK
2024-03-20T23:40:07.616972625Z [2024-03-20 23:40:07,616: INFO/ForkPoolWorker-6] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:40:07.616978692Z [2024-03-20 23:40:07,616: INFO/ForkPoolWorker-6] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:07.619186282Z [2024-03-20 23:40:07,618: ERROR/ForkPoolWorker-9] [ff7a0b8e-50a0-4755-955b-a6b05765712a] Failed to execute task Dag 'vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d' could not be found; either it does not exist or it failed to parse..
2024-03-20T23:40:07.619198520Z Traceback (most recent call last):
2024-03-20T23:40:07.619202476Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-20T23:40:07.619206283Z     args.func(args)
2024-03-20T23:40:07.619210159Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-20T23:40:07.619213759Z     return func(*args, **kwargs)
2024-03-20T23:40:07.619216846Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-20T23:40:07.619219967Z     return f(*args, **kwargs)
2024-03-20T23:40:07.619223017Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-20T23:40:07.619226330Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-20T23:40:07.619229683Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-20T23:40:07.619232761Z     raise AirflowException(
2024-03-20T23:40:07.619259601Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d' could not be found; either it does not exist or it failed to parse.
2024-03-20T23:40:07.620704663Z [2024-03-20 23:40:07,620: ERROR/ForkPoolWorker-6] [4a581e2f-20c7-410f-800e-03f31ebd8bd8] Failed to execute task Dag 'vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d' could not be found; either it does not exist or it failed to parse..
2024-03-20T23:40:07.620717245Z Traceback (most recent call last):
2024-03-20T23:40:07.620721048Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-20T23:40:07.620724779Z     args.func(args)
2024-03-20T23:40:07.620728370Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-20T23:40:07.620732041Z     return func(*args, **kwargs)
2024-03-20T23:40:07.620735102Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-20T23:40:07.620753841Z     return f(*args, **kwargs)
2024-03-20T23:40:07.620757587Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-20T23:40:07.620760781Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-20T23:40:07.620763960Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-20T23:40:07.620767070Z     raise AirflowException(
2024-03-20T23:40:07.620770794Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d' could not be found; either it does not exist or it failed to parse.
2024-03-20T23:40:07.665638869Z [2024-03-20 23:40:07,665: ERROR/ForkPoolWorker-6] Task airflow.executors.celery_executor.execute_command[4a581e2f-20c7-410f-800e-03f31ebd8bd8] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4a581e2f-20c7-410f-800e-03f31ebd8bd8')
2024-03-20T23:40:07.665661595Z Traceback (most recent call last):
2024-03-20T23:40:07.665666104Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-20T23:40:07.665669284Z     R = retval = fun(*args, **kwargs)
2024-03-20T23:40:07.665687904Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-20T23:40:07.665691435Z     return self.run(*args, **kwargs)
2024-03-20T23:40:07.665695300Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-20T23:40:07.665699131Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-20T23:40:07.665702139Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-20T23:40:07.665705844Z     raise AirflowException(msg)
2024-03-20T23:40:07.665709669Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4a581e2f-20c7-410f-800e-03f31ebd8bd8
2024-03-20T23:40:07.708456322Z [2024-03-20 23:40:07,707: ERROR/ForkPoolWorker-9] Task airflow.executors.celery_executor.execute_command[ff7a0b8e-50a0-4755-955b-a6b05765712a] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id ff7a0b8e-50a0-4755-955b-a6b05765712a')
2024-03-20T23:40:07.708478344Z Traceback (most recent call last):
2024-03-20T23:40:07.708482886Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-20T23:40:07.708486500Z     R = retval = fun(*args, **kwargs)
2024-03-20T23:40:07.708501280Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-20T23:40:07.708504495Z     return self.run(*args, **kwargs)
2024-03-20T23:40:07.708508122Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-20T23:40:07.708511740Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-20T23:40:07.708514793Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-20T23:40:07.708518324Z     raise AirflowException(msg)
2024-03-20T23:40:07.708522134Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id ff7a0b8e-50a0-4755-955b-a6b05765712a
2024-03-20T23:40:07.713878378Z [2024-03-20 23:40:07,713: INFO/ForkPoolWorker-7] Getting VIM list
2024-03-20T23:40:07.717092017Z [2024-03-20 23:40:07,716: INFO/ForkPoolWorker-7] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:07.734760137Z [2024-03-20 23:40:07,734: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:40:07.740247911Z [2024-03-20 23:40:07,739: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:07.762090538Z [2024-03-20 23:40:07,761: INFO/ForkPoolWorker-7] Connected to database osm version 1.2
2024-03-20T23:40:07.764253219Z [2024-03-20 23:40:07,764: INFO/ForkPoolWorker-7] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:07.764266030Z [2024-03-20 23:40:07,764: INFO/ForkPoolWorker-7] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:07.764428886Z [2024-03-20 23:40:07,764: INFO/ForkPoolWorker-7] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:07.764440654Z [2024-03-20 23:40:07,764: INFO/ForkPoolWorker-7] Getting VIM list OK
2024-03-20T23:40:07.764652589Z [2024-03-20 23:40:07,764: INFO/ForkPoolWorker-7] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:40:07.764700137Z [2024-03-20 23:40:07,764: INFO/ForkPoolWorker-7] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:07.771388085Z [2024-03-20 23:40:07,770: WARNING/ForkPoolWorker-7] Dag 'vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:40:07.771786725Z [2024-03-20 23:40:07,771: INFO/ForkPoolWorker-7] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:40:07.772029607Z [2024-03-20 23:40:07,771: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:40:07.772588470Z [2024-03-20 23:40:07,772: INFO/ForkPoolWorker-7] Getting VIM list
2024-03-20T23:40:07.773397573Z [2024-03-20 23:40:07,773: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:07.773409408Z [2024-03-20 23:40:07,773: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:07.773556267Z [2024-03-20 23:40:07,773: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:07.773562198Z [2024-03-20 23:40:07,773: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:40:07.773801591Z [2024-03-20 23:40:07,773: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:40:07.773811985Z [2024-03-20 23:40:07,773: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:07.775242009Z [2024-03-20 23:40:07,774: INFO/ForkPoolWorker-7] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:07.784023978Z [2024-03-20 23:40:07,783: WARNING/ForkPoolWorker-15] Dag 'vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:40:07.784920420Z [2024-03-20 23:40:07,784: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:40:07.785839122Z [2024-03-20 23:40:07,785: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:40:07.788262143Z [2024-03-20 23:40:07,788: INFO/ForkPoolWorker-7] Connected to database osm version 1.2
2024-03-20T23:40:07.790847056Z [2024-03-20 23:40:07,790: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:07.792465458Z [2024-03-20 23:40:07,792: INFO/ForkPoolWorker-7] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:07.792480441Z [2024-03-20 23:40:07,792: INFO/ForkPoolWorker-7] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:07.792626742Z [2024-03-20 23:40:07,792: INFO/ForkPoolWorker-7] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:07.792638133Z [2024-03-20 23:40:07,792: INFO/ForkPoolWorker-7] Getting VIM list OK
2024-03-20T23:40:07.793059852Z [2024-03-20 23:40:07,792: INFO/ForkPoolWorker-7] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:40:07.793070007Z [2024-03-20 23:40:07,792: INFO/ForkPoolWorker-7] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:07.797045197Z [2024-03-20 23:40:07,796: ERROR/ForkPoolWorker-7] [728b3676-b6de-4829-888e-7a9fbe6f9004] Failed to execute task Dag 'vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d' could not be found; either it does not exist or it failed to parse..
2024-03-20T23:40:07.797075556Z Traceback (most recent call last):
2024-03-20T23:40:07.797079941Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-20T23:40:07.797084237Z     args.func(args)
2024-03-20T23:40:07.797087796Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-20T23:40:07.797091418Z     return func(*args, **kwargs)
2024-03-20T23:40:07.797094507Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-20T23:40:07.797110219Z     return f(*args, **kwargs)
2024-03-20T23:40:07.797113508Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-20T23:40:07.797116712Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-20T23:40:07.797119840Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-20T23:40:07.797122895Z     raise AirflowException(
2024-03-20T23:40:07.797127112Z airflow.exceptions.AirflowException: Dag 'vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d' could not be found; either it does not exist or it failed to parse.
2024-03-20T23:40:07.827095198Z [2024-03-20 23:40:07,826: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:40:07.830399563Z [2024-03-20 23:40:07,830: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:07.830490581Z [2024-03-20 23:40:07,830: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:07.830702937Z [2024-03-20 23:40:07,830: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:07.830716421Z [2024-03-20 23:40:07,830: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:40:07.830957284Z [2024-03-20 23:40:07,830: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:40:07.831074970Z [2024-03-20 23:40:07,830: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:07.836108216Z [2024-03-20 23:40:07,835: ERROR/ForkPoolWorker-15] [7e61a159-eb1f-42ed-8bd7-f3f38d964d11] Failed to execute task Dag 'vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d' could not be found; either it does not exist or it failed to parse..
2024-03-20T23:40:07.836125831Z Traceback (most recent call last):
2024-03-20T23:40:07.836131034Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-20T23:40:07.836135951Z     args.func(args)
2024-03-20T23:40:07.836139717Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-20T23:40:07.836158366Z     return func(*args, **kwargs)
2024-03-20T23:40:07.836161839Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-20T23:40:07.836165019Z     return f(*args, **kwargs)
2024-03-20T23:40:07.836168119Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-20T23:40:07.836171433Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-20T23:40:07.836174670Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-20T23:40:07.836177866Z     raise AirflowException(
2024-03-20T23:40:07.836184888Z airflow.exceptions.AirflowException: Dag 'vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d' could not be found; either it does not exist or it failed to parse.
2024-03-20T23:40:07.852093945Z [2024-03-20 23:40:07,851: INFO/ForkPoolWorker-4] Getting VIM list
2024-03-20T23:40:07.855019503Z [2024-03-20 23:40:07,854: ERROR/ForkPoolWorker-7] Task airflow.executors.celery_executor.execute_command[728b3676-b6de-4829-888e-7a9fbe6f9004] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 728b3676-b6de-4829-888e-7a9fbe6f9004')
2024-03-20T23:40:07.855039439Z Traceback (most recent call last):
2024-03-20T23:40:07.855043676Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-20T23:40:07.855074449Z     R = retval = fun(*args, **kwargs)
2024-03-20T23:40:07.855077779Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-20T23:40:07.855081274Z     return self.run(*args, **kwargs)
2024-03-20T23:40:07.855085250Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-20T23:40:07.855090324Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-20T23:40:07.855093468Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-20T23:40:07.855096901Z     raise AirflowException(msg)
2024-03-20T23:40:07.855101106Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 728b3676-b6de-4829-888e-7a9fbe6f9004
2024-03-20T23:40:07.856705346Z [2024-03-20 23:40:07,855: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:07.882172278Z [2024-03-20 23:40:07,881: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7e61a159-eb1f-42ed-8bd7-f3f38d964d11] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7e61a159-eb1f-42ed-8bd7-f3f38d964d11')
2024-03-20T23:40:07.882213853Z Traceback (most recent call last):
2024-03-20T23:40:07.882220795Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-20T23:40:07.882225947Z     R = retval = fun(*args, **kwargs)
2024-03-20T23:40:07.882230920Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-20T23:40:07.882235974Z     return self.run(*args, **kwargs)
2024-03-20T23:40:07.882242113Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-20T23:40:07.882248154Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-20T23:40:07.882253728Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-20T23:40:07.882259566Z     raise AirflowException(msg)
2024-03-20T23:40:07.882265836Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7e61a159-eb1f-42ed-8bd7-f3f38d964d11
2024-03-20T23:40:07.894859470Z [2024-03-20 23:40:07,894: INFO/ForkPoolWorker-4] Connected to database osm version 1.2
2024-03-20T23:40:07.897361888Z [2024-03-20 23:40:07,897: INFO/ForkPoolWorker-4] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:07.897433984Z [2024-03-20 23:40:07,897: INFO/ForkPoolWorker-4] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:07.897535337Z [2024-03-20 23:40:07,897: INFO/ForkPoolWorker-4] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:07.897562238Z [2024-03-20 23:40:07,897: INFO/ForkPoolWorker-4] Getting VIM list OK
2024-03-20T23:40:07.897822776Z [2024-03-20 23:40:07,897: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:40:07.898550399Z [2024-03-20 23:40:07,897: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:07.904261136Z [2024-03-20 23:40:07,904: WARNING/ForkPoolWorker-4] Dag 'vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:40:07.904934593Z [2024-03-20 23:40:07,904: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:40:07.905794767Z [2024-03-20 23:40:07,905: INFO/ForkPoolWorker-4] Getting VIM list
2024-03-20T23:40:07.908672812Z [2024-03-20 23:40:07,908: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:07.923644436Z [2024-03-20 23:40:07,923: INFO/ForkPoolWorker-4] Connected to database osm version 1.2
2024-03-20T23:40:07.925062143Z [2024-03-20 23:40:07,924: INFO/ForkPoolWorker-4] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:07.925078960Z [2024-03-20 23:40:07,924: INFO/ForkPoolWorker-4] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:07.925178431Z [2024-03-20 23:40:07,924: INFO/ForkPoolWorker-4] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:07.925185999Z [2024-03-20 23:40:07,925: INFO/ForkPoolWorker-4] Getting VIM list OK
2024-03-20T23:40:07.925481303Z [2024-03-20 23:40:07,925: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:40:07.925491107Z [2024-03-20 23:40:07,925: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:07.929160158Z [2024-03-20 23:40:07,928: ERROR/ForkPoolWorker-4] [d1b96991-832d-426a-bbe6-21adf0eef443] Failed to execute task Dag 'vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d' could not be found; either it does not exist or it failed to parse..
2024-03-20T23:40:07.929175508Z Traceback (most recent call last):
2024-03-20T23:40:07.929182103Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-20T23:40:07.929216776Z     args.func(args)
2024-03-20T23:40:07.929223358Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-20T23:40:07.929229240Z     return func(*args, **kwargs)
2024-03-20T23:40:07.929234244Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-20T23:40:07.929239312Z     return f(*args, **kwargs)
2024-03-20T23:40:07.929244258Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-20T23:40:07.929249293Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-20T23:40:07.929254388Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-20T23:40:07.929259220Z     raise AirflowException(
2024-03-20T23:40:07.929265180Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d' could not be found; either it does not exist or it failed to parse.
2024-03-20T23:40:07.972509346Z [2024-03-20 23:40:07,971: ERROR/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[d1b96991-832d-426a-bbe6-21adf0eef443] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d1b96991-832d-426a-bbe6-21adf0eef443')
2024-03-20T23:40:07.972559972Z Traceback (most recent call last):
2024-03-20T23:40:07.972564729Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-20T23:40:07.972567720Z     R = retval = fun(*args, **kwargs)
2024-03-20T23:40:07.972571031Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-20T23:40:07.972573892Z     return self.run(*args, **kwargs)
2024-03-20T23:40:07.972578055Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-20T23:40:07.972581290Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-20T23:40:07.972584299Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-20T23:40:07.972587738Z     raise AirflowException(msg)
2024-03-20T23:40:07.972591349Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d1b96991-832d-426a-bbe6-21adf0eef443
2024-03-20T23:40:08.190928264Z [2024-03-20 23:40:08,189: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:40:08.195919099Z [2024-03-20 23:40:08,193: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:08.230150003Z [2024-03-20 23:40:08,229: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:40:08.231403192Z [2024-03-20 23:40:08,231: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:08.231455381Z [2024-03-20 23:40:08,231: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:08.231594148Z [2024-03-20 23:40:08,231: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:08.231652685Z [2024-03-20 23:40:08,231: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:40:08.231989438Z [2024-03-20 23:40:08,231: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:40:08.232118206Z [2024-03-20 23:40:08,232: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:08.350075203Z [2024-03-20 23:40:08,349: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-20T23:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:40:08.618284111Z [2024-03-20 23:40:08,617: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[62b0195c-6956-43e7-b2f2-7e69fe36200c] succeeded in 8.185079378999944s: None
2024-03-20T23:40:09.106596234Z [2024-03-20 23:40:09,106: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5e63197a-85e6-48bb-a8a8-f1155b496049] succeeded in 3.2220961819998593s: None
2024-03-20T23:40:09.330004820Z [2024-03-20 23:40:09,329: INFO/ForkPoolWorker-8] Task airflow.executors.celery_executor.execute_command[7b90b48f-7cd4-4ff4-8898-d495426f4f55] succeeded in 8.852152293000017s: None
2024-03-20T23:40:09.723638402Z [2024-03-20 23:40:09,723: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce31ef54-4e71-43a8-b584-3437df477369] received
2024-03-20T23:40:09.733158645Z [2024-03-20 23:40:09,732: INFO/ForkPoolWorker-15] [ce31ef54-4e71-43a8-b584-3437df477369] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-20T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-20T23:40:10.088876052Z [2024-03-20 23:40:10,085: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:40:11.279678155Z [2024-03-20 23:40:11,279: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:40:11.282945643Z [2024-03-20 23:40:11,282: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:11.303745508Z [2024-03-20 23:40:11,303: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:40:11.305301121Z [2024-03-20 23:40:11,305: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:11.305338074Z [2024-03-20 23:40:11,305: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:11.305510750Z [2024-03-20 23:40:11,305: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:11.305577953Z [2024-03-20 23:40:11,305: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:40:11.305809559Z [2024-03-20 23:40:11,305: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:40:11.305831002Z [2024-03-20 23:40:11,305: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:11.382544569Z [2024-03-20 23:40:11,382: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-20T23:35:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:40:11.922175916Z [2024-03-20 23:40:11,921: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ce31ef54-4e71-43a8-b584-3437df477369] succeeded in 2.1963372069999423s: None
2024-03-20T23:40:12.341146385Z [2024-03-20 23:40:12,340: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b6c64c6-5750-44cf-8027-abdeaf4f5ed1] received
2024-03-20T23:40:12.366111154Z [2024-03-20 23:40:12,365: INFO/ForkPoolWorker-15] [8b6c64c6-5750-44cf-8027-abdeaf4f5ed1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-20T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:40:12.673411985Z [2024-03-20 23:40:12,670: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:40:13.868933999Z [2024-03-20 23:40:13,868: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:40:13.874310262Z [2024-03-20 23:40:13,873: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:13.897779349Z [2024-03-20 23:40:13,897: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:40:13.899019022Z [2024-03-20 23:40:13,898: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:13.899105588Z [2024-03-20 23:40:13,898: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:13.899297396Z [2024-03-20 23:40:13,898: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:13.899406186Z [2024-03-20 23:40:13,899: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:40:13.899742692Z [2024-03-20 23:40:13,899: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:40:13.899912895Z [2024-03-20 23:40:13,899: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:13.989252035Z [2024-03-20 23:40:13,988: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-20T23:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:40:14.558673111Z [2024-03-20 23:40:14,557: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8b6c64c6-5750-44cf-8027-abdeaf4f5ed1] succeeded in 2.2044109299999946s: None
2024-03-20T23:40:17.622141807Z [2024-03-20 23:40:17,621: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1bc9b875-3f7c-4dba-b090-766ec281fa20] received
2024-03-20T23:40:17.632956931Z [2024-03-20 23:40:17,632: INFO/ForkPoolWorker-15] [1bc9b875-3f7c-4dba-b090-766ec281fa20] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:40:17.955267492Z [2024-03-20 23:40:17,952: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:40:19.058814172Z [2024-03-20 23:40:19,058: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:40:19.062296317Z [2024-03-20 23:40:19,061: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:19.066630848Z [2024-03-20 23:40:19,066: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[630c5e78-009b-4dc4-aa4f-5ab13d8a891e] received
2024-03-20T23:40:19.068581035Z [2024-03-20 23:40:19,068: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7b6b20e-baa8-4ce0-af19-bb9333491314] received
2024-03-20T23:40:19.074147210Z [2024-03-20 23:40:19,073: INFO/ForkPoolWorker-1] [e7b6b20e-baa8-4ce0-af19-bb9333491314] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:40:19.076841337Z [2024-03-20 23:40:19,076: INFO/ForkPoolWorker-16] [630c5e78-009b-4dc4-aa4f-5ab13d8a891e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:40:19.087612103Z [2024-03-20 23:40:19,087: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb70d7aa-f4a6-4165-b988-f3bcbfe6321f] received
2024-03-20T23:40:19.096428320Z [2024-03-20 23:40:19,096: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5aef0d33-a309-401d-9798-50146be2d576] received
2024-03-20T23:40:19.096908650Z [2024-03-20 23:40:19,096: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:40:19.097930661Z [2024-03-20 23:40:19,097: INFO/ForkPoolWorker-2] [fb70d7aa-f4a6-4165-b988-f3bcbfe6321f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:40:19.098176062Z [2024-03-20 23:40:19,098: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:19.106784292Z [2024-03-20 23:40:19,106: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:19.106919498Z [2024-03-20 23:40:19,106: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:19.106994066Z [2024-03-20 23:40:19,106: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:40:19.107332369Z [2024-03-20 23:40:19,107: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:40:19.107387769Z [2024-03-20 23:40:19,107: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:19.107701414Z [2024-03-20 23:40:19,107: INFO/ForkPoolWorker-3] [5aef0d33-a309-401d-9798-50146be2d576] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:40:19.110443752Z [2024-03-20 23:40:19,110: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[224e8407-f2fa-48c1-925e-646377651e0f] received
2024-03-20T23:40:19.119793796Z [2024-03-20 23:40:19,119: INFO/ForkPoolWorker-4] [224e8407-f2fa-48c1-925e-646377651e0f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:40:19.120124581Z [2024-03-20 23:40:19,119: WARNING/ForkPoolWorker-15] Dag 'vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:40:19.120892324Z [2024-03-20 23:40:19,120: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:40:19.121857307Z [2024-03-20 23:40:19,121: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:40:19.124673202Z [2024-03-20 23:40:19,124: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:19.161243206Z [2024-03-20 23:40:19,161: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:40:19.164603769Z [2024-03-20 23:40:19,164: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:19.164762229Z [2024-03-20 23:40:19,164: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:19.164968600Z [2024-03-20 23:40:19,164: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:19.165142404Z [2024-03-20 23:40:19,165: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:40:19.165486232Z [2024-03-20 23:40:19,165: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:40:19.165983704Z [2024-03-20 23:40:19,165: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:19.169803023Z [2024-03-20 23:40:19,169: ERROR/ForkPoolWorker-15] [1bc9b875-3f7c-4dba-b090-766ec281fa20] Failed to execute task Dag 'vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d' could not be found; either it does not exist or it failed to parse..
2024-03-20T23:40:19.169819891Z Traceback (most recent call last):
2024-03-20T23:40:19.169824055Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-20T23:40:19.169836968Z     args.func(args)
2024-03-20T23:40:19.169840763Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-20T23:40:19.169844827Z     return func(*args, **kwargs)
2024-03-20T23:40:19.169847904Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-20T23:40:19.169851342Z     return f(*args, **kwargs)
2024-03-20T23:40:19.169854475Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-20T23:40:19.169857575Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-20T23:40:19.169860974Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-20T23:40:19.169863947Z     raise AirflowException(
2024-03-20T23:40:19.169868700Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d' could not be found; either it does not exist or it failed to parse.
2024-03-20T23:40:19.228768830Z [2024-03-20 23:40:19,228: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1bc9b875-3f7c-4dba-b090-766ec281fa20] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1bc9b875-3f7c-4dba-b090-766ec281fa20')
2024-03-20T23:40:19.228798267Z Traceback (most recent call last):
2024-03-20T23:40:19.228802432Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-20T23:40:19.228805676Z     R = retval = fun(*args, **kwargs)
2024-03-20T23:40:19.228808795Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-20T23:40:19.228811793Z     return self.run(*args, **kwargs)
2024-03-20T23:40:19.228815799Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-20T23:40:19.228819498Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-20T23:40:19.228822596Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-20T23:40:19.228826503Z     raise AirflowException(msg)
2024-03-20T23:40:19.228833057Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1bc9b875-3f7c-4dba-b090-766ec281fa20
2024-03-20T23:40:19.533254046Z [2024-03-20 23:40:19,530: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:40:19.595266311Z [2024-03-20 23:40:19,592: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:40:19.711683601Z [2024-03-20 23:40:19,697: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:40:19.832995633Z [2024-03-20 23:40:19,828: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:40:20.046032772Z [2024-03-20 23:40:20,041: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:40:20.944719948Z [2024-03-20 23:40:20,936: INFO/ForkPoolWorker-3] Getting VIM list
2024-03-20T23:40:20.948855329Z [2024-03-20 23:40:20,948: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:21.021217851Z [2024-03-20 23:40:21,020: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-20T23:40:21.025283860Z [2024-03-20 23:40:21,025: INFO/ForkPoolWorker-3] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:21.025792728Z [2024-03-20 23:40:21,025: INFO/ForkPoolWorker-3] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:21.026033294Z [2024-03-20 23:40:21,025: INFO/ForkPoolWorker-3] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:21.026138706Z [2024-03-20 23:40:21,026: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-03-20T23:40:21.026443617Z [2024-03-20 23:40:21,026: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:40:21.026503633Z [2024-03-20 23:40:21,026: INFO/ForkPoolWorker-3] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:21.032997297Z [2024-03-20 23:40:21,032: WARNING/ForkPoolWorker-3] Dag 'vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:40:21.033756504Z [2024-03-20 23:40:21,033: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:40:21.034618529Z [2024-03-20 23:40:21,034: INFO/ForkPoolWorker-3] Getting VIM list
2024-03-20T23:40:21.042285319Z [2024-03-20 23:40:21,041: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:21.100617821Z [2024-03-20 23:40:21,100: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-20T23:40:21.104050117Z [2024-03-20 23:40:21,103: INFO/ForkPoolWorker-3] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:21.104101355Z [2024-03-20 23:40:21,103: INFO/ForkPoolWorker-3] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:21.104301445Z [2024-03-20 23:40:21,104: INFO/ForkPoolWorker-3] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:21.104433386Z [2024-03-20 23:40:21,104: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-03-20T23:40:21.104733003Z [2024-03-20 23:40:21,104: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:40:21.104868210Z [2024-03-20 23:40:21,104: INFO/ForkPoolWorker-3] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:21.108010269Z [2024-03-20 23:40:21,107: ERROR/ForkPoolWorker-3] [5aef0d33-a309-401d-9798-50146be2d576] Failed to execute task Dag 'vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d' could not be found; either it does not exist or it failed to parse..
2024-03-20T23:40:21.108023870Z Traceback (most recent call last):
2024-03-20T23:40:21.108027985Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-20T23:40:21.108031627Z     args.func(args)
2024-03-20T23:40:21.108035749Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-20T23:40:21.108039389Z     return func(*args, **kwargs)
2024-03-20T23:40:21.108042520Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-20T23:40:21.108045718Z     return f(*args, **kwargs)
2024-03-20T23:40:21.108049021Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-20T23:40:21.108052206Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-20T23:40:21.108055738Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-20T23:40:21.108059047Z     raise AirflowException(
2024-03-20T23:40:21.108062768Z airflow.exceptions.AirflowException: Dag 'vim_status_063ab749-b0aa-4df3-8345-4c59c0deef9d' could not be found; either it does not exist or it failed to parse.
2024-03-20T23:40:21.219479250Z [2024-03-20 23:40:21,214: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[5aef0d33-a309-401d-9798-50146be2d576] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 5aef0d33-a309-401d-9798-50146be2d576')
2024-03-20T23:40:21.219501530Z Traceback (most recent call last):
2024-03-20T23:40:21.219505749Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-20T23:40:21.219513244Z     R = retval = fun(*args, **kwargs)
2024-03-20T23:40:21.219516357Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-20T23:40:21.219519429Z     return self.run(*args, **kwargs)
2024-03-20T23:40:21.219522843Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-20T23:40:21.219526140Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-20T23:40:21.219529139Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-20T23:40:21.219533150Z     raise AirflowException(msg)
2024-03-20T23:40:21.219536657Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 5aef0d33-a309-401d-9798-50146be2d576
2024-03-20T23:40:21.228820129Z [2024-03-20 23:40:21,228: INFO/ForkPoolWorker-4] Getting VIM list
2024-03-20T23:40:21.243955479Z [2024-03-20 23:40:21,243: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:21.291928252Z [2024-03-20 23:40:21,291: INFO/ForkPoolWorker-4] Connected to database osm version 1.2
2024-03-20T23:40:21.301661581Z [2024-03-20 23:40:21,301: INFO/ForkPoolWorker-4] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:21.301706487Z [2024-03-20 23:40:21,301: INFO/ForkPoolWorker-4] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:21.301955368Z [2024-03-20 23:40:21,301: INFO/ForkPoolWorker-4] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:21.302114334Z [2024-03-20 23:40:21,301: INFO/ForkPoolWorker-4] Getting VIM list OK
2024-03-20T23:40:21.303020016Z [2024-03-20 23:40:21,302: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:40:21.303116379Z [2024-03-20 23:40:21,302: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:21.309261413Z [2024-03-20 23:40:21,309: WARNING/ForkPoolWorker-4] Dag 'vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:40:21.310049370Z [2024-03-20 23:40:21,309: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:40:21.311086960Z [2024-03-20 23:40:21,310: INFO/ForkPoolWorker-4] Getting VIM list
2024-03-20T23:40:21.313789904Z [2024-03-20 23:40:21,313: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:21.340990138Z [2024-03-20 23:40:21,340: INFO/ForkPoolWorker-4] Connected to database osm version 1.2
2024-03-20T23:40:21.344337771Z [2024-03-20 23:40:21,344: INFO/ForkPoolWorker-4] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:21.344420704Z [2024-03-20 23:40:21,344: INFO/ForkPoolWorker-4] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:21.344648087Z [2024-03-20 23:40:21,344: INFO/ForkPoolWorker-4] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:21.344780755Z [2024-03-20 23:40:21,344: INFO/ForkPoolWorker-4] Getting VIM list OK
2024-03-20T23:40:21.345451918Z [2024-03-20 23:40:21,345: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:40:21.345715287Z [2024-03-20 23:40:21,345: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:21.349120104Z [2024-03-20 23:40:21,348: ERROR/ForkPoolWorker-4] [224e8407-f2fa-48c1-925e-646377651e0f] Failed to execute task Dag 'vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d' could not be found; either it does not exist or it failed to parse..
2024-03-20T23:40:21.349130562Z Traceback (most recent call last):
2024-03-20T23:40:21.349134296Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-20T23:40:21.349138028Z     args.func(args)
2024-03-20T23:40:21.349141407Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-20T23:40:21.349145275Z     return func(*args, **kwargs)
2024-03-20T23:40:21.349148517Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-20T23:40:21.349165414Z     return f(*args, **kwargs)
2024-03-20T23:40:21.349168552Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-20T23:40:21.349172239Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-20T23:40:21.349175264Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-20T23:40:21.349178413Z     raise AirflowException(
2024-03-20T23:40:21.349181973Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d' could not be found; either it does not exist or it failed to parse.
2024-03-20T23:40:21.384170866Z [2024-03-20 23:40:21,383: ERROR/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[224e8407-f2fa-48c1-925e-646377651e0f] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 224e8407-f2fa-48c1-925e-646377651e0f')
2024-03-20T23:40:21.384188341Z Traceback (most recent call last):
2024-03-20T23:40:21.384192261Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-20T23:40:21.384195435Z     R = retval = fun(*args, **kwargs)
2024-03-20T23:40:21.384198568Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-20T23:40:21.384201888Z     return self.run(*args, **kwargs)
2024-03-20T23:40:21.384205467Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-20T23:40:21.384209472Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-20T23:40:21.384212527Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-20T23:40:21.384216101Z     raise AirflowException(msg)
2024-03-20T23:40:21.384219867Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 224e8407-f2fa-48c1-925e-646377651e0f
2024-03-20T23:40:21.391939547Z [2024-03-20 23:40:21,391: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-20T23:40:21.395275414Z [2024-03-20 23:40:21,394: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:21.411770191Z [2024-03-20 23:40:21,411: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-20T23:40:21.413061681Z [2024-03-20 23:40:21,412: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:21.413076101Z [2024-03-20 23:40:21,413: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:21.413198908Z [2024-03-20 23:40:21,413: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:21.413225234Z [2024-03-20 23:40:21,413: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-20T23:40:21.413444736Z [2024-03-20 23:40:21,413: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:40:21.413478284Z [2024-03-20 23:40:21,413: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:21.419708663Z [2024-03-20 23:40:21,419: WARNING/ForkPoolWorker-2] Dag 'vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:40:21.420537954Z [2024-03-20 23:40:21,419: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:40:21.421488547Z [2024-03-20 23:40:21,421: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-20T23:40:21.424200388Z [2024-03-20 23:40:21,423: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:21.436105113Z [2024-03-20 23:40:21,435: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-20T23:40:21.437721589Z [2024-03-20 23:40:21,437: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:21.437859826Z [2024-03-20 23:40:21,437: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:21.438060728Z [2024-03-20 23:40:21,437: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:21.438096312Z [2024-03-20 23:40:21,437: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-20T23:40:21.438451576Z [2024-03-20 23:40:21,438: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:40:21.438468019Z [2024-03-20 23:40:21,438: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:21.442955643Z [2024-03-20 23:40:21,442: ERROR/ForkPoolWorker-2] [fb70d7aa-f4a6-4165-b988-f3bcbfe6321f] Failed to execute task Dag 'vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d' could not be found; either it does not exist or it failed to parse..
2024-03-20T23:40:21.442975707Z Traceback (most recent call last):
2024-03-20T23:40:21.442981404Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-20T23:40:21.442987159Z     args.func(args)
2024-03-20T23:40:21.442992483Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-20T23:40:21.442998284Z     return func(*args, **kwargs)
2024-03-20T23:40:21.443003064Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-20T23:40:21.443007663Z     return f(*args, **kwargs)
2024-03-20T23:40:21.443012280Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-20T23:40:21.443016991Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-20T23:40:21.443021600Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-20T23:40:21.443026400Z     raise AirflowException(
2024-03-20T23:40:21.443031972Z airflow.exceptions.AirflowException: Dag 'vim_status_adb67b55-d8af-4988-ac97-e77af9a2ed0d' could not be found; either it does not exist or it failed to parse.
2024-03-20T23:40:21.447218259Z [2024-03-20 23:40:21,446: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-20T23:40:21.451379844Z [2024-03-20 23:40:21,450: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:21.484652048Z [2024-03-20 23:40:21,484: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-20T23:40:21.486086494Z [2024-03-20 23:40:21,485: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:21.486274469Z [2024-03-20 23:40:21,486: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:21.486521884Z [2024-03-20 23:40:21,486: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:21.486687483Z [2024-03-20 23:40:21,486: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-20T23:40:21.487138740Z [2024-03-20 23:40:21,486: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:40:21.487317056Z [2024-03-20 23:40:21,487: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:21.490026461Z [2024-03-20 23:40:21,489: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fb70d7aa-f4a6-4165-b988-f3bcbfe6321f] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fb70d7aa-f4a6-4165-b988-f3bcbfe6321f')
2024-03-20T23:40:21.490039378Z Traceback (most recent call last):
2024-03-20T23:40:21.490043299Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-20T23:40:21.490046682Z     R = retval = fun(*args, **kwargs)
2024-03-20T23:40:21.490049869Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-20T23:40:21.490053054Z     return self.run(*args, **kwargs)
2024-03-20T23:40:21.490056485Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-20T23:40:21.490059865Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-20T23:40:21.490062915Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-20T23:40:21.490066365Z     raise AirflowException(msg)
2024-03-20T23:40:21.490070078Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id fb70d7aa-f4a6-4165-b988-f3bcbfe6321f
2024-03-20T23:40:21.495208759Z [2024-03-20 23:40:21,495: WARNING/ForkPoolWorker-1] Dag 'vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:40:21.496087137Z [2024-03-20 23:40:21,495: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:40:21.496948876Z [2024-03-20 23:40:21,496: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-20T23:40:21.499593864Z [2024-03-20 23:40:21,499: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:21.510521103Z [2024-03-20 23:40:21,510: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-20T23:40:21.511565760Z [2024-03-20 23:40:21,511: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:21.511689210Z [2024-03-20 23:40:21,511: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:21.511929258Z [2024-03-20 23:40:21,511: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:21.511949935Z [2024-03-20 23:40:21,511: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-20T23:40:21.512171650Z [2024-03-20 23:40:21,512: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:40:21.512243576Z [2024-03-20 23:40:21,512: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:21.515404457Z [2024-03-20 23:40:21,514: ERROR/ForkPoolWorker-1] [e7b6b20e-baa8-4ce0-af19-bb9333491314] Failed to execute task Dag 'vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d' could not be found; either it does not exist or it failed to parse..
2024-03-20T23:40:21.515417710Z Traceback (most recent call last):
2024-03-20T23:40:21.515424303Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-20T23:40:21.515427922Z     args.func(args)
2024-03-20T23:40:21.515431101Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-20T23:40:21.515434467Z     return func(*args, **kwargs)
2024-03-20T23:40:21.515437439Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-20T23:40:21.515440487Z     return f(*args, **kwargs)
2024-03-20T23:40:21.515443387Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-20T23:40:21.515446376Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-20T23:40:21.515449297Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-20T23:40:21.515452142Z     raise AirflowException(
2024-03-20T23:40:21.515455980Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_063ab749-b0aa-4df3-8345-4c59c0deef9d' could not be found; either it does not exist or it failed to parse.
2024-03-20T23:40:21.542424953Z [2024-03-20 23:40:21,541: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e7b6b20e-baa8-4ce0-af19-bb9333491314] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e7b6b20e-baa8-4ce0-af19-bb9333491314')
2024-03-20T23:40:21.542445527Z Traceback (most recent call last):
2024-03-20T23:40:21.542451152Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-20T23:40:21.542455693Z     R = retval = fun(*args, **kwargs)
2024-03-20T23:40:21.542459838Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-20T23:40:21.542464362Z     return self.run(*args, **kwargs)
2024-03-20T23:40:21.542469059Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-20T23:40:21.542473842Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-20T23:40:21.542477934Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-20T23:40:21.542483038Z     raise AirflowException(msg)
2024-03-20T23:40:21.542488168Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e7b6b20e-baa8-4ce0-af19-bb9333491314
2024-03-20T23:40:21.619002046Z [2024-03-20 23:40:21,618: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:40:21.622642352Z [2024-03-20 23:40:21,622: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:21.647618488Z [2024-03-20 23:40:21,646: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:40:21.647647525Z [2024-03-20 23:40:21,647: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:21.647657824Z [2024-03-20 23:40:21,647: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:21.647667669Z [2024-03-20 23:40:21,647: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:21.647677886Z [2024-03-20 23:40:21,647: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:40:21.647751336Z [2024-03-20 23:40:21,647: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:40:21.647770951Z [2024-03-20 23:40:21,647: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:21.655857036Z [2024-03-20 23:40:21,655: WARNING/ForkPoolWorker-16] Dag 'vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:40:21.656449370Z [2024-03-20 23:40:21,655: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:40:21.657554455Z [2024-03-20 23:40:21,657: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:40:21.660099716Z [2024-03-20 23:40:21,659: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:40:21.674647801Z [2024-03-20 23:40:21,674: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:40:21.675886370Z [2024-03-20 23:40:21,675: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:40:21.675927457Z [2024-03-20 23:40:21,675: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:40:21.676387649Z [2024-03-20 23:40:21,675: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:40:21.676547571Z [2024-03-20 23:40:21,676: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:40:21.677341541Z [2024-03-20 23:40:21,677: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:40:21.677350852Z [2024-03-20 23:40:21,677: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:40:21.680977924Z [2024-03-20 23:40:21,680: ERROR/ForkPoolWorker-16] [630c5e78-009b-4dc4-aa4f-5ab13d8a891e] Failed to execute task Dag 'vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d' could not be found; either it does not exist or it failed to parse..
2024-03-20T23:40:21.680992843Z Traceback (most recent call last):
2024-03-20T23:40:21.680996998Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-20T23:40:21.681014298Z     args.func(args)
2024-03-20T23:40:21.681017973Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-20T23:40:21.681021912Z     return func(*args, **kwargs)
2024-03-20T23:40:21.681024941Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-20T23:40:21.681027882Z     return f(*args, **kwargs)
2024-03-20T23:40:21.681030857Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-20T23:40:21.681033949Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-20T23:40:21.681036929Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-20T23:40:21.681039859Z     raise AirflowException(
2024-03-20T23:40:21.681043620Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_adb67b55-d8af-4988-ac97-e77af9a2ed0d' could not be found; either it does not exist or it failed to parse.
2024-03-20T23:40:21.725076358Z [2024-03-20 23:40:21,724: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[630c5e78-009b-4dc4-aa4f-5ab13d8a891e] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 630c5e78-009b-4dc4-aa4f-5ab13d8a891e')
2024-03-20T23:40:21.725102545Z Traceback (most recent call last):
2024-03-20T23:40:21.725109785Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-20T23:40:21.725115570Z     R = retval = fun(*args, **kwargs)
2024-03-20T23:40:21.725121610Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-20T23:40:21.725127454Z     return self.run(*args, **kwargs)
2024-03-20T23:40:21.725134661Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-20T23:40:21.725141504Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-20T23:40:21.725147615Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-20T23:40:21.725154352Z     raise AirflowException(msg)
2024-03-20T23:40:21.725161178Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 630c5e78-009b-4dc4-aa4f-5ab13d8a891e
2024-03-20T23:41:00.473107838Z [2024-03-20 23:41:00,472: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36f17b8d-611d-433f-9008-2e2727f2c872] received
2024-03-20T23:41:00.475510403Z [2024-03-20 23:41:00,475: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e05d0b25-90bf-4bcd-8ce4-f1ff02d0f51e] received
2024-03-20T23:41:00.480618419Z [2024-03-20 23:41:00,480: INFO/ForkPoolWorker-15] [36f17b8d-611d-433f-9008-2e2727f2c872] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-20T23:41:00.482309242Z [2024-03-20 23:41:00,482: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b504788-6abe-4dbe-bffd-969fcaa30f27] received
2024-03-20T23:41:00.482327370Z [2024-03-20 23:41:00,482: INFO/ForkPoolWorker-16] [e05d0b25-90bf-4bcd-8ce4-f1ff02d0f51e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:41:00.491067951Z [2024-03-20 23:41:00,490: INFO/ForkPoolWorker-1] [4b504788-6abe-4dbe-bffd-969fcaa30f27] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:41:00.785479153Z [2024-03-20 23:41:00,781: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:41:00.788276249Z [2024-03-20 23:41:00,784: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-20T23:41:00.941861656Z [2024-03-20 23:41:00,937: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:41:00.968821754Z [2024-03-20 23:41:00,968: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-20T23:41:00.972892152Z [2024-03-20 23:41:00,972: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:41:00.997060959Z [2024-03-20 23:41:00,996: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:41:01.008484970Z [2024-03-20 23:41:01,008: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-20T23:41:01.008715722Z [2024-03-20 23:41:01,008: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-20T23:41:01.009009322Z [2024-03-20 23:41:01,008: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-20T23:41:01.009689607Z [2024-03-20 23:41:01,009: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-20T23:41:01.130141405Z [2024-03-20 23:41:01,129: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-20T23:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:41:01.780870888Z [2024-03-20 23:41:01,780: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[36f17b8d-611d-433f-9008-2e2727f2c872] succeeded in 1.3064118780000626s: None
2024-03-20T23:41:02.010248165Z [2024-03-20 23:41:02,009: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:41:02.014035381Z [2024-03-20 23:41:02,013: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:41:02.039759459Z [2024-03-20 23:41:02,039: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:41:02.042041998Z [2024-03-20 23:41:02,041: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:41:02.042420061Z [2024-03-20 23:41:02,042: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:41:02.042741358Z [2024-03-20 23:41:02,042: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:41:02.042956992Z [2024-03-20 23:41:02,042: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:41:02.046026017Z [2024-03-20 23:41:02,045: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:41:02.046146522Z [2024-03-20 23:41:02,045: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:41:02.146799918Z [2024-03-20 23:41:02,146: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-20T23:41:02.150459297Z [2024-03-20 23:41:02,149: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:41:02.173625401Z [2024-03-20 23:41:02,173: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-20T23:41:02.175195581Z [2024-03-20 23:41:02,174: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:41:02.175211522Z [2024-03-20 23:41:02,175: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:41:02.175467825Z [2024-03-20 23:41:02,175: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:41:02.175637943Z [2024-03-20 23:41:02,175: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-20T23:41:02.176068309Z [2024-03-20 23:41:02,175: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:41:02.176146735Z [2024-03-20 23:41:02,176: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:41:02.184138088Z [2024-03-20 23:41:02,183: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:41:02.358184435Z [2024-03-20 23:41:02,357: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:41:04.209705924Z [2024-03-20 23:41:04,209: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e05d0b25-90bf-4bcd-8ce4-f1ff02d0f51e] succeeded in 3.7331445349998376s: None
2024-03-20T23:41:04.457377258Z [2024-03-20 23:41:04,456: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4b504788-6abe-4dbe-bffd-969fcaa30f27] succeeded in 3.973295854000071s: None
2024-03-20T23:42:00.612998301Z [2024-03-20 23:42:00,612: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92d0c961-873b-4304-b0e6-95f4c0b25328] received
2024-03-20T23:42:00.617047440Z [2024-03-20 23:42:00,616: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7572e143-1d10-4b2d-9dca-7c330be2083a] received
2024-03-20T23:42:00.625178384Z [2024-03-20 23:42:00,624: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4b375e4-7fe2-411f-8dd5-8dc466fa4e7b] received
2024-03-20T23:42:00.627765472Z [2024-03-20 23:42:00,627: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77d5e62a-ed75-47c8-ad69-c611ce1c2a81] received
2024-03-20T23:42:00.632649502Z [2024-03-20 23:42:00,628: INFO/ForkPoolWorker-15] [92d0c961-873b-4304-b0e6-95f4c0b25328] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-20T23:42:00.638977861Z [2024-03-20 23:42:00,638: INFO/ForkPoolWorker-16] [7572e143-1d10-4b2d-9dca-7c330be2083a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:42:00.642622431Z [2024-03-20 23:42:00,642: INFO/ForkPoolWorker-2] [77d5e62a-ed75-47c8-ad69-c611ce1c2a81] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:42:00.654328407Z [2024-03-20 23:42:00,654: INFO/ForkPoolWorker-1] [a4b375e4-7fe2-411f-8dd5-8dc466fa4e7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-20T23:42:00.986844738Z [2024-03-20 23:42:00,983: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:42:01.022067495Z [2024-03-20 23:42:01,018: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:42:01.027516343Z [2024-03-20 23:42:01,023: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-20T23:42:01.029056846Z [2024-03-20 23:42:01,025: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-20T23:42:01.368612461Z [2024-03-20 23:42:01,368: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-20T23:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:42:01.379866736Z [2024-03-20 23:42:01,377: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-20T23:42:01.386896340Z [2024-03-20 23:42:01,384: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:42:01.433846169Z [2024-03-20 23:42:01,433: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:42:01.437303577Z [2024-03-20 23:42:01,435: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-20T23:42:01.437322665Z [2024-03-20 23:42:01,436: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-20T23:42:01.437326606Z [2024-03-20 23:42:01,436: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-20T23:42:01.437329730Z [2024-03-20 23:42:01,436: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-20T23:42:01.607367365Z [2024-03-20 23:42:01,606: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-20T23:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:42:02.013814389Z [2024-03-20 23:42:02,013: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a4b375e4-7fe2-411f-8dd5-8dc466fa4e7b] succeeded in 1.3853214210000715s: None
2024-03-20T23:42:02.413628496Z [2024-03-20 23:42:02,413: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[92d0c961-873b-4304-b0e6-95f4c0b25328] succeeded in 1.7979118460000336s: None
2024-03-20T23:42:02.702802861Z [2024-03-20 23:42:02,702: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-20T23:42:02.706441214Z [2024-03-20 23:42:02,705: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:42:02.725721668Z [2024-03-20 23:42:02,725: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-20T23:42:02.727314491Z [2024-03-20 23:42:02,727: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:42:02.727327446Z [2024-03-20 23:42:02,727: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:42:02.727498034Z [2024-03-20 23:42:02,727: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:42:02.727542935Z [2024-03-20 23:42:02,727: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-20T23:42:02.727913436Z [2024-03-20 23:42:02,727: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:42:02.727991895Z [2024-03-20 23:42:02,727: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:42:02.822303920Z [2024-03-20 23:42:02,822: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:42:02.933183377Z [2024-03-20 23:42:02,932: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:42:02.937199419Z [2024-03-20 23:42:02,936: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:42:02.965009478Z [2024-03-20 23:42:02,964: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:42:02.967578295Z [2024-03-20 23:42:02,967: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:42:02.968286696Z [2024-03-20 23:42:02,968: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:42:02.968705656Z [2024-03-20 23:42:02,968: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:42:02.968946780Z [2024-03-20 23:42:02,968: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:42:02.969671051Z [2024-03-20 23:42:02,969: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:42:02.969927925Z [2024-03-20 23:42:02,969: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:42:03.102104754Z [2024-03-20 23:42:03,101: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:42:04.671826221Z [2024-03-20 23:42:04,670: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[77d5e62a-ed75-47c8-ad69-c611ce1c2a81] succeeded in 4.03956250400006s: None
2024-03-20T23:42:05.194111970Z [2024-03-20 23:42:05,193: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7572e143-1d10-4b2d-9dca-7c330be2083a] succeeded in 4.574775788999887s: None
2024-03-20T23:43:00.498216281Z [2024-03-20 23:43:00,497: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2850f0c-566d-472a-8f54-16470e175562] received
2024-03-20T23:43:00.506797153Z [2024-03-20 23:43:00,505: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33315ac9-633a-4794-b9a0-214be747ec17] received
2024-03-20T23:43:00.509310736Z [2024-03-20 23:43:00,509: INFO/ForkPoolWorker-15] [f2850f0c-566d-472a-8f54-16470e175562] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:43:00.518695850Z [2024-03-20 23:43:00,518: INFO/ForkPoolWorker-16] [33315ac9-633a-4794-b9a0-214be747ec17] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:43:00.535330009Z [2024-03-20 23:43:00,535: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20018f61-695b-4b41-a189-f2941d83f09e] received
2024-03-20T23:43:00.547324903Z [2024-03-20 23:43:00,546: INFO/ForkPoolWorker-1] [20018f61-695b-4b41-a189-f2941d83f09e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-20T23:43:00.955326562Z [2024-03-20 23:43:00,952: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-20T23:43:01.097814349Z [2024-03-20 23:43:01,094: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:43:01.197471113Z [2024-03-20 23:43:01,194: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:43:01.387065161Z [2024-03-20 23:43:01,386: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-20T23:43:01.397542171Z [2024-03-20 23:43:01,397: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:43:01.614752750Z [2024-03-20 23:43:01,614: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-20T23:43:01.617138143Z [2024-03-20 23:43:01,616: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-20T23:43:01.617345494Z [2024-03-20 23:43:01,617: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-20T23:43:01.617593259Z [2024-03-20 23:43:01,617: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-20T23:43:01.617978833Z [2024-03-20 23:43:01,617: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-20T23:43:01.758081407Z [2024-03-20 23:43:01,757: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-20T23:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:43:03.273449761Z [2024-03-20 23:43:03,273: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[20018f61-695b-4b41-a189-f2941d83f09e] succeeded in 2.735442138000053s: None
2024-03-20T23:43:03.375439746Z [2024-03-20 23:43:03,375: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:43:03.378867362Z [2024-03-20 23:43:03,378: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:43:03.398343216Z [2024-03-20 23:43:03,398: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:43:03.399377567Z [2024-03-20 23:43:03,399: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:43:03.399420162Z [2024-03-20 23:43:03,399: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:43:03.399539398Z [2024-03-20 23:43:03,399: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:43:03.399571718Z [2024-03-20 23:43:03,399: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:43:03.400195913Z [2024-03-20 23:43:03,400: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:43:03.400230032Z [2024-03-20 23:43:03,400: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:43:03.505695505Z [2024-03-20 23:43:03,505: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:43:03.699414500Z [2024-03-20 23:43:03,699: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:43:03.703152876Z [2024-03-20 23:43:03,702: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:43:03.752247243Z [2024-03-20 23:43:03,751: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:43:03.757822062Z [2024-03-20 23:43:03,757: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:43:03.758075019Z [2024-03-20 23:43:03,757: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:43:03.758458411Z [2024-03-20 23:43:03,758: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:43:03.758645288Z [2024-03-20 23:43:03,758: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:43:03.759035762Z [2024-03-20 23:43:03,758: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:43:03.759448876Z [2024-03-20 23:43:03,758: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:43:03.883661099Z [2024-03-20 23:43:03,883: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:43:06.179396859Z [2024-03-20 23:43:06,178: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f2850f0c-566d-472a-8f54-16470e175562] succeeded in 5.677764853000099s: None
2024-03-20T23:43:06.316213402Z [2024-03-20 23:43:06,315: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[33315ac9-633a-4794-b9a0-214be747ec17] succeeded in 5.805861752000055s: None
2024-03-20T23:44:00.307930119Z [2024-03-20 23:44:00,307: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd1bb7f3-a7ba-4021-ad70-3dc84db284f4] received
2024-03-20T23:44:00.311485777Z [2024-03-20 23:44:00,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7409078d-b665-4933-9fa7-d4df16981bad] received
2024-03-20T23:44:00.322873207Z [2024-03-20 23:44:00,322: INFO/ForkPoolWorker-16] [7409078d-b665-4933-9fa7-d4df16981bad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:44:00.322982560Z [2024-03-20 23:44:00,322: INFO/ForkPoolWorker-15] [bd1bb7f3-a7ba-4021-ad70-3dc84db284f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-20T23:44:00.324139968Z [2024-03-20 23:44:00,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bbe3c5d7-8c70-4571-b92b-fa3bc9c09ecd] received
2024-03-20T23:44:00.345329459Z [2024-03-20 23:44:00,344: INFO/ForkPoolWorker-1] [bbe3c5d7-8c70-4571-b92b-fa3bc9c09ecd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-20T23:44:00.349980148Z [2024-03-20 23:44:00,349: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[631e38c6-aabe-4e29-83e3-fda3edc4e3e4] received
2024-03-20T23:44:00.361166469Z [2024-03-20 23:44:00,360: INFO/ForkPoolWorker-2] [631e38c6-aabe-4e29-83e3-fda3edc4e3e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:44:00.664333592Z [2024-03-20 23:44:00,661: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-20T23:44:00.664603089Z [2024-03-20 23:44:00,660: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-20T23:44:00.670129566Z [2024-03-20 23:44:00,666: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:44:00.678214466Z [2024-03-20 23:44:00,673: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:44:00.881896938Z [2024-03-20 23:44:00,881: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-20T23:44:00.888441475Z [2024-03-20 23:44:00,887: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:44:00.923096958Z [2024-03-20 23:44:00,922: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-20T23:44:00.924501074Z [2024-03-20 23:44:00,924: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-20T23:44:00.924669712Z [2024-03-20 23:44:00,924: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-20T23:44:00.924735885Z [2024-03-20 23:44:00,924: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-20T23:44:00.924934882Z [2024-03-20 23:44:00,924: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-20T23:44:01.005621395Z [2024-03-20 23:44:01,005: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-20T23:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:44:01.089621809Z [2024-03-20 23:44:01,089: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-20T23:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:44:01.677896196Z [2024-03-20 23:44:01,677: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bbe3c5d7-8c70-4571-b92b-fa3bc9c09ecd] succeeded in 1.3486601730000984s: None
2024-03-20T23:44:01.721396691Z [2024-03-20 23:44:01,720: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bd1bb7f3-a7ba-4021-ad70-3dc84db284f4] succeeded in 1.4078784130001623s: None
2024-03-20T23:44:02.058334735Z [2024-03-20 23:44:02,057: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-20T23:44:02.061888974Z [2024-03-20 23:44:02,061: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:44:02.087875239Z [2024-03-20 23:44:02,087: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-20T23:44:02.089370504Z [2024-03-20 23:44:02,089: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:44:02.089418188Z [2024-03-20 23:44:02,089: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:44:02.089573955Z [2024-03-20 23:44:02,089: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:44:02.089632393Z [2024-03-20 23:44:02,089: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-20T23:44:02.089998211Z [2024-03-20 23:44:02,089: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:44:02.090011797Z [2024-03-20 23:44:02,089: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:44:02.103134204Z [2024-03-20 23:44:02,102: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:44:02.107001660Z [2024-03-20 23:44:02,106: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:44:02.124702302Z [2024-03-20 23:44:02,124: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:44:02.126224524Z [2024-03-20 23:44:02,125: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:44:02.126241564Z [2024-03-20 23:44:02,126: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:44:02.126434917Z [2024-03-20 23:44:02,126: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:44:02.126564341Z [2024-03-20 23:44:02,126: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:44:02.126968594Z [2024-03-20 23:44:02,126: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:44:02.127464809Z [2024-03-20 23:44:02,126: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:44:02.194728059Z [2024-03-20 23:44:02,194: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:44:02.261079570Z [2024-03-20 23:44:02,260: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:44:03.922778161Z [2024-03-20 23:44:03,922: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[631e38c6-aabe-4e29-83e3-fda3edc4e3e4] succeeded in 3.5705134940001244s: None
2024-03-20T23:44:04.488833343Z [2024-03-20 23:44:04,488: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7409078d-b665-4933-9fa7-d4df16981bad] succeeded in 4.174348320999798s: None
2024-03-20T23:45:00.263242501Z [2024-03-20 23:45:00,262: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8c74d84-9b60-4058-9e6d-9de88d65bdd9] received
2024-03-20T23:45:00.271365135Z [2024-03-20 23:45:00,270: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2a08a20-c2ef-4fea-8eda-02695cb0da87] received
2024-03-20T23:45:00.273641135Z [2024-03-20 23:45:00,273: INFO/ForkPoolWorker-15] [d8c74d84-9b60-4058-9e6d-9de88d65bdd9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:45:00.288818119Z [2024-03-20 23:45:00,288: INFO/ForkPoolWorker-16] [b2a08a20-c2ef-4fea-8eda-02695cb0da87] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:45:00.290529347Z [2024-03-20 23:45:00,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[191664dc-eb2d-41c2-bc8d-025af96090d9] received
2024-03-20T23:45:00.295390663Z [2024-03-20 23:45:00,295: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8aad18f9-3c58-454d-bc11-1a0ec0c107ae] received
2024-03-20T23:45:00.306686984Z [2024-03-20 23:45:00,306: INFO/ForkPoolWorker-1] [191664dc-eb2d-41c2-bc8d-025af96090d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:45:00.313083882Z [2024-03-20 23:45:00,312: INFO/ForkPoolWorker-2] [8aad18f9-3c58-454d-bc11-1a0ec0c107ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-20T23:45:00.654329203Z [2024-03-20 23:45:00,646: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:45:00.660283440Z [2024-03-20 23:45:00,650: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:45:00.727924464Z [2024-03-20 23:45:00,723: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-20T23:45:00.748396421Z [2024-03-20 23:45:00,745: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:45:00.907492948Z [2024-03-20 23:45:00,907: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-20T23:45:00.911504679Z [2024-03-20 23:45:00,911: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:45:00.946138976Z [2024-03-20 23:45:00,945: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-20T23:45:00.947029962Z [2024-03-20 23:45:00,946: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-20T23:45:00.947103618Z [2024-03-20 23:45:00,946: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-20T23:45:00.947178998Z [2024-03-20 23:45:00,947: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-20T23:45:00.947384267Z [2024-03-20 23:45:00,947: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-20T23:45:01.057381685Z [2024-03-20 23:45:01,057: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-20T23:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:45:01.695937766Z [2024-03-20 23:45:01,695: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8aad18f9-3c58-454d-bc11-1a0ec0c107ae] succeeded in 1.394922766000036s: None
2024-03-20T23:45:01.937557616Z [2024-03-20 23:45:01,937: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:45:01.941184675Z [2024-03-20 23:45:01,940: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:45:01.982524155Z [2024-03-20 23:45:01,982: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:45:01.984260859Z [2024-03-20 23:45:01,983: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:45:01.984277738Z [2024-03-20 23:45:01,984: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:45:01.984554347Z [2024-03-20 23:45:01,984: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:45:01.984658319Z [2024-03-20 23:45:01,984: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:45:01.985017060Z [2024-03-20 23:45:01,984: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:45:01.985146386Z [2024-03-20 23:45:01,984: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:45:02.102418842Z [2024-03-20 23:45:02,102: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-20T23:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:45:02.119039806Z [2024-03-20 23:45:02,118: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:45:02.122990332Z [2024-03-20 23:45:02,122: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:45:02.160533181Z [2024-03-20 23:45:02,160: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:45:02.163258789Z [2024-03-20 23:45:02,162: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:45:02.163489240Z [2024-03-20 23:45:02,163: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:45:02.163875704Z [2024-03-20 23:45:02,163: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:45:02.164230476Z [2024-03-20 23:45:02,163: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:45:02.164912721Z [2024-03-20 23:45:02,164: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:45:02.165115601Z [2024-03-20 23:45:02,164: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:45:02.356659333Z [2024-03-20 23:45:02,351: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:45:02.645219897Z [2024-03-20 23:45:02,644: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-20T23:45:02.648802820Z [2024-03-20 23:45:02,648: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:45:02.680719643Z [2024-03-20 23:45:02,680: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-20T23:45:02.685778189Z [2024-03-20 23:45:02,685: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:45:02.685904077Z [2024-03-20 23:45:02,685: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:45:02.686121175Z [2024-03-20 23:45:02,685: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:45:02.686242208Z [2024-03-20 23:45:02,686: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-20T23:45:02.689343965Z [2024-03-20 23:45:02,686: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:45:02.689626412Z [2024-03-20 23:45:02,689: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:45:02.849008864Z [2024-03-20 23:45:02,848: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:45:02.964579654Z [2024-03-20 23:45:02,964: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d8c74d84-9b60-4058-9e6d-9de88d65bdd9] succeeded in 2.6990848969999206s: None
2024-03-20T23:45:03.035725853Z [2024-03-20 23:45:03,035: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[357ad5e6-48e0-4bc6-bc45-bf0f1fa7ad1c] received
2024-03-20T23:45:03.047297516Z [2024-03-20 23:45:03,046: INFO/ForkPoolWorker-15] [357ad5e6-48e0-4bc6-bc45-bf0f1fa7ad1c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-20T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:45:03.406888964Z [2024-03-20 23:45:03,403: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:45:03.952794943Z [2024-03-20 23:45:03,952: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b2a08a20-c2ef-4fea-8eda-02695cb0da87] succeeded in 3.6747392099998706s: None
2024-03-20T23:45:04.558148510Z [2024-03-20 23:45:04,556: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:45:04.562046953Z [2024-03-20 23:45:04,561: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:45:04.583423809Z [2024-03-20 23:45:04,582: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:45:04.584864620Z [2024-03-20 23:45:04,584: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:45:04.584928790Z [2024-03-20 23:45:04,584: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:45:04.585070728Z [2024-03-20 23:45:04,584: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:45:04.585155521Z [2024-03-20 23:45:04,585: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:45:04.585507761Z [2024-03-20 23:45:04,585: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:45:04.585534173Z [2024-03-20 23:45:04,585: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:45:04.684432030Z [2024-03-20 23:45:04,682: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-20T23:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:45:05.352783208Z [2024-03-20 23:45:05,352: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[357ad5e6-48e0-4bc6-bc45-bf0f1fa7ad1c] succeeded in 2.3145384100000683s: None
2024-03-20T23:45:05.463783207Z [2024-03-20 23:45:05,463: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[191664dc-eb2d-41c2-bc8d-025af96090d9] succeeded in 5.17109074200016s: None
2024-03-20T23:45:05.500708804Z [2024-03-20 23:45:05,500: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35762111-1395-485c-8277-aa919b3d8cfe] received
2024-03-20T23:45:05.515484767Z [2024-03-20 23:45:05,515: INFO/ForkPoolWorker-15] [35762111-1395-485c-8277-aa919b3d8cfe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-20T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-20T23:45:05.802835515Z [2024-03-20 23:45:05,799: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:45:06.943769103Z [2024-03-20 23:45:06,943: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:45:06.947358409Z [2024-03-20 23:45:06,946: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:45:06.965545351Z [2024-03-20 23:45:06,965: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:45:06.966686464Z [2024-03-20 23:45:06,966: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:45:06.966704106Z [2024-03-20 23:45:06,966: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:45:06.967042324Z [2024-03-20 23:45:06,966: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:45:06.967057038Z [2024-03-20 23:45:06,966: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:45:06.967350518Z [2024-03-20 23:45:06,967: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:45:06.967412835Z [2024-03-20 23:45:06,967: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:45:07.054463734Z [2024-03-20 23:45:07,054: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-20T23:40:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:45:07.627744074Z [2024-03-20 23:45:07,627: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[35762111-1395-485c-8277-aa919b3d8cfe] succeeded in 2.124233641000046s: None
2024-03-20T23:45:07.791600525Z [2024-03-20 23:45:07,791: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92a9dc7d-ca83-4e0e-9699-3f913941a4a3] received
2024-03-20T23:45:07.800118056Z [2024-03-20 23:45:07,799: INFO/ForkPoolWorker-15] [92a9dc7d-ca83-4e0e-9699-3f913941a4a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-20T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:45:08.118474638Z [2024-03-20 23:45:08,115: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:45:09.476964904Z [2024-03-20 23:45:09,476: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:45:09.480617096Z [2024-03-20 23:45:09,480: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:45:09.500361914Z [2024-03-20 23:45:09,500: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:45:09.501698025Z [2024-03-20 23:45:09,501: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:45:09.501834061Z [2024-03-20 23:45:09,501: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:45:09.501972251Z [2024-03-20 23:45:09,501: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:45:09.502091805Z [2024-03-20 23:45:09,501: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:45:09.502368279Z [2024-03-20 23:45:09,502: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:45:09.502445196Z [2024-03-20 23:45:09,502: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:45:09.589595567Z [2024-03-20 23:45:09,589: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-20T23:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:45:10.185588349Z [2024-03-20 23:45:10,185: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[92a9dc7d-ca83-4e0e-9699-3f913941a4a3] succeeded in 2.3908478079999895s: None
2024-03-20T23:46:01.217815574Z [2024-03-20 23:46:01,216: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8545075-8a4c-4efc-9d79-8e021b9ff082] received
2024-03-20T23:46:01.229121438Z [2024-03-20 23:46:01,228: INFO/ForkPoolWorker-15] [b8545075-8a4c-4efc-9d79-8e021b9ff082] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-20T23:46:01.230921342Z [2024-03-20 23:46:01,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73d6e977-a1d5-4ed5-ad56-d3b7c21645df] received
2024-03-20T23:46:01.232893069Z [2024-03-20 23:46:01,232: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9b25c26-6b49-45b1-b4a0-f325b9a02e96] received
2024-03-20T23:46:01.234820162Z [2024-03-20 23:46:01,234: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[553cdf07-6304-4d5d-b355-110f8c01e3c8] received
2024-03-20T23:46:01.243547441Z [2024-03-20 23:46:01,243: INFO/ForkPoolWorker-1] [f9b25c26-6b49-45b1-b4a0-f325b9a02e96] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:46:01.243567027Z [2024-03-20 23:46:01,243: INFO/ForkPoolWorker-16] [73d6e977-a1d5-4ed5-ad56-d3b7c21645df] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-20T23:46:01.245891771Z [2024-03-20 23:46:01,245: INFO/ForkPoolWorker-2] [553cdf07-6304-4d5d-b355-110f8c01e3c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:46:01.557670953Z [2024-03-20 23:46:01,554: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-20T23:46:01.557928370Z [2024-03-20 23:46:01,554: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-20T23:46:01.660743571Z [2024-03-20 23:46:01,657: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:46:01.766258111Z [2024-03-20 23:46:01,764: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-20T23:46:01.770895778Z [2024-03-20 23:46:01,770: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:46:01.803805050Z [2024-03-20 23:46:01,803: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:46:01.805521248Z [2024-03-20 23:46:01,805: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-20T23:46:01.805826258Z [2024-03-20 23:46:01,805: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-20T23:46:01.806006744Z [2024-03-20 23:46:01,805: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-20T23:46:01.807447114Z [2024-03-20 23:46:01,807: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-20T23:46:01.829119042Z [2024-03-20 23:46:01,828: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-20T23:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:46:01.899790456Z [2024-03-20 23:46:01,896: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:46:01.945434387Z [2024-03-20 23:46:01,945: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-20T23:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:46:02.633373817Z [2024-03-20 23:46:02,632: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b8545075-8a4c-4efc-9d79-8e021b9ff082] succeeded in 1.4134041150000485s: None
2024-03-20T23:46:02.729101165Z [2024-03-20 23:46:02,728: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[73d6e977-a1d5-4ed5-ad56-d3b7c21645df] succeeded in 1.496089715999915s: None
2024-03-20T23:46:03.234484453Z [2024-03-20 23:46:03,234: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-20T23:46:03.237992987Z [2024-03-20 23:46:03,237: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:46:03.261181058Z [2024-03-20 23:46:03,260: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-20T23:46:03.263177976Z [2024-03-20 23:46:03,262: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:46:03.263230336Z [2024-03-20 23:46:03,263: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:46:03.263419205Z [2024-03-20 23:46:03,263: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:46:03.263454629Z [2024-03-20 23:46:03,263: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-20T23:46:03.263817194Z [2024-03-20 23:46:03,263: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:46:03.263835558Z [2024-03-20 23:46:03,263: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:46:03.352381618Z [2024-03-20 23:46:03,351: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-20T23:46:03.355321962Z [2024-03-20 23:46:03,354: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:46:03.355745353Z [2024-03-20 23:46:03,355: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:46:03.384130311Z [2024-03-20 23:46:03,383: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-20T23:46:03.385812153Z [2024-03-20 23:46:03,385: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:46:03.385849135Z [2024-03-20 23:46:03,385: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:46:03.386227671Z [2024-03-20 23:46:03,385: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:46:03.386435104Z [2024-03-20 23:46:03,386: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-20T23:46:03.386760977Z [2024-03-20 23:46:03,386: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:46:03.386780798Z [2024-03-20 23:46:03,386: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:46:03.502258629Z [2024-03-20 23:46:03,501: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:46:05.050663509Z [2024-03-20 23:46:05,050: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[553cdf07-6304-4d5d-b355-110f8c01e3c8] succeeded in 3.8142120469999554s: None
2024-03-20T23:46:06.924650747Z [2024-03-20 23:46:06,924: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f9b25c26-6b49-45b1-b4a0-f325b9a02e96] succeeded in 5.689748396000141s: None
2024-03-20T23:47:00.922971166Z [2024-03-20 23:47:00,922: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b44f221a-0e3d-491e-9649-2e1b0155f636] received
2024-03-20T23:47:00.929225587Z [2024-03-20 23:47:00,928: INFO/ForkPoolWorker-15] [b44f221a-0e3d-491e-9649-2e1b0155f636] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:47:00.937401041Z [2024-03-20 23:47:00,937: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c05017d4-f3e2-4ae5-b507-abac64ef58f0] received
2024-03-20T23:47:00.940127388Z [2024-03-20 23:47:00,939: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df4dcf17-7d4e-4378-bfaf-4d00e1724b4e] received
2024-03-20T23:47:00.946035362Z [2024-03-20 23:47:00,945: INFO/ForkPoolWorker-1] [df4dcf17-7d4e-4378-bfaf-4d00e1724b4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:47:00.953163105Z [2024-03-20 23:47:00,952: INFO/ForkPoolWorker-16] [c05017d4-f3e2-4ae5-b507-abac64ef58f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-20T23:47:01.251964087Z [2024-03-20 23:47:01,247: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:47:01.258967300Z [2024-03-20 23:47:01,255: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:47:01.285588818Z [2024-03-20 23:47:01,282: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-20T23:47:01.456086052Z [2024-03-20 23:47:01,455: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-20T23:47:01.460654589Z [2024-03-20 23:47:01,460: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:47:01.492832446Z [2024-03-20 23:47:01,492: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:47:01.494057182Z [2024-03-20 23:47:01,493: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-20T23:47:01.494152788Z [2024-03-20 23:47:01,494: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-20T23:47:01.494233476Z [2024-03-20 23:47:01,494: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-20T23:47:01.494473433Z [2024-03-20 23:47:01,494: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-20T23:47:01.596407547Z [2024-03-20 23:47:01,595: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-20T23:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:47:02.476948525Z [2024-03-20 23:47:02,476: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c05017d4-f3e2-4ae5-b507-abac64ef58f0] succeeded in 1.5380965990000277s: None
2024-03-20T23:47:02.639284117Z [2024-03-20 23:47:02,638: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-20T23:47:02.643071164Z [2024-03-20 23:47:02,642: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:47:02.670210957Z [2024-03-20 23:47:02,669: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-20T23:47:02.671639432Z [2024-03-20 23:47:02,671: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:47:02.671677053Z [2024-03-20 23:47:02,671: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:47:02.671821483Z [2024-03-20 23:47:02,671: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:47:02.671860035Z [2024-03-20 23:47:02,671: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-20T23:47:02.672230482Z [2024-03-20 23:47:02,672: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:47:02.672406568Z [2024-03-20 23:47:02,672: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:47:02.734643789Z [2024-03-20 23:47:02,734: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:47:02.738686659Z [2024-03-20 23:47:02,738: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:47:02.764821982Z [2024-03-20 23:47:02,764: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:47:02.766597594Z [2024-03-20 23:47:02,766: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:47:02.766807929Z [2024-03-20 23:47:02,766: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:47:02.767129097Z [2024-03-20 23:47:02,766: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:47:02.767248078Z [2024-03-20 23:47:02,767: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:47:02.767617969Z [2024-03-20 23:47:02,767: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:47:02.767753045Z [2024-03-20 23:47:02,767: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:47:02.782258566Z [2024-03-20 23:47:02,781: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:47:02.877378463Z [2024-03-20 23:47:02,876: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:47:04.384037194Z [2024-03-20 23:47:04,383: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[df4dcf17-7d4e-4378-bfaf-4d00e1724b4e] succeeded in 3.441983444000016s: None
2024-03-20T23:47:05.621428267Z [2024-03-20 23:47:05,621: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b44f221a-0e3d-491e-9649-2e1b0155f636] succeeded in 4.696951213000148s: None
2024-03-20T23:48:00.953050448Z [2024-03-20 23:48:00,952: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44d88dd3-5583-4fcc-a254-5ed6ca8de537] received
2024-03-20T23:48:00.965153923Z [2024-03-20 23:48:00,964: INFO/ForkPoolWorker-15] [44d88dd3-5583-4fcc-a254-5ed6ca8de537] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-20T23:48:00.979365624Z [2024-03-20 23:48:00,979: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da6d2148-f171-4ab1-a220-4761923a60f4] received
2024-03-20T23:48:00.995569516Z [2024-03-20 23:48:00,995: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e8e1921-da23-4d45-bd26-dd6671cea167] received
2024-03-20T23:48:01.007873011Z [2024-03-20 23:48:01,007: INFO/ForkPoolWorker-16] [da6d2148-f171-4ab1-a220-4761923a60f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-20T23:48:01.010968302Z [2024-03-20 23:48:01,010: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05caa2de-23ab-4e9b-9ad4-985c2f05dc1a] received
2024-03-20T23:48:01.030179113Z [2024-03-20 23:48:01,028: INFO/ForkPoolWorker-1] [7e8e1921-da23-4d45-bd26-dd6671cea167] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:48:01.085166452Z [2024-03-20 23:48:01,084: INFO/ForkPoolWorker-2] [05caa2de-23ab-4e9b-9ad4-985c2f05dc1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:48:01.668849653Z [2024-03-20 23:48:01,662: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-20T23:48:02.099994744Z [2024-03-20 23:48:02,095: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:48:02.572807768Z [2024-03-20 23:48:02,544: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:48:02.657870384Z [2024-03-20 23:48:02,657: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-20T23:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:48:02.958475329Z [2024-03-20 23:48:02,943: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-20T23:48:03.368957141Z [2024-03-20 23:48:03,368: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-20T23:48:03.393451297Z [2024-03-20 23:48:03,392: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:48:03.509747786Z [2024-03-20 23:48:03,509: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:48:03.513314732Z [2024-03-20 23:48:03,513: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-20T23:48:03.514568643Z [2024-03-20 23:48:03,513: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-20T23:48:03.514603277Z [2024-03-20 23:48:03,514: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-20T23:48:03.514657596Z [2024-03-20 23:48:03,514: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-20T23:48:03.735246208Z [2024-03-20 23:48:03,731: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-20T23:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:48:04.014960655Z [2024-03-20 23:48:04,014: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[44d88dd3-5583-4fcc-a254-5ed6ca8de537] succeeded in 3.059928382999942s: None
2024-03-20T23:48:05.010958975Z [2024-03-20 23:48:05,010: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-20T23:48:05.015236989Z [2024-03-20 23:48:05,014: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:48:05.056513683Z [2024-03-20 23:48:05,056: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-20T23:48:05.059444014Z [2024-03-20 23:48:05,058: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:48:05.064476032Z [2024-03-20 23:48:05,059: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:48:05.064488607Z [2024-03-20 23:48:05,060: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:48:05.064495038Z [2024-03-20 23:48:05,061: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-20T23:48:05.064498518Z [2024-03-20 23:48:05,061: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:48:05.064514572Z [2024-03-20 23:48:05,061: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:48:05.213818617Z [2024-03-20 23:48:05,212: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:48:05.247606875Z [2024-03-20 23:48:05,247: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-20T23:48:05.253813029Z [2024-03-20 23:48:05,251: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:48:05.276238093Z [2024-03-20 23:48:05,275: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[da6d2148-f171-4ab1-a220-4761923a60f4] succeeded in 4.290036965999889s: None
2024-03-20T23:48:05.294392015Z [2024-03-20 23:48:05,294: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-20T23:48:05.296198637Z [2024-03-20 23:48:05,295: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:48:05.296214968Z [2024-03-20 23:48:05,296: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:48:05.296323722Z [2024-03-20 23:48:05,296: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:48:05.296772953Z [2024-03-20 23:48:05,296: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-20T23:48:05.297018758Z [2024-03-20 23:48:05,296: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:48:05.297057082Z [2024-03-20 23:48:05,296: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:48:05.394157075Z [2024-03-20 23:48:05,393: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:48:08.574791384Z [2024-03-20 23:48:08,573: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[05caa2de-23ab-4e9b-9ad4-985c2f05dc1a] succeeded in 7.560691790000192s: None
2024-03-20T23:48:09.121295199Z [2024-03-20 23:48:09,120: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7e8e1921-da23-4d45-bd26-dd6671cea167] succeeded in 8.115959500999907s: None
2024-03-20T23:49:00.666082687Z [2024-03-20 23:49:00,665: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97f43d8a-09d6-4a3f-bc4f-46c981f83e5c] received
2024-03-20T23:49:00.669771833Z [2024-03-20 23:49:00,669: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35674b8c-aa2b-49f3-a94c-8257aaa0edee] received
2024-03-20T23:49:00.676555829Z [2024-03-20 23:49:00,676: INFO/ForkPoolWorker-15] [97f43d8a-09d6-4a3f-bc4f-46c981f83e5c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-20T23:49:00.683114699Z [2024-03-20 23:49:00,682: INFO/ForkPoolWorker-16] [35674b8c-aa2b-49f3-a94c-8257aaa0edee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:49:00.688733513Z [2024-03-20 23:49:00,688: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06cbec02-af61-4713-b175-595923bafcef] received
2024-03-20T23:49:00.700256757Z [2024-03-20 23:49:00,699: INFO/ForkPoolWorker-1] [06cbec02-af61-4713-b175-595923bafcef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:49:01.031865121Z [2024-03-20 23:49:01,028: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:49:01.070770238Z [2024-03-20 23:49:01,067: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:49:01.127022898Z [2024-03-20 23:49:01,124: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-20T23:49:01.332273605Z [2024-03-20 23:49:01,331: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-20T23:49:01.339305771Z [2024-03-20 23:49:01,338: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:49:01.365017249Z [2024-03-20 23:49:01,364: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:49:01.366487929Z [2024-03-20 23:49:01,366: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-20T23:49:01.366727062Z [2024-03-20 23:49:01,366: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-20T23:49:01.366900876Z [2024-03-20 23:49:01,366: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-20T23:49:01.367242222Z [2024-03-20 23:49:01,367: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-20T23:49:01.477749480Z [2024-03-20 23:49:01,477: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-20T23:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:49:02.188728182Z [2024-03-20 23:49:02,188: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[97f43d8a-09d6-4a3f-bc4f-46c981f83e5c] succeeded in 1.519997930999807s: None
2024-03-20T23:49:02.323941149Z [2024-03-20 23:49:02,323: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:49:02.328056586Z [2024-03-20 23:49:02,327: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:49:02.368077210Z [2024-03-20 23:49:02,367: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:49:02.370431769Z [2024-03-20 23:49:02,370: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:49:02.370707950Z [2024-03-20 23:49:02,370: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:49:02.370814755Z [2024-03-20 23:49:02,370: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:49:02.370927305Z [2024-03-20 23:49:02,370: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:49:02.371630849Z [2024-03-20 23:49:02,371: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:49:02.371692038Z [2024-03-20 23:49:02,371: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:49:02.507129771Z [2024-03-20 23:49:02,506: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-20T23:49:02.510899827Z [2024-03-20 23:49:02,510: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:49:02.536591192Z [2024-03-20 23:49:02,536: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-20T23:49:02.537808650Z [2024-03-20 23:49:02,537: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:49:02.537861713Z [2024-03-20 23:49:02,537: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:49:02.537966889Z [2024-03-20 23:49:02,537: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:49:02.537995580Z [2024-03-20 23:49:02,537: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-20T23:49:02.538241857Z [2024-03-20 23:49:02,538: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:49:02.538304430Z [2024-03-20 23:49:02,538: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:49:02.541149509Z [2024-03-20 23:49:02,540: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:49:02.650936592Z [2024-03-20 23:49:02,650: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:49:04.423526286Z [2024-03-20 23:49:04,423: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[06cbec02-af61-4713-b175-595923bafcef] succeeded in 3.7323717620001844s: None
2024-03-20T23:49:04.702817204Z [2024-03-20 23:49:04,702: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[35674b8c-aa2b-49f3-a94c-8257aaa0edee] succeeded in 4.030836188999956s: None
2024-03-20T23:50:00.473232235Z [2024-03-20 23:50:00,472: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa37c1e8-5f70-429b-9516-f0032e2e3728] received
2024-03-20T23:50:00.476433351Z [2024-03-20 23:50:00,476: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[684efd9e-5876-458a-b7e3-71eff1b21921] received
2024-03-20T23:50:00.482417543Z [2024-03-20 23:50:00,482: INFO/ForkPoolWorker-15] [fa37c1e8-5f70-429b-9516-f0032e2e3728] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:50:00.483881204Z [2024-03-20 23:50:00,483: INFO/ForkPoolWorker-16] [684efd9e-5876-458a-b7e3-71eff1b21921] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:50:00.484790125Z [2024-03-20 23:50:00,484: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bdecbd4a-04de-4209-8bd6-fc11f032801d] received
2024-03-20T23:50:00.487581214Z [2024-03-20 23:50:00,487: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3675bb75-0f7b-4b24-828d-83b73cbda9c1] received
2024-03-20T23:50:00.490257087Z [2024-03-20 23:50:00,490: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18273ccf-974d-4274-897f-b844a4d43f47] received
2024-03-20T23:50:00.495824848Z [2024-03-20 23:50:00,495: INFO/ForkPoolWorker-2] [3675bb75-0f7b-4b24-828d-83b73cbda9c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-20T23:50:00.497358673Z [2024-03-20 23:50:00,497: INFO/ForkPoolWorker-1] [bdecbd4a-04de-4209-8bd6-fc11f032801d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-20T23:50:00.514222549Z [2024-03-20 23:50:00,513: INFO/ForkPoolWorker-3] [18273ccf-974d-4274-897f-b844a4d43f47] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:50:00.845971674Z [2024-03-20 23:50:00,842: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:50:00.929780259Z [2024-03-20 23:50:00,926: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-20T23:50:00.999341748Z [2024-03-20 23:50:00,995: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-20T23:50:01.023795974Z [2024-03-20 23:50:01,016: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:50:01.036013139Z [2024-03-20 23:50:01,032: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:50:01.221053435Z [2024-03-20 23:50:01,220: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-20T23:50:01.226697868Z [2024-03-20 23:50:01,226: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:50:01.274379170Z [2024-03-20 23:50:01,274: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-20T23:50:01.276966978Z [2024-03-20 23:50:01,276: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-20T23:50:01.277603222Z [2024-03-20 23:50:01,276: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-20T23:50:01.277793934Z [2024-03-20 23:50:01,277: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-20T23:50:01.278188081Z [2024-03-20 23:50:01,278: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-20T23:50:01.384727801Z [2024-03-20 23:50:01,384: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-20T23:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:50:01.413362867Z [2024-03-20 23:50:01,413: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-20T23:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:50:02.085275864Z [2024-03-20 23:50:02,084: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bdecbd4a-04de-4209-8bd6-fc11f032801d] succeeded in 1.5987623569999414s: None
2024-03-20T23:50:02.162160577Z [2024-03-20 23:50:02,161: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3675bb75-0f7b-4b24-828d-83b73cbda9c1] succeeded in 1.6718559490000189s: None
2024-03-20T23:50:02.619557308Z [2024-03-20 23:50:02,618: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:50:02.624648035Z [2024-03-20 23:50:02,624: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:50:02.653347999Z [2024-03-20 23:50:02,653: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:50:02.658033076Z [2024-03-20 23:50:02,657: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:50:02.659314846Z [2024-03-20 23:50:02,657: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:50:02.659622540Z [2024-03-20 23:50:02,659: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:50:02.659779892Z [2024-03-20 23:50:02,659: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:50:02.660188400Z [2024-03-20 23:50:02,660: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:50:02.660623616Z [2024-03-20 23:50:02,660: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:50:02.766361704Z [2024-03-20 23:50:02,766: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-20T23:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:50:03.035190925Z [2024-03-20 23:50:03,034: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:50:03.039262782Z [2024-03-20 23:50:03,038: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:50:03.040943177Z [2024-03-20 23:50:03,040: INFO/ForkPoolWorker-3] Getting VIM list
2024-03-20T23:50:03.044979422Z [2024-03-20 23:50:03,044: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:50:03.061079806Z [2024-03-20 23:50:03,060: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:50:03.062723467Z [2024-03-20 23:50:03,062: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:50:03.062742260Z [2024-03-20 23:50:03,062: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:50:03.062952874Z [2024-03-20 23:50:03,062: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:50:03.062980663Z [2024-03-20 23:50:03,062: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:50:03.063302345Z [2024-03-20 23:50:03,063: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:50:03.063316807Z [2024-03-20 23:50:03,063: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:50:03.065350810Z [2024-03-20 23:50:03,065: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-20T23:50:03.066764533Z [2024-03-20 23:50:03,066: INFO/ForkPoolWorker-3] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:50:03.067202614Z [2024-03-20 23:50:03,067: INFO/ForkPoolWorker-3] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:50:03.067521383Z [2024-03-20 23:50:03,067: INFO/ForkPoolWorker-3] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:50:03.067593677Z [2024-03-20 23:50:03,067: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-03-20T23:50:03.067883209Z [2024-03-20 23:50:03,067: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:50:03.068403323Z [2024-03-20 23:50:03,068: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:50:03.162055739Z [2024-03-20 23:50:03,161: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:50:03.186018164Z [2024-03-20 23:50:03,185: INFO/ForkPoolWorker-3] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:50:03.458880944Z [2024-03-20 23:50:03,458: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fa37c1e8-5f70-429b-9516-f0032e2e3728] succeeded in 2.9823551879999286s: None
2024-03-20T23:50:04.479949623Z [2024-03-20 23:50:04,479: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5eddabd9-3679-405f-bf0c-57cca2d3368b] received
2024-03-20T23:50:04.489768073Z [2024-03-20 23:50:04,489: INFO/ForkPoolWorker-15] [5eddabd9-3679-405f-bf0c-57cca2d3368b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:50:04.777074540Z [2024-03-20 23:50:04,773: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:50:05.407441680Z [2024-03-20 23:50:05,406: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[684efd9e-5876-458a-b7e3-71eff1b21921] succeeded in 4.928210288000173s: None
2024-03-20T23:50:05.921548033Z [2024-03-20 23:50:05,920: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[18273ccf-974d-4274-897f-b844a4d43f47] succeeded in 5.4251974180001525s: None
2024-03-20T23:50:05.969203829Z [2024-03-20 23:50:05,968: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:50:05.973278132Z [2024-03-20 23:50:05,972: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:50:05.995174673Z [2024-03-20 23:50:05,994: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:50:05.996760019Z [2024-03-20 23:50:05,996: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:50:05.997068620Z [2024-03-20 23:50:05,996: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:50:05.997169687Z [2024-03-20 23:50:05,996: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:50:05.997343698Z [2024-03-20 23:50:05,997: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:50:05.997779958Z [2024-03-20 23:50:05,997: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:50:05.998010516Z [2024-03-20 23:50:05,997: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:50:06.091649319Z [2024-03-20 23:50:06,091: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-20T23:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:50:06.785903947Z [2024-03-20 23:50:06,785: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5eddabd9-3679-405f-bf0c-57cca2d3368b] succeeded in 2.302677926999877s: None
2024-03-20T23:50:06.950781417Z [2024-03-20 23:50:06,950: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46dfa93c-7af4-46e8-90c3-e94614d4a345] received
2024-03-20T23:50:06.957927405Z [2024-03-20 23:50:06,957: INFO/ForkPoolWorker-15] [46dfa93c-7af4-46e8-90c3-e94614d4a345] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-20T23:50:07.241973133Z [2024-03-20 23:50:07,238: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:50:08.363385720Z [2024-03-20 23:50:08,363: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:50:08.367116665Z [2024-03-20 23:50:08,366: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:50:08.390770635Z [2024-03-20 23:50:08,390: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:50:08.392286682Z [2024-03-20 23:50:08,392: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:50:08.392450676Z [2024-03-20 23:50:08,392: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:50:08.392614959Z [2024-03-20 23:50:08,392: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:50:08.392708573Z [2024-03-20 23:50:08,392: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:50:08.392971089Z [2024-03-20 23:50:08,392: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:50:08.393079285Z [2024-03-20 23:50:08,392: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:50:08.516424751Z [2024-03-20 23:50:08,514: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-20T23:45:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:50:09.118436052Z [2024-03-20 23:50:09,117: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[46dfa93c-7af4-46e8-90c3-e94614d4a345] succeeded in 2.1654257709999456s: None
2024-03-20T23:50:09.611385387Z [2024-03-20 23:50:09,611: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fba6688-9f69-4810-b23a-4e2e46ca1bc1] received
2024-03-20T23:50:09.625419919Z [2024-03-20 23:50:09,625: INFO/ForkPoolWorker-15] [9fba6688-9f69-4810-b23a-4e2e46ca1bc1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:50:09.951592830Z [2024-03-20 23:50:09,948: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:50:11.150198278Z [2024-03-20 23:50:11,149: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:50:11.153813388Z [2024-03-20 23:50:11,153: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:50:11.177141020Z [2024-03-20 23:50:11,176: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:50:11.178563643Z [2024-03-20 23:50:11,178: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:50:11.178733964Z [2024-03-20 23:50:11,178: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:50:11.178981287Z [2024-03-20 23:50:11,178: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:50:11.179144539Z [2024-03-20 23:50:11,178: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:50:11.179554397Z [2024-03-20 23:50:11,179: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:50:11.179716164Z [2024-03-20 23:50:11,179: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:50:11.270259867Z [2024-03-20 23:50:11,269: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-20T23:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:50:11.826330934Z [2024-03-20 23:50:11,825: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9fba6688-9f69-4810-b23a-4e2e46ca1bc1] succeeded in 2.2123108209998463s: None
2024-03-20T23:51:00.450294646Z [2024-03-20 23:51:00,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56dc2520-d968-4787-aacc-b6dcbf07e3fd] received
2024-03-20T23:51:00.459549151Z [2024-03-20 23:51:00,459: INFO/ForkPoolWorker-15] [56dc2520-d968-4787-aacc-b6dcbf07e3fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:51:00.462131955Z [2024-03-20 23:51:00,461: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd9863a8-ec31-40d7-8700-0278ec31bb3b] received
2024-03-20T23:51:00.477044409Z [2024-03-20 23:51:00,476: INFO/ForkPoolWorker-16] [dd9863a8-ec31-40d7-8700-0278ec31bb3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-20T23:51:00.484269053Z [2024-03-20 23:51:00,483: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10094af3-f765-428e-a44e-e3abb0c4d80e] received
2024-03-20T23:51:00.497175074Z [2024-03-20 23:51:00,496: INFO/ForkPoolWorker-1] [10094af3-f765-428e-a44e-e3abb0c4d80e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:51:00.797030860Z [2024-03-20 23:51:00,793: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-20T23:51:00.797371866Z [2024-03-20 23:51:00,794: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:51:00.872571976Z [2024-03-20 23:51:00,864: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:51:00.972651176Z [2024-03-20 23:51:00,972: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-20T23:51:00.977755451Z [2024-03-20 23:51:00,977: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:51:01.009162025Z [2024-03-20 23:51:01,008: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:51:01.010620535Z [2024-03-20 23:51:01,010: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-20T23:51:01.010712594Z [2024-03-20 23:51:01,010: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-20T23:51:01.010819085Z [2024-03-20 23:51:01,010: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-20T23:51:01.011171071Z [2024-03-20 23:51:01,010: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-20T23:51:01.122361536Z [2024-03-20 23:51:01,121: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-20T23:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:51:01.779902356Z [2024-03-20 23:51:01,779: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dd9863a8-ec31-40d7-8700-0278ec31bb3b] succeeded in 1.3146042500000021s: None
2024-03-20T23:51:02.100690554Z [2024-03-20 23:51:02,100: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:51:02.104626652Z [2024-03-20 23:51:02,104: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:51:02.125880704Z [2024-03-20 23:51:02,125: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:51:02.127690917Z [2024-03-20 23:51:02,127: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:51:02.127989223Z [2024-03-20 23:51:02,127: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:51:02.128230584Z [2024-03-20 23:51:02,127: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:51:02.128373551Z [2024-03-20 23:51:02,128: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:51:02.128721359Z [2024-03-20 23:51:02,128: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:51:02.128805155Z [2024-03-20 23:51:02,128: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:51:02.221036322Z [2024-03-20 23:51:02,220: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:51:02.358632527Z [2024-03-20 23:51:02,358: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-20T23:51:02.362449174Z [2024-03-20 23:51:02,361: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:51:02.430228267Z [2024-03-20 23:51:02,429: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-20T23:51:02.432618761Z [2024-03-20 23:51:02,432: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:51:02.432657337Z [2024-03-20 23:51:02,432: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:51:02.432976955Z [2024-03-20 23:51:02,432: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:51:02.433096833Z [2024-03-20 23:51:02,432: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-20T23:51:02.433611190Z [2024-03-20 23:51:02,433: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:51:02.433787706Z [2024-03-20 23:51:02,433: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:51:02.577417273Z [2024-03-20 23:51:02,576: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:51:04.239129582Z [2024-03-20 23:51:04,238: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[56dc2520-d968-4787-aacc-b6dcbf07e3fd] succeeded in 3.7867445360000147s: None
2024-03-20T23:51:04.283234260Z [2024-03-20 23:51:04,282: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[10094af3-f765-428e-a44e-e3abb0c4d80e] succeeded in 3.796371127999919s: None
2024-03-20T23:51:13.239657019Z [2024-03-20 23:51:13,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af9dc5df-fd40-4ac1-aa0e-b17c982a867f] received
2024-03-20T23:51:13.247630365Z [2024-03-20 23:51:13,247: INFO/ForkPoolWorker-15] [af9dc5df-fd40-4ac1-aa0e-b17c982a867f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:51:13.378734440Z [2024-03-20 23:51:13,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d9d0c8c-c8b3-4f54-942c-aa5a3a1c748b] received
2024-03-20T23:51:13.394236678Z [2024-03-20 23:51:13,393: INFO/ForkPoolWorker-16] [5d9d0c8c-c8b3-4f54-942c-aa5a3a1c748b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:51:13.566070086Z [2024-03-20 23:51:13,562: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:51:13.740358996Z [2024-03-20 23:51:13,736: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:51:14.700478787Z [2024-03-20 23:51:14,697: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:51:14.704452564Z [2024-03-20 23:51:14,700: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:51:14.714801372Z [2024-03-20 23:51:14,714: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:51:14.716764024Z [2024-03-20 23:51:14,715: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:51:14.716777669Z [2024-03-20 23:51:14,715: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:51:14.716780973Z [2024-03-20 23:51:14,715: INFO/ForkPoolWorker-15] Read VIM c2d3576c-57a2-44ae-bc76-8149f05e77af (basic_08_vim_test)
2024-03-20T23:51:14.716785330Z [2024-03-20 23:51:14,715: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c2d3576c-57a2-44ae-bc76-8149f05e77af', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-03-20T23:51:14.716790232Z [2024-03-20 23:51:14,716: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:51:14.716793239Z [2024-03-20 23:51:14,716: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:51:14.716796307Z [2024-03-20 23:51:14,716: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:51:14.724465737Z [2024-03-20 23:51:14,720: INFO/ForkPoolWorker-15] Creating DAG vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af
2024-03-20T23:51:14.784485597Z [2024-03-20 23:51:14,783: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:51:14.854251762Z [2024-03-20 23:51:14,853: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:51:14.858290193Z [2024-03-20 23:51:14,856: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:51:14.884618502Z [2024-03-20 23:51:14,884: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:51:14.885825792Z [2024-03-20 23:51:14,885: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:51:14.885834235Z [2024-03-20 23:51:14,885: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:51:14.885879241Z [2024-03-20 23:51:14,885: INFO/ForkPoolWorker-16] Read VIM c2d3576c-57a2-44ae-bc76-8149f05e77af (basic_08_vim_test)
2024-03-20T23:51:14.885986364Z [2024-03-20 23:51:14,885: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c2d3576c-57a2-44ae-bc76-8149f05e77af', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-03-20T23:51:14.886039956Z [2024-03-20 23:51:14,885: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:51:14.886408647Z [2024-03-20 23:51:14,886: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:51:14.886465897Z [2024-03-20 23:51:14,886: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:51:14.890808834Z [2024-03-20 23:51:14,890: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af
2024-03-20T23:51:14.962643474Z [2024-03-20 23:51:14,962: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:51:16.158010923Z [2024-03-20 23:51:16,157: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[af9dc5df-fd40-4ac1-aa0e-b17c982a867f] succeeded in 2.915928354000016s: None
2024-03-20T23:51:16.762211083Z [2024-03-20 23:51:16,761: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5d9d0c8c-c8b3-4f54-942c-aa5a3a1c748b] succeeded in 3.380011489000026s: None
2024-03-20T23:51:18.501853044Z [2024-03-20 23:51:18,500: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0714e7f-9b5a-4e06-8a00-1e892b376a9a] received
2024-03-20T23:51:18.510655892Z [2024-03-20 23:51:18,510: INFO/ForkPoolWorker-15] [a0714e7f-9b5a-4e06-8a00-1e892b376a9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:51:18.816693004Z [2024-03-20 23:51:18,812: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:51:20.084794886Z [2024-03-20 23:51:20,084: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:51:20.088271140Z [2024-03-20 23:51:20,087: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:51:20.109356241Z [2024-03-20 23:51:20,109: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:51:20.111324449Z [2024-03-20 23:51:20,111: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:51:20.111337614Z [2024-03-20 23:51:20,111: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:51:20.111457410Z [2024-03-20 23:51:20,111: INFO/ForkPoolWorker-15] Read VIM c2d3576c-57a2-44ae-bc76-8149f05e77af (basic_08_vim_test)
2024-03-20T23:51:20.111505375Z [2024-03-20 23:51:20,111: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c2d3576c-57a2-44ae-bc76-8149f05e77af', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-03-20T23:51:20.111534613Z [2024-03-20 23:51:20,111: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:51:20.111779188Z [2024-03-20 23:51:20,111: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:51:20.111848089Z [2024-03-20 23:51:20,111: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:51:20.118771466Z [2024-03-20 23:51:20,118: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af
2024-03-20T23:51:20.183695795Z [2024-03-20 23:51:20,183: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.extract_metrics_from_vnfrs scheduled__2024-03-20T23:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:51:20.848507043Z [2024-03-20 23:51:20,847: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a0714e7f-9b5a-4e06-8a00-1e892b376a9a] succeeded in 2.344675792999851s: None
2024-03-20T23:51:21.768238973Z [2024-03-20 23:51:21,767: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f0df2cc-a723-4c5a-95bd-6698e5eeaf55] received
2024-03-20T23:51:21.777371771Z [2024-03-20 23:51:21,776: INFO/ForkPoolWorker-15] [9f0df2cc-a723-4c5a-95bd-6698e5eeaf55] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'split_metrics', 'scheduled__2024-03-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:51:22.068842075Z [2024-03-20 23:51:22,065: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:51:23.185621989Z [2024-03-20 23:51:23,185: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:51:23.188934939Z [2024-03-20 23:51:23,188: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:51:23.204748467Z [2024-03-20 23:51:23,204: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:51:23.205751317Z [2024-03-20 23:51:23,205: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:51:23.205780697Z [2024-03-20 23:51:23,205: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:51:23.205841917Z [2024-03-20 23:51:23,205: INFO/ForkPoolWorker-15] Read VIM c2d3576c-57a2-44ae-bc76-8149f05e77af (basic_08_vim_test)
2024-03-20T23:51:23.205947664Z [2024-03-20 23:51:23,205: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c2d3576c-57a2-44ae-bc76-8149f05e77af', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-03-20T23:51:23.205977727Z [2024-03-20 23:51:23,205: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:51:23.206186703Z [2024-03-20 23:51:23,206: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:51:23.206279381Z [2024-03-20 23:51:23,206: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:51:23.211663008Z [2024-03-20 23:51:23,211: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af
2024-03-20T23:51:23.280015653Z [2024-03-20 23:51:23,279: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.split_metrics scheduled__2024-03-20T23:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:51:23.902305354Z [2024-03-20 23:51:23,901: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9f0df2cc-a723-4c5a-95bd-6698e5eeaf55] succeeded in 2.132425077000107s: None
2024-03-20T23:51:24.061423421Z [2024-03-20 23:51:24,061: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2594d02-66e3-44b4-96ef-e5cb0eb8f7db] received
2024-03-20T23:51:24.067801529Z [2024-03-20 23:51:24,067: INFO/ForkPoolWorker-15] [f2594d02-66e3-44b4-96ef-e5cb0eb8f7db] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'collect_metrics', 'scheduled__2024-03-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-20T23:51:24.344543885Z [2024-03-20 23:51:24,341: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:51:25.503949416Z [2024-03-20 23:51:25,503: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:51:25.507389441Z [2024-03-20 23:51:25,506: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:51:25.523934318Z [2024-03-20 23:51:25,523: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:51:25.525082559Z [2024-03-20 23:51:25,524: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:51:25.525114719Z [2024-03-20 23:51:25,525: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:51:25.525137037Z [2024-03-20 23:51:25,525: INFO/ForkPoolWorker-15] Read VIM c2d3576c-57a2-44ae-bc76-8149f05e77af (basic_08_vim_test)
2024-03-20T23:51:25.525302764Z [2024-03-20 23:51:25,525: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c2d3576c-57a2-44ae-bc76-8149f05e77af', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-03-20T23:51:25.525315323Z [2024-03-20 23:51:25,525: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:51:25.525709338Z [2024-03-20 23:51:25,525: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:51:25.525793956Z [2024-03-20 23:51:25,525: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:51:25.531764094Z [2024-03-20 23:51:25,531: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af
2024-03-20T23:51:25.619463741Z [2024-03-20 23:51:25,619: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.collect_metrics scheduled__2024-03-20T23:45:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:51:26.204624334Z [2024-03-20 23:51:26,203: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f2594d02-66e3-44b4-96ef-e5cb0eb8f7db] succeeded in 2.14130602299997s: None
2024-03-20T23:51:27.237685260Z [2024-03-20 23:51:27,237: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a17dc88f-db38-4748-9f24-7d40a93bb1cd] received
2024-03-20T23:51:27.244427351Z [2024-03-20 23:51:27,244: INFO/ForkPoolWorker-15] [a17dc88f-db38-4748-9f24-7d40a93bb1cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'send_prometheus', 'scheduled__2024-03-20T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:51:27.577947015Z [2024-03-20 23:51:27,574: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:51:28.711661873Z [2024-03-20 23:51:28,711: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:51:28.715294251Z [2024-03-20 23:51:28,714: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:51:28.734409264Z [2024-03-20 23:51:28,734: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:51:28.736561559Z [2024-03-20 23:51:28,736: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:51:28.736910323Z [2024-03-20 23:51:28,736: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:51:28.737184261Z [2024-03-20 23:51:28,737: INFO/ForkPoolWorker-15] Read VIM c2d3576c-57a2-44ae-bc76-8149f05e77af (basic_08_vim_test)
2024-03-20T23:51:28.737652672Z [2024-03-20 23:51:28,737: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c2d3576c-57a2-44ae-bc76-8149f05e77af', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-03-20T23:51:28.737942073Z [2024-03-20 23:51:28,737: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:51:28.738740931Z [2024-03-20 23:51:28,738: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:51:28.739134751Z [2024-03-20 23:51:28,738: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:51:28.749569377Z [2024-03-20 23:51:28,749: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af
2024-03-20T23:51:28.821293181Z [2024-03-20 23:51:28,821: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.send_prometheus scheduled__2024-03-20T23:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:51:29.332673903Z [2024-03-20 23:51:29,331: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a17dc88f-db38-4748-9f24-7d40a93bb1cd] succeeded in 2.0925835559999086s: None
2024-03-20T23:52:00.362164621Z [2024-03-20 23:52:00,361: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b213fb0-99e8-4102-9c52-7599738b380a] received
2024-03-20T23:52:00.366362042Z [2024-03-20 23:52:00,366: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff4af6f6-eb49-4375-b534-4fbe00168cd3] received
2024-03-20T23:52:00.375038741Z [2024-03-20 23:52:00,374: INFO/ForkPoolWorker-15] [6b213fb0-99e8-4102-9c52-7599738b380a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-20T23:52:00.376024371Z [2024-03-20 23:52:00,375: INFO/ForkPoolWorker-16] [ff4af6f6-eb49-4375-b534-4fbe00168cd3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:52:00.423279047Z [2024-03-20 23:52:00,423: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c55346e-be47-4378-9bef-248ff6f6810f] received
2024-03-20T23:52:00.426738646Z [2024-03-20 23:52:00,426: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c62fe8e4-1db7-44dd-8b0c-2282d0cc843e] received
2024-03-20T23:52:00.428295351Z [2024-03-20 23:52:00,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ea70cd6-fff7-42fe-8823-27fe3c2822b9] received
2024-03-20T23:52:00.448825389Z [2024-03-20 23:52:00,448: INFO/ForkPoolWorker-2] [c62fe8e4-1db7-44dd-8b0c-2282d0cc843e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:52:00.454471848Z [2024-03-20 23:52:00,454: INFO/ForkPoolWorker-1] [2c55346e-be47-4378-9bef-248ff6f6810f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:52:00.455196626Z [2024-03-20 23:52:00,455: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a04a9b3b-8da7-4503-a8de-f83ae2769edf] received
2024-03-20T23:52:00.467725275Z [2024-03-20 23:52:00,464: INFO/ForkPoolWorker-3] [8ea70cd6-fff7-42fe-8823-27fe3c2822b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:52:00.481521565Z [2024-03-20 23:52:00,481: INFO/ForkPoolWorker-4] [a04a9b3b-8da7-4503-a8de-f83ae2769edf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-20T23:52:00.855240885Z [2024-03-20 23:52:00,848: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:52:01.000801886Z [2024-03-20 23:52:00,986: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:52:01.240400532Z [2024-03-20 23:52:01,236: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-20T23:52:01.243550060Z [2024-03-20 23:52:01,239: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:52:01.356618558Z [2024-03-20 23:52:01,351: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-20T23:52:01.369380084Z [2024-03-20 23:52:01,364: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:52:01.578310288Z [2024-03-20 23:52:01,578: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-20T23:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:52:01.802010818Z [2024-03-20 23:52:01,801: INFO/ForkPoolWorker-4] Getting SDNC list
2024-03-20T23:52:01.806662589Z [2024-03-20 23:52:01,806: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:52:01.881233534Z [2024-03-20 23:52:01,881: INFO/ForkPoolWorker-4] Connected to database osm version 1.2
2024-03-20T23:52:01.883520823Z [2024-03-20 23:52:01,883: INFO/ForkPoolWorker-4] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-20T23:52:01.883747337Z [2024-03-20 23:52:01,883: INFO/ForkPoolWorker-4] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-20T23:52:01.883900425Z [2024-03-20 23:52:01,883: INFO/ForkPoolWorker-4] Getting SDNC list OK
2024-03-20T23:52:01.884168213Z [2024-03-20 23:52:01,884: INFO/ForkPoolWorker-4] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-20T23:52:02.042869136Z [2024-03-20 23:52:02,042: INFO/ForkPoolWorker-4] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-20T23:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:52:02.372558852Z [2024-03-20 23:52:02,372: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6b213fb0-99e8-4102-9c52-7599738b380a] succeeded in 2.0065198950001104s: None
2024-03-20T23:52:03.108139867Z [2024-03-20 23:52:03,107: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[a04a9b3b-8da7-4503-a8de-f83ae2769edf] succeeded in 2.649707221999961s: None
2024-03-20T23:52:03.234676858Z [2024-03-20 23:52:03,234: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:52:03.238488915Z [2024-03-20 23:52:03,238: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:52:03.259303104Z [2024-03-20 23:52:03,258: INFO/ForkPoolWorker-3] Getting VIM list
2024-03-20T23:52:03.262934106Z [2024-03-20 23:52:03,262: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:52:03.268509037Z [2024-03-20 23:52:03,268: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:52:03.270404084Z [2024-03-20 23:52:03,270: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:52:03.270613704Z [2024-03-20 23:52:03,270: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:52:03.270820615Z [2024-03-20 23:52:03,270: INFO/ForkPoolWorker-16] Read VIM c2d3576c-57a2-44ae-bc76-8149f05e77af (basic_08_vim_test)
2024-03-20T23:52:03.271098512Z [2024-03-20 23:52:03,270: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c2d3576c-57a2-44ae-bc76-8149f05e77af', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-03-20T23:52:03.271204144Z [2024-03-20 23:52:03,271: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:52:03.272598084Z [2024-03-20 23:52:03,272: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:52:03.272940503Z [2024-03-20 23:52:03,272: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:52:03.280068498Z [2024-03-20 23:52:03,279: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af
2024-03-20T23:52:03.319491637Z [2024-03-20 23:52:03,319: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-20T23:52:03.325976374Z [2024-03-20 23:52:03,325: INFO/ForkPoolWorker-3] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:52:03.326117932Z [2024-03-20 23:52:03,325: INFO/ForkPoolWorker-3] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:52:03.326224529Z [2024-03-20 23:52:03,326: INFO/ForkPoolWorker-3] Read VIM c2d3576c-57a2-44ae-bc76-8149f05e77af (basic_08_vim_test)
2024-03-20T23:52:03.326442773Z [2024-03-20 23:52:03,326: INFO/ForkPoolWorker-3] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c2d3576c-57a2-44ae-bc76-8149f05e77af', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-03-20T23:52:03.326566178Z [2024-03-20 23:52:03,326: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-03-20T23:52:03.326891119Z [2024-03-20 23:52:03,326: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:52:03.327007113Z [2024-03-20 23:52:03,326: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:52:03.333027395Z [2024-03-20 23:52:03,332: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af
2024-03-20T23:52:03.369317899Z [2024-03-20 23:52:03,368: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:52:03.445671161Z [2024-03-20 23:52:03,445: INFO/ForkPoolWorker-3] Running <TaskInstance: vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:52:03.551665057Z [2024-03-20 23:52:03,551: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-20T23:52:03.556162463Z [2024-03-20 23:52:03,555: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:52:03.567851266Z [2024-03-20 23:52:03,567: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-20T23:52:03.571552617Z [2024-03-20 23:52:03,571: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:52:03.596925975Z [2024-03-20 23:52:03,596: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-20T23:52:03.598301920Z [2024-03-20 23:52:03,598: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:52:03.598319273Z [2024-03-20 23:52:03,598: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:52:03.598439582Z [2024-03-20 23:52:03,598: INFO/ForkPoolWorker-1] Read VIM c2d3576c-57a2-44ae-bc76-8149f05e77af (basic_08_vim_test)
2024-03-20T23:52:03.598618076Z [2024-03-20 23:52:03,598: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c2d3576c-57a2-44ae-bc76-8149f05e77af', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-03-20T23:52:03.598678183Z [2024-03-20 23:52:03,598: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-20T23:52:03.598940830Z [2024-03-20 23:52:03,598: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:52:03.599153368Z [2024-03-20 23:52:03,598: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:52:03.604206493Z [2024-03-20 23:52:03,603: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-20T23:52:03.606380118Z [2024-03-20 23:52:03,606: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:52:03.606499276Z [2024-03-20 23:52:03,606: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:52:03.606509582Z [2024-03-20 23:52:03,606: INFO/ForkPoolWorker-1] Creating DAG vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af
2024-03-20T23:52:03.606650375Z [2024-03-20 23:52:03,606: INFO/ForkPoolWorker-2] Read VIM c2d3576c-57a2-44ae-bc76-8149f05e77af (basic_08_vim_test)
2024-03-20T23:52:03.606857537Z [2024-03-20 23:52:03,606: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c2d3576c-57a2-44ae-bc76-8149f05e77af', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-03-20T23:52:03.606961917Z [2024-03-20 23:52:03,606: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-20T23:52:03.607378314Z [2024-03-20 23:52:03,607: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:52:03.607399597Z [2024-03-20 23:52:03,607: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:52:03.612713235Z [2024-03-20 23:52:03,612: INFO/ForkPoolWorker-2] Creating DAG vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af
2024-03-20T23:52:03.693532621Z [2024-03-20 23:52:03,693: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:52:03.725778343Z [2024-03-20 23:52:03,725: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:52:07.057035909Z [2024-03-20 23:52:07,056: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ff4af6f6-eb49-4375-b534-4fbe00168cd3] succeeded in 6.688651815999947s: None
2024-03-20T23:52:07.507606559Z [2024-03-20 23:52:07,507: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c62fe8e4-1db7-44dd-8b0c-2282d0cc843e] succeeded in 7.075283721000005s: None
2024-03-20T23:52:07.684880604Z [2024-03-20 23:52:07,684: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[8ea70cd6-fff7-42fe-8823-27fe3c2822b9] succeeded in 7.252172167000026s: None
2024-03-20T23:52:07.852968660Z [2024-03-20 23:52:07,852: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2c55346e-be47-4378-9bef-248ff6f6810f] succeeded in 7.423353826000039s: None
2024-03-20T23:53:01.319614957Z [2024-03-20 23:53:01,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1cf6f6fb-8bc4-43cb-9737-65a8d4834f88] received
2024-03-20T23:53:01.326462355Z [2024-03-20 23:53:01,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b20989c8-8b86-4653-90f7-95e466523844] received
2024-03-20T23:53:01.329662608Z [2024-03-20 23:53:01,329: INFO/ForkPoolWorker-15] [1cf6f6fb-8bc4-43cb-9737-65a8d4834f88] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-20T23:53:01.333219052Z [2024-03-20 23:53:01,332: INFO/ForkPoolWorker-16] [b20989c8-8b86-4653-90f7-95e466523844] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:53:01.334998926Z [2024-03-20 23:53:01,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f27096b-a0a8-45ae-a7b9-d30c500c724b] received
2024-03-20T23:53:01.337818270Z [2024-03-20 23:53:01,337: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82534495-3a9e-4ac6-91ec-a2445a049e3f] received
2024-03-20T23:53:01.344560643Z [2024-03-20 23:53:01,344: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e064af1a-b51d-4c18-a237-b833e26998bb] received
2024-03-20T23:53:01.346913691Z [2024-03-20 23:53:01,346: INFO/ForkPoolWorker-1] [6f27096b-a0a8-45ae-a7b9-d30c500c724b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:53:01.354636270Z [2024-03-20 23:53:01,354: INFO/ForkPoolWorker-2] [82534495-3a9e-4ac6-91ec-a2445a049e3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:53:01.364026764Z [2024-03-20 23:53:01,363: INFO/ForkPoolWorker-3] [e064af1a-b51d-4c18-a237-b833e26998bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:53:01.717999298Z [2024-03-20 23:53:01,714: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:53:01.926928239Z [2024-03-20 23:53:01,923: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:53:01.934245418Z [2024-03-20 23:53:01,923: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:53:01.943055041Z [2024-03-20 23:53:01,935: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-20T23:53:02.141132013Z [2024-03-20 23:53:02,120: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:53:02.436813898Z [2024-03-20 23:53:02,436: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-20T23:53:02.445830668Z [2024-03-20 23:53:02,445: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:53:02.496713502Z [2024-03-20 23:53:02,496: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:53:02.500186470Z [2024-03-20 23:53:02,499: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-20T23:53:02.505594486Z [2024-03-20 23:53:02,505: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-20T23:53:02.505750482Z [2024-03-20 23:53:02,505: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-20T23:53:02.506135425Z [2024-03-20 23:53:02,506: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-20T23:53:02.917545841Z [2024-03-20 23:53:02,917: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-20T23:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:53:03.930886972Z [2024-03-20 23:53:03,930: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1cf6f6fb-8bc4-43cb-9737-65a8d4834f88] succeeded in 2.6090786709999065s: None
2024-03-20T23:53:03.994583142Z [2024-03-20 23:53:03,994: INFO/ForkPoolWorker-3] Getting VIM list
2024-03-20T23:53:03.999054397Z [2024-03-20 23:53:03,998: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:53:04.045059819Z [2024-03-20 23:53:04,044: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-20T23:53:04.048265625Z [2024-03-20 23:53:04,047: INFO/ForkPoolWorker-3] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:53:04.048469469Z [2024-03-20 23:53:04,048: INFO/ForkPoolWorker-3] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:53:04.048582581Z [2024-03-20 23:53:04,048: INFO/ForkPoolWorker-3] Read VIM c2d3576c-57a2-44ae-bc76-8149f05e77af (basic_08_vim_test)
2024-03-20T23:53:04.048826907Z [2024-03-20 23:53:04,048: INFO/ForkPoolWorker-3] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c2d3576c-57a2-44ae-bc76-8149f05e77af', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-03-20T23:53:04.048917184Z [2024-03-20 23:53:04,048: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-03-20T23:53:04.049275470Z [2024-03-20 23:53:04,049: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:53:04.049391826Z [2024-03-20 23:53:04,049: INFO/ForkPoolWorker-3] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:53:04.056398363Z [2024-03-20 23:53:04,055: INFO/ForkPoolWorker-3] Creating DAG vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af
2024-03-20T23:53:04.166066142Z [2024-03-20 23:53:04,165: INFO/ForkPoolWorker-3] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:53:04.171178017Z [2024-03-20 23:53:04,170: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-20T23:53:04.174764128Z [2024-03-20 23:53:04,174: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:53:04.210864421Z [2024-03-20 23:53:04,210: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-20T23:53:04.217826139Z [2024-03-20 23:53:04,217: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:53:04.218160143Z [2024-03-20 23:53:04,217: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:53:04.218173743Z [2024-03-20 23:53:04,218: INFO/ForkPoolWorker-1] Read VIM c2d3576c-57a2-44ae-bc76-8149f05e77af (basic_08_vim_test)
2024-03-20T23:53:04.218437681Z [2024-03-20 23:53:04,218: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c2d3576c-57a2-44ae-bc76-8149f05e77af', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-03-20T23:53:04.218535936Z [2024-03-20 23:53:04,218: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-20T23:53:04.219378469Z [2024-03-20 23:53:04,219: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:53:04.219398906Z [2024-03-20 23:53:04,219: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:53:04.227072616Z [2024-03-20 23:53:04,226: INFO/ForkPoolWorker-1] Creating DAG vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af
2024-03-20T23:53:04.245872290Z [2024-03-20 23:53:04,245: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-20T23:53:04.251839082Z [2024-03-20 23:53:04,251: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:53:04.282192258Z [2024-03-20 23:53:04,281: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-20T23:53:04.284992508Z [2024-03-20 23:53:04,284: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:53:04.285084422Z [2024-03-20 23:53:04,284: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:53:04.285175792Z [2024-03-20 23:53:04,285: INFO/ForkPoolWorker-2] Read VIM c2d3576c-57a2-44ae-bc76-8149f05e77af (basic_08_vim_test)
2024-03-20T23:53:04.285654392Z [2024-03-20 23:53:04,285: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c2d3576c-57a2-44ae-bc76-8149f05e77af', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-03-20T23:53:04.285853727Z [2024-03-20 23:53:04,285: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-20T23:53:04.286278121Z [2024-03-20 23:53:04,286: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:53:04.286959692Z [2024-03-20 23:53:04,286: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:53:04.293167891Z [2024-03-20 23:53:04,292: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af
2024-03-20T23:53:04.315022289Z [2024-03-20 23:53:04,314: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:53:04.434224574Z [2024-03-20 23:53:04,433: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:53:04.456138317Z [2024-03-20 23:53:04,455: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:53:04.491374323Z [2024-03-20 23:53:04,491: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:53:04.493417846Z [2024-03-20 23:53:04,493: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:53:04.495865100Z [2024-03-20 23:53:04,495: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:53:04.496032879Z [2024-03-20 23:53:04,495: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:53:04.496079821Z [2024-03-20 23:53:04,495: INFO/ForkPoolWorker-16] Read VIM c2d3576c-57a2-44ae-bc76-8149f05e77af (basic_08_vim_test)
2024-03-20T23:53:04.496291749Z [2024-03-20 23:53:04,496: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'c2d3576c-57a2-44ae-bc76-8149f05e77af', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-03-20T23:53:04.496431782Z [2024-03-20 23:53:04,496: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:53:04.496689970Z [2024-03-20 23:53:04,496: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:53:04.497180371Z [2024-03-20 23:53:04,496: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:53:04.502027011Z [2024-03-20 23:53:04,501: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af
2024-03-20T23:53:04.606934649Z [2024-03-20 23:53:04,606: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:53:07.773127395Z [2024-03-20 23:53:07,772: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[e064af1a-b51d-4c18-a237-b833e26998bb] succeeded in 6.426156160999881s: None
2024-03-20T23:53:08.108074175Z [2024-03-20 23:53:08,107: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6f27096b-a0a8-45ae-a7b9-d30c500c724b] succeeded in 6.770828805000065s: None
2024-03-20T23:53:09.399573032Z [2024-03-20 23:53:09,399: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[82534495-3a9e-4ac6-91ec-a2445a049e3f] succeeded in 8.058195369000032s: None
2024-03-20T23:53:09.420644060Z [2024-03-20 23:53:09,412: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b20989c8-8b86-4653-90f7-95e466523844] succeeded in 8.084726516000046s: None
2024-03-20T23:54:01.193036603Z [2024-03-20 23:54:01,192: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72acc92e-e2e2-4812-a985-a4739878af9b] received
2024-03-20T23:54:01.195553609Z [2024-03-20 23:54:01,195: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35139d65-926d-4c7e-a21c-040bb0c21f44] received
2024-03-20T23:54:01.198799097Z [2024-03-20 23:54:01,198: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6ea04b8-3224-4cc1-bd87-e1cf36620b92] received
2024-03-20T23:54:01.205647907Z [2024-03-20 23:54:01,205: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da50c8d8-1a45-492e-b1b9-562e3caaa321] received
2024-03-20T23:54:01.208099956Z [2024-03-20 23:54:01,207: INFO/ForkPoolWorker-16] [35139d65-926d-4c7e-a21c-040bb0c21f44] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:54:01.210049811Z [2024-03-20 23:54:01,209: INFO/ForkPoolWorker-15] [72acc92e-e2e2-4812-a985-a4739878af9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:54:01.211995888Z [2024-03-20 23:54:01,211: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[963b5279-165b-44d0-8cd1-d0fac9180f59] received
2024-03-20T23:54:01.212711790Z [2024-03-20 23:54:01,212: INFO/ForkPoolWorker-2] [da50c8d8-1a45-492e-b1b9-562e3caaa321] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:54:01.213084429Z [2024-03-20 23:54:01,212: INFO/ForkPoolWorker-1] [d6ea04b8-3224-4cc1-bd87-e1cf36620b92] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-20T23:54:01.222310945Z [2024-03-20 23:54:01,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[143b7630-9c1a-43df-9fbd-d1b3f86eb949] received
2024-03-20T23:54:01.228397476Z [2024-03-20 23:54:01,228: INFO/ForkPoolWorker-3] [963b5279-165b-44d0-8cd1-d0fac9180f59] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:54:01.234300952Z [2024-03-20 23:54:01,234: INFO/ForkPoolWorker-4] [143b7630-9c1a-43df-9fbd-d1b3f86eb949] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-20T23:54:01.693794980Z [2024-03-20 23:54:01,690: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:54:01.748915239Z [2024-03-20 23:54:01,739: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-20T23:54:01.803053199Z [2024-03-20 23:54:01,782: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:54:01.910680367Z [2024-03-20 23:54:01,902: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:54:02.019465339Z [2024-03-20 23:54:02,014: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-20T23:54:02.194453627Z [2024-03-20 23:54:02,189: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:54:02.344547278Z [2024-03-20 23:54:02,339: INFO/ForkPoolWorker-4] Getting SDNC list
2024-03-20T23:54:02.357976082Z [2024-03-20 23:54:02,355: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:54:02.423809364Z [2024-03-20 23:54:02,423: INFO/ForkPoolWorker-4] Connected to database osm version 1.2
2024-03-20T23:54:02.470580788Z [2024-03-20 23:54:02,470: INFO/ForkPoolWorker-4] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-20T23:54:02.470616328Z [2024-03-20 23:54:02,470: INFO/ForkPoolWorker-4] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-20T23:54:02.471016479Z [2024-03-20 23:54:02,470: INFO/ForkPoolWorker-4] Getting SDNC list OK
2024-03-20T23:54:02.471319813Z [2024-03-20 23:54:02,471: INFO/ForkPoolWorker-4] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-20T23:54:02.567257162Z [2024-03-20 23:54:02,566: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-20T23:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:54:02.624900380Z [2024-03-20 23:54:02,624: INFO/ForkPoolWorker-4] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-20T23:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:54:03.432158191Z [2024-03-20 23:54:03,431: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[143b7630-9c1a-43df-9fbd-d1b3f86eb949] succeeded in 2.208046946999957s: None
2024-03-20T23:54:03.493990663Z [2024-03-20 23:54:03,493: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d6ea04b8-3224-4cc1-bd87-e1cf36620b92] succeeded in 2.293464809999932s: None
2024-03-20T23:54:04.362837531Z [2024-03-20 23:54:04,362: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:54:04.366590139Z [2024-03-20 23:54:04,366: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:54:04.402114264Z [2024-03-20 23:54:04,401: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:54:04.404670859Z [2024-03-20 23:54:04,404: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:54:04.404798165Z [2024-03-20 23:54:04,404: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:54:04.405143555Z [2024-03-20 23:54:04,404: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:54:04.405323755Z [2024-03-20 23:54:04,405: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:54:04.405709973Z [2024-03-20 23:54:04,405: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:54:04.405876869Z [2024-03-20 23:54:04,405: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:54:04.433498610Z [2024-03-20 23:54:04,433: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:54:04.442489642Z [2024-03-20 23:54:04,441: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:54:04.487720320Z [2024-03-20 23:54:04,487: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:54:04.489536525Z [2024-03-20 23:54:04,489: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:54:04.489654273Z [2024-03-20 23:54:04,489: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:54:04.489947484Z [2024-03-20 23:54:04,489: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:54:04.490121100Z [2024-03-20 23:54:04,489: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:54:04.490554537Z [2024-03-20 23:54:04,490: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:54:04.490807069Z [2024-03-20 23:54:04,490: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:54:04.501796918Z [2024-03-20 23:54:04,501: WARNING/ForkPoolWorker-16] Dag 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:54:04.503236435Z [2024-03-20 23:54:04,502: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:54:04.504917008Z [2024-03-20 23:54:04,504: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:54:04.511861681Z [2024-03-20 23:54:04,511: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:54:04.523907301Z [2024-03-20 23:54:04,523: INFO/ForkPoolWorker-3] Getting VIM list
2024-03-20T23:54:04.527847335Z [2024-03-20 23:54:04,527: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:54:04.535411791Z [2024-03-20 23:54:04,535: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:54:04.538547856Z [2024-03-20 23:54:04,538: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:54:04.539478944Z [2024-03-20 23:54:04,539: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:54:04.539844515Z [2024-03-20 23:54:04,539: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:54:04.540261261Z [2024-03-20 23:54:04,539: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:54:04.540973550Z [2024-03-20 23:54:04,540: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:54:04.541156875Z [2024-03-20 23:54:04,540: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:54:04.547464170Z [2024-03-20 23:54:04,546: ERROR/ForkPoolWorker-16] [35139d65-926d-4c7e-a21c-040bb0c21f44] Failed to execute task Dag 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af' could not be found; either it does not exist or it failed to parse..
2024-03-20T23:54:04.547480928Z Traceback (most recent call last):
2024-03-20T23:54:04.547484959Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-20T23:54:04.547489241Z     args.func(args)
2024-03-20T23:54:04.547493100Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-20T23:54:04.547496857Z     return func(*args, **kwargs)
2024-03-20T23:54:04.547499940Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-20T23:54:04.547503086Z     return f(*args, **kwargs)
2024-03-20T23:54:04.547506127Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-20T23:54:04.547509145Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-20T23:54:04.547512483Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-20T23:54:04.547515470Z     raise AirflowException(
2024-03-20T23:54:04.547519373Z airflow.exceptions.AirflowException: Dag 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af' could not be found; either it does not exist or it failed to parse.
2024-03-20T23:54:04.551906943Z [2024-03-20 23:54:04,551: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-20T23:54:04.553325085Z [2024-03-20 23:54:04,553: INFO/ForkPoolWorker-3] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:54:04.553487650Z [2024-03-20 23:54:04,553: INFO/ForkPoolWorker-3] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:54:04.553652044Z [2024-03-20 23:54:04,553: INFO/ForkPoolWorker-3] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:54:04.553720042Z [2024-03-20 23:54:04,553: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-03-20T23:54:04.554027044Z [2024-03-20 23:54:04,553: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:54:04.554474269Z [2024-03-20 23:54:04,554: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:54:04.561700587Z [2024-03-20 23:54:04,561: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:54:04.562251250Z [2024-03-20 23:54:04,562: WARNING/ForkPoolWorker-3] Dag 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:54:04.563225455Z [2024-03-20 23:54:04,562: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:54:04.564205437Z [2024-03-20 23:54:04,564: INFO/ForkPoolWorker-3] Getting VIM list
2024-03-20T23:54:04.567013736Z [2024-03-20 23:54:04,566: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:54:04.603301868Z [2024-03-20 23:54:04,602: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[35139d65-926d-4c7e-a21c-040bb0c21f44] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 35139d65-926d-4c7e-a21c-040bb0c21f44')
2024-03-20T23:54:04.603321414Z Traceback (most recent call last):
2024-03-20T23:54:04.603325458Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-20T23:54:04.603328438Z     R = retval = fun(*args, **kwargs)
2024-03-20T23:54:04.603331523Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-20T23:54:04.603334640Z     return self.run(*args, **kwargs)
2024-03-20T23:54:04.603338318Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-20T23:54:04.603342029Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-20T23:54:04.603345059Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-20T23:54:04.603348493Z     raise AirflowException(msg)
2024-03-20T23:54:04.603352170Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 35139d65-926d-4c7e-a21c-040bb0c21f44
2024-03-20T23:54:04.613782378Z [2024-03-20 23:54:04,613: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-20T23:54:04.629840252Z [2024-03-20 23:54:04,629: INFO/ForkPoolWorker-3] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:54:04.630035475Z [2024-03-20 23:54:04,629: INFO/ForkPoolWorker-3] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:54:04.630202615Z [2024-03-20 23:54:04,630: INFO/ForkPoolWorker-3] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:54:04.630245379Z [2024-03-20 23:54:04,630: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-03-20T23:54:04.630535949Z [2024-03-20 23:54:04,630: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:54:04.631018657Z [2024-03-20 23:54:04,630: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:54:04.634428649Z [2024-03-20 23:54:04,633: ERROR/ForkPoolWorker-3] [963b5279-165b-44d0-8cd1-d0fac9180f59] Failed to execute task Dag 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af' could not be found; either it does not exist or it failed to parse..
2024-03-20T23:54:04.634450472Z Traceback (most recent call last):
2024-03-20T23:54:04.634455841Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-20T23:54:04.634460805Z     args.func(args)
2024-03-20T23:54:04.634465888Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-20T23:54:04.634470892Z     return func(*args, **kwargs)
2024-03-20T23:54:04.634475639Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-20T23:54:04.634479958Z     return f(*args, **kwargs)
2024-03-20T23:54:04.634484311Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-20T23:54:04.634488504Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-20T23:54:04.634492602Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-20T23:54:04.634496692Z     raise AirflowException(
2024-03-20T23:54:04.634501468Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af' could not be found; either it does not exist or it failed to parse.
2024-03-20T23:54:04.647952427Z [2024-03-20 23:54:04,647: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-20T23:54:04.654957838Z [2024-03-20 23:54:04,654: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:54:04.704326988Z [2024-03-20 23:54:04,704: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-20T23:54:04.706488024Z [2024-03-20 23:54:04,706: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:54:04.706681889Z [2024-03-20 23:54:04,706: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:54:04.706957553Z [2024-03-20 23:54:04,706: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:54:04.707142240Z [2024-03-20 23:54:04,707: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-20T23:54:04.707516823Z [2024-03-20 23:54:04,707: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:54:04.707701187Z [2024-03-20 23:54:04,707: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:54:04.742999057Z [2024-03-20 23:54:04,742: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[963b5279-165b-44d0-8cd1-d0fac9180f59] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 963b5279-165b-44d0-8cd1-d0fac9180f59')
2024-03-20T23:54:04.743023472Z Traceback (most recent call last):
2024-03-20T23:54:04.743027727Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-20T23:54:04.743031085Z     R = retval = fun(*args, **kwargs)
2024-03-20T23:54:04.743034522Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-20T23:54:04.743038184Z     return self.run(*args, **kwargs)
2024-03-20T23:54:04.743041833Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-20T23:54:04.743045492Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-20T23:54:04.743048525Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-20T23:54:04.743052374Z     raise AirflowException(msg)
2024-03-20T23:54:04.743056373Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 963b5279-165b-44d0-8cd1-d0fac9180f59
2024-03-20T23:54:04.796578945Z [2024-03-20 23:54:04,796: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:54:07.381667850Z [2024-03-20 23:54:07,381: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[72acc92e-e2e2-4812-a985-a4739878af9b] succeeded in 6.186377966000009s: None
2024-03-20T23:54:08.345806618Z [2024-03-20 23:54:08,345: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[da50c8d8-1a45-492e-b1b9-562e3caaa321] succeeded in 7.138670274000106s: None
2024-03-20T23:54:16.479665385Z [2024-03-20 23:54:16,479: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c12fda0-1d6c-4fb4-8b2b-083de3214b0a] received
2024-03-20T23:54:16.488516965Z [2024-03-20 23:54:16,488: INFO/ForkPoolWorker-15] [6c12fda0-1d6c-4fb4-8b2b-083de3214b0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:54:16.489900346Z [2024-03-20 23:54:16,489: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef7d562a-4b17-4951-bf6f-7917141a8a0c] received
2024-03-20T23:54:16.500664573Z [2024-03-20 23:54:16,500: INFO/ForkPoolWorker-16] [ef7d562a-4b17-4951-bf6f-7917141a8a0c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:54:16.768086076Z [2024-03-20 23:54:16,765: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:54:16.778922997Z [2024-03-20 23:54:16,775: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:54:17.841848451Z [2024-03-20 23:54:17,841: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:54:17.845130122Z [2024-03-20 23:54:17,844: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:54:17.873289499Z [2024-03-20 23:54:17,873: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:54:17.874845820Z [2024-03-20 23:54:17,874: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:54:17.874888865Z [2024-03-20 23:54:17,874: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:54:17.875041882Z [2024-03-20 23:54:17,874: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:54:17.875081500Z [2024-03-20 23:54:17,875: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:54:17.875377403Z [2024-03-20 23:54:17,875: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:54:17.875440123Z [2024-03-20 23:54:17,875: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:54:17.883546638Z [2024-03-20 23:54:17,883: WARNING/ForkPoolWorker-15] Dag 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:54:17.884419657Z [2024-03-20 23:54:17,883: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:54:17.885211459Z [2024-03-20 23:54:17,884: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:54:17.885947322Z [2024-03-20 23:54:17,885: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:54:17.888369495Z [2024-03-20 23:54:17,887: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:54:17.889976270Z [2024-03-20 23:54:17,889: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:54:17.898483922Z [2024-03-20 23:54:17,898: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:54:17.899932983Z [2024-03-20 23:54:17,899: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:54:17.900004390Z [2024-03-20 23:54:17,899: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:54:17.900146286Z [2024-03-20 23:54:17,899: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:54:17.900296036Z [2024-03-20 23:54:17,900: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:54:17.900762576Z [2024-03-20 23:54:17,900: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:54:17.900835315Z [2024-03-20 23:54:17,900: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:54:17.904294703Z [2024-03-20 23:54:17,903: ERROR/ForkPoolWorker-15] [6c12fda0-1d6c-4fb4-8b2b-083de3214b0a] Failed to execute task Dag 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af' could not be found; either it does not exist or it failed to parse..
2024-03-20T23:54:17.904407326Z Traceback (most recent call last):
2024-03-20T23:54:17.904418336Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-20T23:54:17.904446998Z     args.func(args)
2024-03-20T23:54:17.904455937Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-20T23:54:17.904463939Z     return func(*args, **kwargs)
2024-03-20T23:54:17.904472038Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-20T23:54:17.904479348Z     return f(*args, **kwargs)
2024-03-20T23:54:17.904485912Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-20T23:54:17.904494071Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-20T23:54:17.904500866Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-20T23:54:17.904527633Z     raise AirflowException(
2024-03-20T23:54:17.904535602Z airflow.exceptions.AirflowException: Dag 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af' could not be found; either it does not exist or it failed to parse.
2024-03-20T23:54:17.913425565Z [2024-03-20 23:54:17,913: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:54:17.914740136Z [2024-03-20 23:54:17,914: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:54:17.914953906Z [2024-03-20 23:54:17,914: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:54:17.915281642Z [2024-03-20 23:54:17,915: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:54:17.915478995Z [2024-03-20 23:54:17,915: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:54:17.915907106Z [2024-03-20 23:54:17,915: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:54:17.916098267Z [2024-03-20 23:54:17,915: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:54:17.924944579Z [2024-03-20 23:54:17,924: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:54:17.926087503Z [2024-03-20 23:54:17,925: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:54:17.927072590Z [2024-03-20 23:54:17,926: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:54:17.930483813Z [2024-03-20 23:54:17,930: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:54:17.942657706Z [2024-03-20 23:54:17,942: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6c12fda0-1d6c-4fb4-8b2b-083de3214b0a] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6c12fda0-1d6c-4fb4-8b2b-083de3214b0a')
2024-03-20T23:54:17.942681383Z Traceback (most recent call last):
2024-03-20T23:54:17.942685340Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-20T23:54:17.942688497Z     R = retval = fun(*args, **kwargs)
2024-03-20T23:54:17.942691458Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-20T23:54:17.942694386Z     return self.run(*args, **kwargs)
2024-03-20T23:54:17.942711705Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-20T23:54:17.942715767Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-20T23:54:17.942718994Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-20T23:54:17.942722585Z     raise AirflowException(msg)
2024-03-20T23:54:17.942726046Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6c12fda0-1d6c-4fb4-8b2b-083de3214b0a
2024-03-20T23:54:17.945383639Z [2024-03-20 23:54:17,945: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:54:17.947070960Z [2024-03-20 23:54:17,946: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:54:17.947308624Z [2024-03-20 23:54:17,947: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:54:17.947579908Z [2024-03-20 23:54:17,947: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:54:17.947787600Z [2024-03-20 23:54:17,947: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:54:17.948293152Z [2024-03-20 23:54:17,947: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:54:17.948551058Z [2024-03-20 23:54:17,948: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:54:17.953360799Z [2024-03-20 23:54:17,952: ERROR/ForkPoolWorker-16] [ef7d562a-4b17-4951-bf6f-7917141a8a0c] Failed to execute task Dag 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af' could not be found; either it does not exist or it failed to parse..
2024-03-20T23:54:17.953373237Z Traceback (most recent call last):
2024-03-20T23:54:17.953377966Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-20T23:54:17.953381586Z     args.func(args)
2024-03-20T23:54:17.953384973Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-20T23:54:17.953388652Z     return func(*args, **kwargs)
2024-03-20T23:54:17.953391630Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-20T23:54:17.953394837Z     return f(*args, **kwargs)
2024-03-20T23:54:17.953397781Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-20T23:54:17.953400700Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-20T23:54:17.953403682Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-20T23:54:17.953406593Z     raise AirflowException(
2024-03-20T23:54:17.953427278Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af' could not be found; either it does not exist or it failed to parse.
2024-03-20T23:54:17.987607768Z [2024-03-20 23:54:17,986: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ef7d562a-4b17-4951-bf6f-7917141a8a0c] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id ef7d562a-4b17-4951-bf6f-7917141a8a0c')
2024-03-20T23:54:17.987682854Z Traceback (most recent call last):
2024-03-20T23:54:17.987692794Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-20T23:54:17.987700828Z     R = retval = fun(*args, **kwargs)
2024-03-20T23:54:17.987759154Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-20T23:54:17.987767496Z     return self.run(*args, **kwargs)
2024-03-20T23:54:17.987776510Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-20T23:54:17.987786318Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-20T23:54:17.987793894Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-20T23:54:17.987831411Z     raise AirflowException(msg)
2024-03-20T23:54:17.987846160Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id ef7d562a-4b17-4951-bf6f-7917141a8a0c
2024-03-20T23:55:01.361500112Z [2024-03-20 23:55:01,361: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8de1712-6c10-43c4-89d5-f7a31bccaea7] received
2024-03-20T23:55:01.367802947Z [2024-03-20 23:55:01,367: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39a3f680-ed20-4ec5-a23e-1bb6aec60146] received
2024-03-20T23:55:01.371706188Z [2024-03-20 23:55:01,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f606b079-2be9-4e7c-96c8-216158f64c80] received
2024-03-20T23:55:01.378658850Z [2024-03-20 23:55:01,378: INFO/ForkPoolWorker-16] [39a3f680-ed20-4ec5-a23e-1bb6aec60146] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:55:01.379341685Z [2024-03-20 23:55:01,379: INFO/ForkPoolWorker-15] [b8de1712-6c10-43c4-89d5-f7a31bccaea7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:55:01.383006362Z [2024-03-20 23:55:01,382: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3cdc2ca-cc60-4223-a720-c1ee9c882dcd] received
2024-03-20T23:55:01.386766014Z [2024-03-20 23:55:01,386: INFO/ForkPoolWorker-1] [f606b079-2be9-4e7c-96c8-216158f64c80] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-20T23:55:01.396867101Z [2024-03-20 23:55:01,396: INFO/ForkPoolWorker-2] [c3cdc2ca-cc60-4223-a720-c1ee9c882dcd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:55:01.403135704Z [2024-03-20 23:55:01,402: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[718f0c5c-69e3-40d7-8e65-7ecd06c16f25] received
2024-03-20T23:55:01.409861373Z [2024-03-20 23:55:01,409: INFO/ForkPoolWorker-3] [718f0c5c-69e3-40d7-8e65-7ecd06c16f25] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:55:01.417617018Z [2024-03-20 23:55:01,417: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0fd92160-3877-404e-87b7-a1c28507db6e] received
2024-03-20T23:55:01.428743221Z [2024-03-20 23:55:01,428: INFO/ForkPoolWorker-4] [0fd92160-3877-404e-87b7-a1c28507db6e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:55:01.430904666Z [2024-03-20 23:55:01,430: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3785c422-43cc-4ad6-9b3a-ef32487c43c1] received
2024-03-20T23:55:01.450923851Z [2024-03-20 23:55:01,450: INFO/ForkPoolWorker-5] [3785c422-43cc-4ad6-9b3a-ef32487c43c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:55:01.766282168Z [2024-03-20 23:55:01,763: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:55:01.850049719Z [2024-03-20 23:55:01,841: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:55:01.880114972Z [2024-03-20 23:55:01,875: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:55:02.134236734Z [2024-03-20 23:55:02,130: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:55:02.209809118Z [2024-03-20 23:55:02,203: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:55:02.219987193Z [2024-03-20 23:55:02,216: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-20T23:55:02.506159656Z [2024-03-20 23:55:02,501: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:55:02.991368917Z [2024-03-20 23:55:02,990: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-20T23:55:02.998700116Z [2024-03-20 23:55:02,997: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:55:03.045048844Z [2024-03-20 23:55:03,044: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-20T23:55:03.053064722Z [2024-03-20 23:55:03,052: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-20T23:55:03.054077414Z [2024-03-20 23:55:03,053: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-20T23:55:03.054356428Z [2024-03-20 23:55:03,054: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-20T23:55:03.054835243Z [2024-03-20 23:55:03,054: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-20T23:55:03.251528241Z [2024-03-20 23:55:03,251: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-20T23:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:55:04.770559832Z [2024-03-20 23:55:04,770: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:55:04.805072511Z [2024-03-20 23:55:04,804: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:55:04.826247522Z [2024-03-20 23:55:04,825: INFO/ForkPoolWorker-5] Getting VIM list
2024-03-20T23:55:04.830085188Z [2024-03-20 23:55:04,829: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:55:04.862950909Z [2024-03-20 23:55:04,862: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f606b079-2be9-4e7c-96c8-216158f64c80] succeeded in 3.488025357999959s: None
2024-03-20T23:55:04.871478374Z [2024-03-20 23:55:04,871: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:55:04.878087960Z [2024-03-20 23:55:04,877: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:55:04.878117791Z [2024-03-20 23:55:04,877: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:55:04.878350615Z [2024-03-20 23:55:04,878: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:55:04.878476960Z [2024-03-20 23:55:04,878: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:55:04.879169660Z [2024-03-20 23:55:04,878: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:55:04.879181222Z [2024-03-20 23:55:04,878: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:55:04.904449488Z [2024-03-20 23:55:04,897: INFO/ForkPoolWorker-5] Connected to database osm version 1.2
2024-03-20T23:55:04.906303336Z [2024-03-20 23:55:04,906: INFO/ForkPoolWorker-5] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:55:04.906322810Z [2024-03-20 23:55:04,906: INFO/ForkPoolWorker-5] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:55:04.906447599Z [2024-03-20 23:55:04,906: INFO/ForkPoolWorker-5] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:55:04.906530516Z [2024-03-20 23:55:04,906: INFO/ForkPoolWorker-5] Getting VIM list OK
2024-03-20T23:55:04.906991777Z [2024-03-20 23:55:04,906: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:55:04.907077073Z [2024-03-20 23:55:04,906: INFO/ForkPoolWorker-5] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:55:05.097763340Z [2024-03-20 23:55:05,097: INFO/ForkPoolWorker-5] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:55:05.115916912Z [2024-03-20 23:55:05,115: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-20T23:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:55:05.565201012Z [2024-03-20 23:55:05,564: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:55:05.569012201Z [2024-03-20 23:55:05,568: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:55:05.612403740Z [2024-03-20 23:55:05,612: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:55:05.617392289Z [2024-03-20 23:55:05,617: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:55:05.617429543Z [2024-03-20 23:55:05,617: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:55:05.617604710Z [2024-03-20 23:55:05,617: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:55:05.617687903Z [2024-03-20 23:55:05,617: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:55:05.618076756Z [2024-03-20 23:55:05,617: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:55:05.618105266Z [2024-03-20 23:55:05,617: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:55:05.626285512Z [2024-03-20 23:55:05,626: WARNING/ForkPoolWorker-15] Dag 'vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:55:05.629425177Z [2024-03-20 23:55:05,628: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:55:05.630929509Z [2024-03-20 23:55:05,630: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:55:05.636413107Z [2024-03-20 23:55:05,635: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:55:05.681670030Z [2024-03-20 23:55:05,681: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:55:05.683632758Z [2024-03-20 23:55:05,683: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:55:05.683874831Z [2024-03-20 23:55:05,683: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:55:05.684176280Z [2024-03-20 23:55:05,683: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:55:05.684381999Z [2024-03-20 23:55:05,684: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:55:05.684759895Z [2024-03-20 23:55:05,684: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:55:05.684963554Z [2024-03-20 23:55:05,684: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:55:05.690062309Z [2024-03-20 23:55:05,689: ERROR/ForkPoolWorker-15] [b8de1712-6c10-43c4-89d5-f7a31bccaea7] Failed to execute task Dag 'vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af' could not be found; either it does not exist or it failed to parse..
2024-03-20T23:55:05.690113506Z Traceback (most recent call last):
2024-03-20T23:55:05.690118420Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-20T23:55:05.690122305Z     args.func(args)
2024-03-20T23:55:05.690126873Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-20T23:55:05.690133005Z     return func(*args, **kwargs)
2024-03-20T23:55:05.690137363Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-20T23:55:05.690142599Z     return f(*args, **kwargs)
2024-03-20T23:55:05.690147117Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-20T23:55:05.690151960Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-20T23:55:05.690157266Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-20T23:55:05.690161913Z     raise AirflowException(
2024-03-20T23:55:05.690167468Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af' could not be found; either it does not exist or it failed to parse.
2024-03-20T23:55:05.734328553Z [2024-03-20 23:55:05,733: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b8de1712-6c10-43c4-89d5-f7a31bccaea7] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id b8de1712-6c10-43c4-89d5-f7a31bccaea7')
2024-03-20T23:55:05.734358575Z Traceback (most recent call last):
2024-03-20T23:55:05.734364710Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-20T23:55:05.734369861Z     R = retval = fun(*args, **kwargs)
2024-03-20T23:55:05.734384218Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-20T23:55:05.734388549Z     return self.run(*args, **kwargs)
2024-03-20T23:55:05.734393829Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-20T23:55:05.734398934Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-20T23:55:05.734403505Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-20T23:55:05.734409082Z     raise AirflowException(msg)
2024-03-20T23:55:05.734414466Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id b8de1712-6c10-43c4-89d5-f7a31bccaea7
2024-03-20T23:55:05.868399958Z [2024-03-20 23:55:05,867: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-20T23:55:05.870987890Z [2024-03-20 23:55:05,870: INFO/ForkPoolWorker-3] Getting VIM list
2024-03-20T23:55:05.873802460Z [2024-03-20 23:55:05,873: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:55:05.874746932Z [2024-03-20 23:55:05,874: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:55:05.907973344Z [2024-03-20 23:55:05,907: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-20T23:55:05.908628302Z [2024-03-20 23:55:05,908: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-20T23:55:05.909602834Z [2024-03-20 23:55:05,909: INFO/ForkPoolWorker-3] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:55:05.909712856Z [2024-03-20 23:55:05,909: INFO/ForkPoolWorker-3] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:55:05.909890588Z [2024-03-20 23:55:05,909: INFO/ForkPoolWorker-3] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:55:05.910006296Z [2024-03-20 23:55:05,909: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-03-20T23:55:05.910517854Z [2024-03-20 23:55:05,910: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:55:05.910625848Z [2024-03-20 23:55:05,910: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:55:05.911349058Z [2024-03-20 23:55:05,911: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:55:05.911579856Z [2024-03-20 23:55:05,911: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:55:05.911942606Z [2024-03-20 23:55:05,911: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:55:05.912135235Z [2024-03-20 23:55:05,912: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-20T23:55:05.912564822Z [2024-03-20 23:55:05,912: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:55:05.912760797Z [2024-03-20 23:55:05,912: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:55:05.920845998Z [2024-03-20 23:55:05,920: WARNING/ForkPoolWorker-2] Dag 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:55:05.922122299Z [2024-03-20 23:55:05,921: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:55:05.923938006Z [2024-03-20 23:55:05,923: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-20T23:55:05.927746402Z [2024-03-20 23:55:05,927: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:55:05.959915809Z [2024-03-20 23:55:05,959: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-20T23:55:05.962444828Z [2024-03-20 23:55:05,962: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:55:05.962848754Z [2024-03-20 23:55:05,962: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:55:05.963419473Z [2024-03-20 23:55:05,963: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:55:05.964770555Z [2024-03-20 23:55:05,964: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-20T23:55:05.965302700Z [2024-03-20 23:55:05,965: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:55:05.965318990Z [2024-03-20 23:55:05,965: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:55:05.969956053Z [2024-03-20 23:55:05,969: ERROR/ForkPoolWorker-2] [c3cdc2ca-cc60-4223-a720-c1ee9c882dcd] Failed to execute task Dag 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af' could not be found; either it does not exist or it failed to parse..
2024-03-20T23:55:05.969974375Z Traceback (most recent call last):
2024-03-20T23:55:05.969978633Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-20T23:55:05.969982520Z     args.func(args)
2024-03-20T23:55:05.969986991Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-20T23:55:05.969990753Z     return func(*args, **kwargs)
2024-03-20T23:55:05.969994116Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-20T23:55:05.969997357Z     return f(*args, **kwargs)
2024-03-20T23:55:05.970000993Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-20T23:55:05.970004313Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-20T23:55:05.970007540Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-20T23:55:05.970010678Z     raise AirflowException(
2024-03-20T23:55:05.970019331Z airflow.exceptions.AirflowException: Dag 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af' could not be found; either it does not exist or it failed to parse.
2024-03-20T23:55:05.971097367Z [2024-03-20 23:55:05,970: INFO/ForkPoolWorker-4] Getting VIM list
2024-03-20T23:55:05.975490779Z [2024-03-20 23:55:05,975: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:55:06.012550149Z [2024-03-20 23:55:06,010: INFO/ForkPoolWorker-4] Connected to database osm version 1.2
2024-03-20T23:55:06.012570439Z [2024-03-20 23:55:06,012: INFO/ForkPoolWorker-4] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:55:06.012574064Z [2024-03-20 23:55:06,012: INFO/ForkPoolWorker-4] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:55:06.012577976Z [2024-03-20 23:55:06,012: INFO/ForkPoolWorker-4] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:55:06.012582308Z [2024-03-20 23:55:06,012: INFO/ForkPoolWorker-4] Getting VIM list OK
2024-03-20T23:55:06.013048499Z [2024-03-20 23:55:06,012: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:55:06.013178202Z [2024-03-20 23:55:06,013: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:55:06.019742034Z [2024-03-20 23:55:06,017: INFO/ForkPoolWorker-3] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:55:06.029402389Z [2024-03-20 23:55:06,029: WARNING/ForkPoolWorker-4] Dag 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:55:06.030891012Z [2024-03-20 23:55:06,029: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:55:06.033053183Z [2024-03-20 23:55:06,032: INFO/ForkPoolWorker-4] Getting VIM list
2024-03-20T23:55:06.033747063Z [2024-03-20 23:55:06,033: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c3cdc2ca-cc60-4223-a720-c1ee9c882dcd] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c3cdc2ca-cc60-4223-a720-c1ee9c882dcd')
2024-03-20T23:55:06.033759185Z Traceback (most recent call last):
2024-03-20T23:55:06.033763288Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-20T23:55:06.033766490Z     R = retval = fun(*args, **kwargs)
2024-03-20T23:55:06.033769589Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-20T23:55:06.033772819Z     return self.run(*args, **kwargs)
2024-03-20T23:55:06.033776539Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-20T23:55:06.033780270Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-20T23:55:06.033783800Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-20T23:55:06.033787823Z     raise AirflowException(msg)
2024-03-20T23:55:06.033791986Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c3cdc2ca-cc60-4223-a720-c1ee9c882dcd
2024-03-20T23:55:06.036468298Z [2024-03-20 23:55:06,036: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:55:06.053401716Z [2024-03-20 23:55:06,053: INFO/ForkPoolWorker-4] Connected to database osm version 1.2
2024-03-20T23:55:06.065028340Z [2024-03-20 23:55:06,057: INFO/ForkPoolWorker-4] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:55:06.065302034Z [2024-03-20 23:55:06,065: INFO/ForkPoolWorker-4] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:55:06.065684527Z [2024-03-20 23:55:06,065: INFO/ForkPoolWorker-4] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:55:06.065920968Z [2024-03-20 23:55:06,065: INFO/ForkPoolWorker-4] Getting VIM list OK
2024-03-20T23:55:06.066272363Z [2024-03-20 23:55:06,066: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:55:06.066385083Z [2024-03-20 23:55:06,066: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:55:06.070319025Z [2024-03-20 23:55:06,069: ERROR/ForkPoolWorker-4] [0fd92160-3877-404e-87b7-a1c28507db6e] Failed to execute task Dag 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af' could not be found; either it does not exist or it failed to parse..
2024-03-20T23:55:06.070333281Z Traceback (most recent call last):
2024-03-20T23:55:06.070337144Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-20T23:55:06.070340830Z     args.func(args)
2024-03-20T23:55:06.070344465Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-20T23:55:06.070362491Z     return func(*args, **kwargs)
2024-03-20T23:55:06.070365917Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-20T23:55:06.070368907Z     return f(*args, **kwargs)
2024-03-20T23:55:06.070371874Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-20T23:55:06.070375357Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-20T23:55:06.070378342Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-20T23:55:06.070381255Z     raise AirflowException(
2024-03-20T23:55:06.070385013Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af' could not be found; either it does not exist or it failed to parse.
2024-03-20T23:55:06.111375344Z [2024-03-20 23:55:06,110: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[39a3f680-ed20-4ec5-a23e-1bb6aec60146] succeeded in 4.741626047999944s: None
2024-03-20T23:55:06.115034593Z [2024-03-20 23:55:06,114: ERROR/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[0fd92160-3877-404e-87b7-a1c28507db6e] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0fd92160-3877-404e-87b7-a1c28507db6e')
2024-03-20T23:55:06.115051977Z Traceback (most recent call last):
2024-03-20T23:55:06.115056012Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-20T23:55:06.115059185Z     R = retval = fun(*args, **kwargs)
2024-03-20T23:55:06.115062463Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-20T23:55:06.115065627Z     return self.run(*args, **kwargs)
2024-03-20T23:55:06.115069328Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-20T23:55:06.115073456Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-20T23:55:06.115076768Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-20T23:55:06.115080656Z     raise AirflowException(msg)
2024-03-20T23:55:06.115084392Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0fd92160-3877-404e-87b7-a1c28507db6e
2024-03-20T23:55:06.679512908Z [2024-03-20 23:55:06,679: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59c9d9ce-baab-4ac4-a3fc-b9fd33f43103] received
2024-03-20T23:55:06.692609202Z [2024-03-20 23:55:06,692: INFO/ForkPoolWorker-15] [59c9d9ce-baab-4ac4-a3fc-b9fd33f43103] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:55:07.033051187Z [2024-03-20 23:55:07,029: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:55:07.376177236Z [2024-03-20 23:55:07,375: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[3785c422-43cc-4ad6-9b3a-ef32487c43c1] succeeded in 5.9422994149999795s: None
2024-03-20T23:55:08.354772857Z [2024-03-20 23:55:08,354: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:55:08.358665997Z [2024-03-20 23:55:08,358: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:55:08.380093449Z [2024-03-20 23:55:08,379: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:55:08.382017064Z [2024-03-20 23:55:08,381: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:55:08.382315266Z [2024-03-20 23:55:08,382: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:55:08.382586924Z [2024-03-20 23:55:08,382: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:55:08.382840582Z [2024-03-20 23:55:08,382: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:55:08.383350395Z [2024-03-20 23:55:08,383: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:55:08.383525553Z [2024-03-20 23:55:08,383: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:55:08.475893840Z [2024-03-20 23:55:08,473: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-20T23:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:55:08.696839655Z [2024-03-20 23:55:08,696: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[718f0c5c-69e3-40d7-8e65-7ecd06c16f25] succeeded in 7.292119814000216s: None
2024-03-20T23:55:09.205503229Z [2024-03-20 23:55:09,204: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[59c9d9ce-baab-4ac4-a3fc-b9fd33f43103] succeeded in 2.5236599730001217s: None
2024-03-20T23:55:09.316354759Z [2024-03-20 23:55:09,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8a174a7-7198-4d26-82e8-10c7e83b2243] received
2024-03-20T23:55:09.322633577Z [2024-03-20 23:55:09,322: INFO/ForkPoolWorker-15] [c8a174a7-7198-4d26-82e8-10c7e83b2243] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-20T23:55:09.740121318Z [2024-03-20 23:55:09,736: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:55:10.954928120Z [2024-03-20 23:55:10,954: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:55:10.958291657Z [2024-03-20 23:55:10,957: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:55:10.988416143Z [2024-03-20 23:55:10,988: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:55:10.990377125Z [2024-03-20 23:55:10,990: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:55:10.990397039Z [2024-03-20 23:55:10,990: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:55:10.990543164Z [2024-03-20 23:55:10,990: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:55:10.990559638Z [2024-03-20 23:55:10,990: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:55:10.990902822Z [2024-03-20 23:55:10,990: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:55:10.990930286Z [2024-03-20 23:55:10,990: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:55:11.105289198Z [2024-03-20 23:55:11,104: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-20T23:50:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:55:13.305053496Z [2024-03-20 23:55:13,304: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c8a174a7-7198-4d26-82e8-10c7e83b2243] succeeded in 3.9867966950000664s: None
2024-03-20T23:55:13.313776601Z [2024-03-20 23:55:13,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2cf3af3-be4d-4db9-b985-784779519641] received
2024-03-20T23:55:13.321494058Z [2024-03-20 23:55:13,321: INFO/ForkPoolWorker-15] [f2cf3af3-be4d-4db9-b985-784779519641] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:55:13.638391171Z [2024-03-20 23:55:13,634: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:55:14.859536259Z [2024-03-20 23:55:14,859: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:55:14.863254708Z [2024-03-20 23:55:14,862: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:55:14.883878437Z [2024-03-20 23:55:14,883: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:55:14.885207282Z [2024-03-20 23:55:14,884: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:55:14.885224062Z [2024-03-20 23:55:14,885: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:55:14.885348512Z [2024-03-20 23:55:14,885: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:55:14.885364434Z [2024-03-20 23:55:14,885: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:55:14.885623187Z [2024-03-20 23:55:14,885: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:55:14.885633003Z [2024-03-20 23:55:14,885: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:55:14.972233287Z [2024-03-20 23:55:14,971: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-20T23:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:55:15.515657395Z [2024-03-20 23:55:15,515: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f2cf3af3-be4d-4db9-b985-784779519641] succeeded in 2.199907916000029s: None
2024-03-20T23:55:17.033255009Z [2024-03-20 23:55:17,033: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b46f6f2b-6488-4df5-890b-6f44f683875b] received
2024-03-20T23:55:17.041411664Z [2024-03-20 23:55:17,041: INFO/ForkPoolWorker-15] [b46f6f2b-6488-4df5-890b-6f44f683875b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-20T23:55:17.045295812Z [2024-03-20 23:55:17,044: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[030f85cc-911b-4ce8-a09b-0b4822d5b92f] received
2024-03-20T23:55:17.048972500Z [2024-03-20 23:55:17,048: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bdfaa5e0-a434-4bc3-b70d-7a74ae4e1dc6] received
2024-03-20T23:55:17.056792614Z [2024-03-20 23:55:17,056: INFO/ForkPoolWorker-1] [bdfaa5e0-a434-4bc3-b70d-7a74ae4e1dc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:55:17.057669100Z [2024-03-20 23:55:17,057: INFO/ForkPoolWorker-16] [030f85cc-911b-4ce8-a09b-0b4822d5b92f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:55:17.351332641Z [2024-03-20 23:55:17,348: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:55:17.407583674Z [2024-03-20 23:55:17,404: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:55:17.425511404Z [2024-03-20 23:55:17,422: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:55:18.456577519Z [2024-03-20 23:55:18,456: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:55:18.486089286Z [2024-03-20 23:55:18,464: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:55:18.532524387Z [2024-03-20 23:55:18,532: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:55:18.537416050Z [2024-03-20 23:55:18,537: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:55:18.537716115Z [2024-03-20 23:55:18,537: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:55:18.538046342Z [2024-03-20 23:55:18,537: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:55:18.538261547Z [2024-03-20 23:55:18,538: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:55:18.538622964Z [2024-03-20 23:55:18,538: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:55:18.538818687Z [2024-03-20 23:55:18,538: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:55:18.546428535Z [2024-03-20 23:55:18,546: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:55:18.547929807Z [2024-03-20 23:55:18,546: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:55:18.548937422Z [2024-03-20 23:55:18,548: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:55:18.552150564Z [2024-03-20 23:55:18,551: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:55:18.565829695Z [2024-03-20 23:55:18,565: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-20T23:55:18.569406710Z [2024-03-20 23:55:18,568: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:55:18.570980737Z [2024-03-20 23:55:18,570: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:55:18.573908438Z [2024-03-20 23:55:18,573: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:55:18.574123858Z [2024-03-20 23:55:18,573: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:55:18.574387496Z [2024-03-20 23:55:18,574: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:55:18.574585942Z [2024-03-20 23:55:18,574: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:55:18.575148009Z [2024-03-20 23:55:18,574: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:55:18.575377449Z [2024-03-20 23:55:18,575: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:55:18.579479741Z [2024-03-20 23:55:18,578: ERROR/ForkPoolWorker-16] [030f85cc-911b-4ce8-a09b-0b4822d5b92f] Failed to execute task Dag 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af' could not be found; either it does not exist or it failed to parse..
2024-03-20T23:55:18.579493980Z Traceback (most recent call last):
2024-03-20T23:55:18.579541201Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-20T23:55:18.579545503Z     args.func(args)
2024-03-20T23:55:18.579548857Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-20T23:55:18.579552460Z     return func(*args, **kwargs)
2024-03-20T23:55:18.579555456Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-20T23:55:18.579558479Z     return f(*args, **kwargs)
2024-03-20T23:55:18.579561645Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-20T23:55:18.579564686Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-20T23:55:18.579571583Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-20T23:55:18.579574656Z     raise AirflowException(
2024-03-20T23:55:18.579578279Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af' could not be found; either it does not exist or it failed to parse.
2024-03-20T23:55:18.591259201Z [2024-03-20 23:55:18,591: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-20T23:55:18.592734573Z [2024-03-20 23:55:18,592: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:55:18.592866852Z [2024-03-20 23:55:18,592: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:55:18.593022435Z [2024-03-20 23:55:18,592: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:55:18.593193212Z [2024-03-20 23:55:18,593: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-20T23:55:18.594031934Z [2024-03-20 23:55:18,593: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:55:18.594146398Z [2024-03-20 23:55:18,593: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:55:18.600749508Z [2024-03-20 23:55:18,600: WARNING/ForkPoolWorker-1] Dag 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:55:18.602185052Z [2024-03-20 23:55:18,600: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:55:18.603028421Z [2024-03-20 23:55:18,602: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-20T23:55:18.605901431Z [2024-03-20 23:55:18,605: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:55:18.611525693Z [2024-03-20 23:55:18,610: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[030f85cc-911b-4ce8-a09b-0b4822d5b92f] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 030f85cc-911b-4ce8-a09b-0b4822d5b92f')
2024-03-20T23:55:18.611533301Z Traceback (most recent call last):
2024-03-20T23:55:18.611537069Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-20T23:55:18.611543758Z     R = retval = fun(*args, **kwargs)
2024-03-20T23:55:18.611546926Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-20T23:55:18.611550122Z     return self.run(*args, **kwargs)
2024-03-20T23:55:18.611553768Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-20T23:55:18.611557114Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-20T23:55:18.611560183Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-20T23:55:18.611565370Z     raise AirflowException(msg)
2024-03-20T23:55:18.611581849Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 030f85cc-911b-4ce8-a09b-0b4822d5b92f
2024-03-20T23:55:18.621528245Z [2024-03-20 23:55:18,621: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-20T23:55:18.623673689Z [2024-03-20 23:55:18,623: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:55:18.623726022Z [2024-03-20 23:55:18,623: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:55:18.623862094Z [2024-03-20 23:55:18,623: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:55:18.623942617Z [2024-03-20 23:55:18,623: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-20T23:55:18.624617006Z [2024-03-20 23:55:18,624: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:55:18.624643301Z [2024-03-20 23:55:18,624: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:55:18.628198357Z [2024-03-20 23:55:18,627: ERROR/ForkPoolWorker-1] [bdfaa5e0-a434-4bc3-b70d-7a74ae4e1dc6] Failed to execute task Dag 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af' could not be found; either it does not exist or it failed to parse..
2024-03-20T23:55:18.628205029Z Traceback (most recent call last):
2024-03-20T23:55:18.628208813Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-20T23:55:18.628212526Z     args.func(args)
2024-03-20T23:55:18.628215656Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-20T23:55:18.628219199Z     return func(*args, **kwargs)
2024-03-20T23:55:18.628222392Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-20T23:55:18.628225687Z     return f(*args, **kwargs)
2024-03-20T23:55:18.628228703Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-20T23:55:18.628231776Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-20T23:55:18.628234684Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-20T23:55:18.628237658Z     raise AirflowException(
2024-03-20T23:55:18.628248000Z airflow.exceptions.AirflowException: Dag 'vim_status_c2d3576c-57a2-44ae-bc76-8149f05e77af' could not be found; either it does not exist or it failed to parse.
2024-03-20T23:55:18.644053846Z [2024-03-20 23:55:18,643: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:55:18.647660686Z [2024-03-20 23:55:18,647: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:55:18.666879997Z [2024-03-20 23:55:18,666: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:55:18.668243830Z [2024-03-20 23:55:18,667: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:55:18.668261442Z [2024-03-20 23:55:18,668: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:55:18.668472186Z [2024-03-20 23:55:18,668: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:55:18.668496585Z [2024-03-20 23:55:18,668: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:55:18.668712669Z [2024-03-20 23:55:18,668: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:55:18.668736556Z [2024-03-20 23:55:18,668: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:55:18.669718433Z [2024-03-20 23:55:18,668: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bdfaa5e0-a434-4bc3-b70d-7a74ae4e1dc6] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id bdfaa5e0-a434-4bc3-b70d-7a74ae4e1dc6')
2024-03-20T23:55:18.669734095Z Traceback (most recent call last):
2024-03-20T23:55:18.669767025Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-20T23:55:18.669799044Z     R = retval = fun(*args, **kwargs)
2024-03-20T23:55:18.669807735Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-20T23:55:18.669816272Z     return self.run(*args, **kwargs)
2024-03-20T23:55:18.669825454Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-20T23:55:18.669834414Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-20T23:55:18.669842645Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-20T23:55:18.669851642Z     raise AirflowException(msg)
2024-03-20T23:55:18.669860844Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id bdfaa5e0-a434-4bc3-b70d-7a74ae4e1dc6
2024-03-20T23:55:18.676967092Z [2024-03-20 23:55:18,676: WARNING/ForkPoolWorker-15] Dag 'vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:55:18.677718963Z [2024-03-20 23:55:18,676: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-20T23:55:18.678552757Z [2024-03-20 23:55:18,678: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-20T23:55:18.681399456Z [2024-03-20 23:55:18,681: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:55:18.692275899Z [2024-03-20 23:55:18,692: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:55:18.693525835Z [2024-03-20 23:55:18,693: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:55:18.693536911Z [2024-03-20 23:55:18,693: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:55:18.693666038Z [2024-03-20 23:55:18,693: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:55:18.693671496Z [2024-03-20 23:55:18,693: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-20T23:55:18.693875273Z [2024-03-20 23:55:18,693: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-20T23:55:18.693883087Z [2024-03-20 23:55:18,693: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:55:18.697563967Z [2024-03-20 23:55:18,697: ERROR/ForkPoolWorker-15] [b46f6f2b-6488-4df5-890b-6f44f683875b] Failed to execute task Dag 'vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af' could not be found; either it does not exist or it failed to parse..
2024-03-20T23:55:18.697580112Z Traceback (most recent call last):
2024-03-20T23:55:18.697587494Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-20T23:55:18.697605135Z     args.func(args)
2024-03-20T23:55:18.697610433Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-20T23:55:18.697615211Z     return func(*args, **kwargs)
2024-03-20T23:55:18.697619273Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-20T23:55:18.697641939Z     return f(*args, **kwargs)
2024-03-20T23:55:18.697649398Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-20T23:55:18.697657052Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-20T23:55:18.697663155Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-20T23:55:18.697669505Z     raise AirflowException(
2024-03-20T23:55:18.697683301Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_c2d3576c-57a2-44ae-bc76-8149f05e77af' could not be found; either it does not exist or it failed to parse.
2024-03-20T23:55:18.731362838Z [2024-03-20 23:55:18,730: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b46f6f2b-6488-4df5-890b-6f44f683875b] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id b46f6f2b-6488-4df5-890b-6f44f683875b')
2024-03-20T23:55:18.731383882Z Traceback (most recent call last):
2024-03-20T23:55:18.731388080Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-20T23:55:18.731391163Z     R = retval = fun(*args, **kwargs)
2024-03-20T23:55:18.731394304Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-20T23:55:18.731397616Z     return self.run(*args, **kwargs)
2024-03-20T23:55:18.731401055Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-20T23:55:18.731404637Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-20T23:55:18.731414727Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-20T23:55:18.731418784Z     raise AirflowException(msg)
2024-03-20T23:55:18.731422403Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id b46f6f2b-6488-4df5-890b-6f44f683875b
2024-03-20T23:56:00.580789189Z [2024-03-20 23:56:00,580: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5dfe884e-6a16-4b86-a714-40db667a7165] received
2024-03-20T23:56:00.584994695Z [2024-03-20 23:56:00,584: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e16b1d3c-d4c1-403e-a2b1-d48dcfd7768c] received
2024-03-20T23:56:00.587649556Z [2024-03-20 23:56:00,587: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed9e6ca3-cf0f-42dd-9fe3-184e3bcc9d37] received
2024-03-20T23:56:00.590960308Z [2024-03-20 23:56:00,590: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[884dd891-6b98-4d66-8471-37003a12bbc6] received
2024-03-20T23:56:00.597212942Z [2024-03-20 23:56:00,596: INFO/ForkPoolWorker-1] [ed9e6ca3-cf0f-42dd-9fe3-184e3bcc9d37] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:56:00.598499772Z [2024-03-20 23:56:00,598: INFO/ForkPoolWorker-15] [5dfe884e-6a16-4b86-a714-40db667a7165] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-20T23:56:00.602485147Z [2024-03-20 23:56:00,602: INFO/ForkPoolWorker-16] [e16b1d3c-d4c1-403e-a2b1-d48dcfd7768c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-20T23:56:00.604664321Z [2024-03-20 23:56:00,604: INFO/ForkPoolWorker-2] [884dd891-6b98-4d66-8471-37003a12bbc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:56:00.940592353Z [2024-03-20 23:56:00,937: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:56:00.966214659Z [2024-03-20 23:56:00,959: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:56:00.971974924Z [2024-03-20 23:56:00,968: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-20T23:56:00.982898840Z [2024-03-20 23:56:00,979: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-20T23:56:01.144394294Z [2024-03-20 23:56:01,143: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-20T23:56:01.149146833Z [2024-03-20 23:56:01,148: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:56:01.201198699Z [2024-03-20 23:56:01,200: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:56:01.202378886Z [2024-03-20 23:56:01,202: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-20T23:56:01.202507810Z [2024-03-20 23:56:01,202: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-20T23:56:01.202557440Z [2024-03-20 23:56:01,202: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-20T23:56:01.202868457Z [2024-03-20 23:56:01,202: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-20T23:56:01.361714138Z [2024-03-20 23:56:01,361: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-20T23:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:56:01.437184734Z [2024-03-20 23:56:01,436: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-20T23:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:56:02.064889721Z [2024-03-20 23:56:02,064: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e16b1d3c-d4c1-403e-a2b1-d48dcfd7768c] succeeded in 1.4779080550001709s: None
2024-03-20T23:56:02.067423311Z [2024-03-20 23:56:02,067: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5dfe884e-6a16-4b86-a714-40db667a7165] succeeded in 1.4848402889997487s: None
2024-03-20T23:56:02.680626995Z [2024-03-20 23:56:02,680: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-20T23:56:02.684121140Z [2024-03-20 23:56:02,683: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:56:02.705183100Z [2024-03-20 23:56:02,704: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-20T23:56:02.706656649Z [2024-03-20 23:56:02,706: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:56:02.706702993Z [2024-03-20 23:56:02,706: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:56:02.706794681Z [2024-03-20 23:56:02,706: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:56:02.706809714Z [2024-03-20 23:56:02,706: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-20T23:56:02.708008654Z [2024-03-20 23:56:02,707: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:56:02.708023300Z [2024-03-20 23:56:02,707: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:56:02.814194846Z [2024-03-20 23:56:02,813: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:56:02.971390299Z [2024-03-20 23:56:02,970: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-20T23:56:02.975145989Z [2024-03-20 23:56:02,974: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:56:03.009517266Z [2024-03-20 23:56:03,009: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-20T23:56:03.011122263Z [2024-03-20 23:56:03,010: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:56:03.011191071Z [2024-03-20 23:56:03,010: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:56:03.011252746Z [2024-03-20 23:56:03,011: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:56:03.011268464Z [2024-03-20 23:56:03,011: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-20T23:56:03.011511610Z [2024-03-20 23:56:03,011: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:56:03.011527902Z [2024-03-20 23:56:03,011: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:56:03.123192158Z [2024-03-20 23:56:03,122: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:56:05.300709110Z [2024-03-20 23:56:05,300: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ed9e6ca3-cf0f-42dd-9fe3-184e3bcc9d37] succeeded in 4.7106407260002925s: None
2024-03-20T23:56:05.788907182Z [2024-03-20 23:56:05,788: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[884dd891-6b98-4d66-8471-37003a12bbc6] succeeded in 5.195939764999821s: None
2024-03-20T23:57:01.331664689Z [2024-03-20 23:57:01,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d4a4b57-9646-4362-a23d-1b5f8e372b24] received
2024-03-20T23:57:01.333135850Z [2024-03-20 23:57:01,332: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ace70ef-ef17-49f9-90d1-5e274e2efc9f] received
2024-03-20T23:57:01.342118724Z [2024-03-20 23:57:01,341: INFO/ForkPoolWorker-16] [6ace70ef-ef17-49f9-90d1-5e274e2efc9f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:57:01.344557061Z [2024-03-20 23:57:01,344: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94eecd55-abd1-48eb-98a8-253de56ceb53] received
2024-03-20T23:57:01.349068074Z [2024-03-20 23:57:01,348: INFO/ForkPoolWorker-15] [0d4a4b57-9646-4362-a23d-1b5f8e372b24] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-20T23:57:01.361920925Z [2024-03-20 23:57:01,361: INFO/ForkPoolWorker-1] [94eecd55-abd1-48eb-98a8-253de56ceb53] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:57:01.675679761Z [2024-03-20 23:57:01,671: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:57:01.685151747Z [2024-03-20 23:57:01,681: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-20T23:57:01.696659886Z [2024-03-20 23:57:01,692: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:57:01.876351609Z [2024-03-20 23:57:01,875: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-20T23:57:01.880690860Z [2024-03-20 23:57:01,880: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:57:01.923222664Z [2024-03-20 23:57:01,922: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:57:01.928215818Z [2024-03-20 23:57:01,927: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-20T23:57:01.928432375Z [2024-03-20 23:57:01,928: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-20T23:57:01.929044398Z [2024-03-20 23:57:01,928: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-20T23:57:01.929380886Z [2024-03-20 23:57:01,929: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-20T23:57:02.027111050Z [2024-03-20 23:57:02,026: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-20T23:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:57:03.169447440Z [2024-03-20 23:57:03,169: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0d4a4b57-9646-4362-a23d-1b5f8e372b24] succeeded in 1.8350727500001085s: None
2024-03-20T23:57:03.575022748Z [2024-03-20 23:57:03,574: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:57:03.576837066Z [2024-03-20 23:57:03,576: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-20T23:57:03.578717501Z [2024-03-20 23:57:03,578: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:57:03.580362927Z [2024-03-20 23:57:03,579: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:57:03.598610206Z [2024-03-20 23:57:03,598: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-20T23:57:03.599765505Z [2024-03-20 23:57:03,599: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:57:03.599889379Z [2024-03-20 23:57:03,599: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:57:03.600052796Z [2024-03-20 23:57:03,599: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:57:03.600157751Z [2024-03-20 23:57:03,600: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-20T23:57:03.600566406Z [2024-03-20 23:57:03,600: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:57:03.600835589Z [2024-03-20 23:57:03,600: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:57:03.603505415Z [2024-03-20 23:57:03,603: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:57:03.604903442Z [2024-03-20 23:57:03,604: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:57:03.605035147Z [2024-03-20 23:57:03,604: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:57:03.605227009Z [2024-03-20 23:57:03,605: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:57:03.605381693Z [2024-03-20 23:57:03,605: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:57:03.605700083Z [2024-03-20 23:57:03,605: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:57:03.606191263Z [2024-03-20 23:57:03,606: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:57:03.689274805Z [2024-03-20 23:57:03,689: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:57:03.689341719Z [2024-03-20 23:57:03,689: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:57:07.919693376Z [2024-03-20 23:57:07,919: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6ace70ef-ef17-49f9-90d1-5e274e2efc9f] succeeded in 6.582826676999957s: None
2024-03-20T23:57:09.084910761Z [2024-03-20 23:57:09,084: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[94eecd55-abd1-48eb-98a8-253de56ceb53] succeeded in 7.738600173000123s: None
2024-03-20T23:58:00.621059403Z [2024-03-20 23:58:00,620: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2b7597b-62c9-4886-80b4-bab0e645b190] received
2024-03-20T23:58:00.624250396Z [2024-03-20 23:58:00,624: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b49d3f39-c6ed-4386-bdef-50648d2a78b2] received
2024-03-20T23:58:00.627543517Z [2024-03-20 23:58:00,627: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[312ba900-161b-436a-8da8-aaff243fc014] received
2024-03-20T23:58:00.632489197Z [2024-03-20 23:58:00,631: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4293a72-ba09-42ae-bddc-5a03799e1309] received
2024-03-20T23:58:00.634888964Z [2024-03-20 23:58:00,634: INFO/ForkPoolWorker-16] [b49d3f39-c6ed-4386-bdef-50648d2a78b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:58:00.636115574Z [2024-03-20 23:58:00,635: INFO/ForkPoolWorker-15] [c2b7597b-62c9-4886-80b4-bab0e645b190] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-20T23:58:00.639676757Z [2024-03-20 23:58:00,639: INFO/ForkPoolWorker-2] [a4293a72-ba09-42ae-bddc-5a03799e1309] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:58:00.651646446Z [2024-03-20 23:58:00,651: INFO/ForkPoolWorker-1] [312ba900-161b-436a-8da8-aaff243fc014] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-20T23:58:00.953722111Z [2024-03-20 23:58:00,950: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-20T23:58:01.065216684Z [2024-03-20 23:58:01,061: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:58:01.078783537Z [2024-03-20 23:58:01,075: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:58:01.114776523Z [2024-03-20 23:58:01,104: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-20T23:58:01.215431901Z [2024-03-20 23:58:01,215: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-20T23:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:58:01.371441004Z [2024-03-20 23:58:01,371: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-20T23:58:01.375873208Z [2024-03-20 23:58:01,375: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:58:01.411367867Z [2024-03-20 23:58:01,411: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-20T23:58:01.412903709Z [2024-03-20 23:58:01,412: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-20T23:58:01.413128464Z [2024-03-20 23:58:01,412: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-20T23:58:01.413242809Z [2024-03-20 23:58:01,413: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-20T23:58:01.413537766Z [2024-03-20 23:58:01,413: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-20T23:58:01.553408599Z [2024-03-20 23:58:01,553: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-20T23:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:58:01.769634225Z [2024-03-20 23:58:01,769: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c2b7597b-62c9-4886-80b4-bab0e645b190] succeeded in 1.146393327000169s: None
2024-03-20T23:58:02.240119198Z [2024-03-20 23:58:02,239: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[312ba900-161b-436a-8da8-aaff243fc014] succeeded in 1.607921676999922s: None
2024-03-20T23:58:02.304342480Z [2024-03-20 23:58:02,303: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:58:02.314575969Z [2024-03-20 23:58:02,314: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:58:02.365869952Z [2024-03-20 23:58:02,365: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:58:02.367130975Z [2024-03-20 23:58:02,366: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:58:02.367189567Z [2024-03-20 23:58:02,367: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:58:02.367308964Z [2024-03-20 23:58:02,367: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:58:02.367483932Z [2024-03-20 23:58:02,367: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:58:02.367800519Z [2024-03-20 23:58:02,367: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:58:02.367848060Z [2024-03-20 23:58:02,367: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:58:02.481421055Z [2024-03-20 23:58:02,481: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:58:02.585485027Z [2024-03-20 23:58:02,584: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-20T23:58:02.589232994Z [2024-03-20 23:58:02,588: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:58:02.615779615Z [2024-03-20 23:58:02,615: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-20T23:58:02.617969013Z [2024-03-20 23:58:02,617: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:58:02.617989630Z [2024-03-20 23:58:02,617: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:58:02.618127844Z [2024-03-20 23:58:02,617: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:58:02.618143348Z [2024-03-20 23:58:02,618: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-20T23:58:02.618517902Z [2024-03-20 23:58:02,618: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:58:02.618547956Z [2024-03-20 23:58:02,618: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:58:02.736174519Z [2024-03-20 23:58:02,735: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:58:04.450960772Z [2024-03-20 23:58:04,450: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a4293a72-ba09-42ae-bddc-5a03799e1309] succeeded in 3.816900574000101s: None
2024-03-20T23:58:04.487057623Z [2024-03-20 23:58:04,486: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b49d3f39-c6ed-4386-bdef-50648d2a78b2] succeeded in 3.8608000099998208s: None
2024-03-20T23:59:01.270946893Z [2024-03-20 23:59:01,270: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24b3491a-1554-428c-95dc-f2a505dc0f93] received
2024-03-20T23:59:01.274540355Z [2024-03-20 23:59:01,274: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2aba8d09-8fab-4037-ac88-bae776711966] received
2024-03-20T23:59:01.282386365Z [2024-03-20 23:59:01,282: INFO/ForkPoolWorker-16] [2aba8d09-8fab-4037-ac88-bae776711966] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-20T23:59:01.283983276Z [2024-03-20 23:59:01,283: INFO/ForkPoolWorker-15] [24b3491a-1554-428c-95dc-f2a505dc0f93] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-20T23:59:01.293590724Z [2024-03-20 23:59:01,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3536cd0-3752-4160-aa06-bc19ebe241d1] received
2024-03-20T23:59:01.310479960Z [2024-03-20 23:59:01,310: INFO/ForkPoolWorker-1] [f3536cd0-3752-4160-aa06-bc19ebe241d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-20T23:59:01.601682775Z [2024-03-20 23:59:01,598: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-20T23:59:01.782086973Z [2024-03-20 23:59:01,777: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-20T23:59:01.811952734Z [2024-03-20 23:59:01,808: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-20T23:59:02.041952760Z [2024-03-20 23:59:02,041: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-20T23:59:02.046361212Z [2024-03-20 23:59:02,045: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:59:02.071235308Z [2024-03-20 23:59:02,070: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-20T23:59:02.072457771Z [2024-03-20 23:59:02,072: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-20T23:59:02.072626743Z [2024-03-20 23:59:02,072: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-20T23:59:02.072735873Z [2024-03-20 23:59:02,072: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-20T23:59:02.072981860Z [2024-03-20 23:59:02,072: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-20T23:59:02.186828732Z [2024-03-20 23:59:02,186: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-20T23:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:59:02.991926879Z [2024-03-20 23:59:02,991: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[24b3491a-1554-428c-95dc-f2a505dc0f93] succeeded in 1.718363708999732s: None
2024-03-20T23:59:03.142866996Z [2024-03-20 23:59:03,142: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-20T23:59:03.147248105Z [2024-03-20 23:59:03,146: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:59:03.173034069Z [2024-03-20 23:59:03,172: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-20T23:59:03.174698318Z [2024-03-20 23:59:03,174: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:59:03.174748128Z [2024-03-20 23:59:03,174: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:59:03.174942440Z [2024-03-20 23:59:03,174: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:59:03.174976098Z [2024-03-20 23:59:03,174: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-20T23:59:03.175413353Z [2024-03-20 23:59:03,175: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-20T23:59:03.175570171Z [2024-03-20 23:59:03,175: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:59:03.297852472Z [2024-03-20 23:59:03,297: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:59:03.395308241Z [2024-03-20 23:59:03,394: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-20T23:59:03.399036937Z [2024-03-20 23:59:03,398: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-20T23:59:03.425602519Z [2024-03-20 23:59:03,425: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-20T23:59:03.427468238Z [2024-03-20 23:59:03,427: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-20T23:59:03.427655555Z [2024-03-20 23:59:03,427: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-20T23:59:03.427890977Z [2024-03-20 23:59:03,427: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-20T23:59:03.428072643Z [2024-03-20 23:59:03,427: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-20T23:59:03.429093862Z [2024-03-20 23:59:03,428: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-20T23:59:03.429305814Z [2024-03-20 23:59:03,429: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-20T23:59:03.539228447Z [2024-03-20 23:59:03,538: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-20T23:59:06.708808306Z [2024-03-20 23:59:06,708: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f3536cd0-3752-4160-aa06-bc19ebe241d1] succeeded in 5.412579767000352s: None
2024-03-20T23:59:07.819684781Z [2024-03-20 23:59:07,819: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2aba8d09-8fab-4037-ac88-bae776711966] succeeded in 6.542531988000064s: None
2024-03-21T00:00:00.949520147Z [2024-03-21 00:00:00,948: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[250f0087-afcf-4319-96bb-a60cb4002749] received
2024-03-21T00:00:00.954494167Z [2024-03-21 00:00:00,954: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5068ce85-49f8-41dd-9677-4d99fd7497a2] received
2024-03-21T00:00:00.962138899Z [2024-03-21 00:00:00,961: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7540d395-69c0-4e43-923d-12bc7899e9fc] received
2024-03-21T00:00:00.966874135Z [2024-03-21 00:00:00,964: INFO/ForkPoolWorker-15] [250f0087-afcf-4319-96bb-a60cb4002749] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-20T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:00:00.970333852Z [2024-03-21 00:00:00,970: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6eb1327f-c82e-477c-b7e9-4d9922a5a036] received
2024-03-21T00:00:00.972228399Z [2024-03-21 00:00:00,972: INFO/ForkPoolWorker-1] [7540d395-69c0-4e43-923d-12bc7899e9fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:00:00.975374803Z [2024-03-21 00:00:00,975: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9190a5c7-4e61-4ae3-8c13-28f78555cf3d] received
2024-03-21T00:00:00.979042976Z [2024-03-21 00:00:00,978: INFO/ForkPoolWorker-2] [6eb1327f-c82e-477c-b7e9-4d9922a5a036] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:00:00.982335018Z [2024-03-21 00:00:00,981: INFO/ForkPoolWorker-16] [5068ce85-49f8-41dd-9677-4d99fd7497a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-20T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:00:00.986418041Z [2024-03-21 00:00:00,985: INFO/ForkPoolWorker-3] [9190a5c7-4e61-4ae3-8c13-28f78555cf3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-20T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:00:01.416897620Z [2024-03-21 00:00:01,408: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:00:01.471007337Z [2024-03-21 00:00:01,467: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:00:01.543489061Z [2024-03-21 00:00:01,540: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:00:01.715736414Z [2024-03-21 00:00:01,708: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:00:01.744826556Z [2024-03-21 00:00:01,736: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:00:01.900630689Z [2024-03-21 00:00:01,900: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-20T23:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:00:02.062714919Z [2024-03-21 00:00:02,061: INFO/ForkPoolWorker-3] Getting SDNC list
2024-03-21T00:00:02.069996538Z [2024-03-21 00:00:02,069: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:00:02.134189184Z [2024-03-21 00:00:02,133: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-21T00:00:02.141534964Z [2024-03-21 00:00:02,141: INFO/ForkPoolWorker-3] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:00:02.141722895Z [2024-03-21 00:00:02,141: INFO/ForkPoolWorker-3] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:00:02.141857639Z [2024-03-21 00:00:02,141: INFO/ForkPoolWorker-3] Getting SDNC list OK
2024-03-21T00:00:02.142225607Z [2024-03-21 00:00:02,142: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:00:02.368842073Z [2024-03-21 00:00:02,368: INFO/ForkPoolWorker-3] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-20T23:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:00:02.739331745Z [2024-03-21 00:00:02,738: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5068ce85-49f8-41dd-9677-4d99fd7497a2] succeeded in 1.7822015400001874s: None
2024-03-21T00:00:03.179467151Z [2024-03-21 00:00:03,179: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[9190a5c7-4e61-4ae3-8c13-28f78555cf3d] succeeded in 2.201517592000073s: None
2024-03-21T00:00:03.278253657Z [2024-03-21 00:00:03,277: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:00:03.282254794Z [2024-03-21 00:00:03,281: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:00:03.305027482Z [2024-03-21 00:00:03,304: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:00:03.307131981Z [2024-03-21 00:00:03,306: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:00:03.307312696Z [2024-03-21 00:00:03,307: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:00:03.307493756Z [2024-03-21 00:00:03,307: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:00:03.307605385Z [2024-03-21 00:00:03,307: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:00:03.308038619Z [2024-03-21 00:00:03,307: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:00:03.308154611Z [2024-03-21 00:00:03,308: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:00:03.385054247Z [2024-03-21 00:00:03,384: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:00:03.388762037Z [2024-03-21 00:00:03,388: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:00:03.416962781Z [2024-03-21 00:00:03,416: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:00:03.418452210Z [2024-03-21 00:00:03,418: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:00:03.418469402Z [2024-03-21 00:00:03,418: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:00:03.418737507Z [2024-03-21 00:00:03,418: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:00:03.418816869Z [2024-03-21 00:00:03,418: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:00:03.419265696Z [2024-03-21 00:00:03,419: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:00:03.419448082Z [2024-03-21 00:00:03,419: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:00:03.424174287Z [2024-03-21 00:00:03,423: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-20T23:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:00:03.432359463Z [2024-03-21 00:00:03,431: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T00:00:03.435849217Z [2024-03-21 00:00:03,435: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:00:03.457456328Z [2024-03-21 00:00:03,457: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:00:03.458787978Z [2024-03-21 00:00:03,458: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:00:03.458810634Z [2024-03-21 00:00:03,458: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:00:03.458968194Z [2024-03-21 00:00:03,458: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:00:03.459086100Z [2024-03-21 00:00:03,458: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T00:00:03.459378005Z [2024-03-21 00:00:03,459: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:00:03.459503103Z [2024-03-21 00:00:03,459: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:00:03.506937656Z [2024-03-21 00:00:03,506: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-20T23:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:00:03.575790001Z [2024-03-21 00:00:03,575: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-20T23:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:00:04.233404081Z [2024-03-21 00:00:04,232: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[250f0087-afcf-4319-96bb-a60cb4002749] succeeded in 3.276899893999598s: None
2024-03-21T00:00:04.773676830Z [2024-03-21 00:00:04,772: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13b080f3-748d-4a7a-9987-0508b9577f70] received
2024-03-21T00:00:04.793049978Z [2024-03-21 00:00:04,792: INFO/ForkPoolWorker-15] [13b080f3-748d-4a7a-9987-0508b9577f70] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-20T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:00:05.033769562Z [2024-03-21 00:00:05,033: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7540d395-69c0-4e43-923d-12bc7899e9fc] succeeded in 4.069846469999902s: None
2024-03-21T00:00:05.149013093Z [2024-03-21 00:00:05,145: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:00:05.587347643Z [2024-03-21 00:00:05,586: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6eb1327f-c82e-477c-b7e9-4d9922a5a036] succeeded in 4.613702551000188s: None
2024-03-21T00:00:06.352401785Z [2024-03-21 00:00:06,351: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:00:06.355902076Z [2024-03-21 00:00:06,355: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:00:06.373167001Z [2024-03-21 00:00:06,372: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:00:06.374528944Z [2024-03-21 00:00:06,374: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:00:06.374541939Z [2024-03-21 00:00:06,374: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:00:06.374644202Z [2024-03-21 00:00:06,374: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:00:06.374677408Z [2024-03-21 00:00:06,374: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:00:06.375090114Z [2024-03-21 00:00:06,374: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:00:06.375103630Z [2024-03-21 00:00:06,374: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:00:06.459755893Z [2024-03-21 00:00:06,459: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-20T23:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:00:07.069069630Z [2024-03-21 00:00:07,068: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[13b080f3-748d-4a7a-9987-0508b9577f70] succeeded in 2.287851610999951s: None
2024-03-21T00:00:07.217057333Z [2024-03-21 00:00:07,216: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34148d15-68e3-497a-8ab7-00d4a75c475e] received
2024-03-21T00:00:07.225491572Z [2024-03-21 00:00:07,225: INFO/ForkPoolWorker-15] [34148d15-68e3-497a-8ab7-00d4a75c475e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-20T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T00:00:07.505896603Z [2024-03-21 00:00:07,502: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:00:08.701803371Z [2024-03-21 00:00:08,701: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:00:08.706288661Z [2024-03-21 00:00:08,705: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:00:08.724485227Z [2024-03-21 00:00:08,724: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:00:08.725937618Z [2024-03-21 00:00:08,725: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:00:08.726027259Z [2024-03-21 00:00:08,725: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:00:08.726147862Z [2024-03-21 00:00:08,725: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:00:08.726214425Z [2024-03-21 00:00:08,726: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:00:08.726552299Z [2024-03-21 00:00:08,726: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:00:08.726619748Z [2024-03-21 00:00:08,726: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:00:08.803860856Z [2024-03-21 00:00:08,803: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-20T23:55:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:00:09.393720974Z [2024-03-21 00:00:09,390: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[34148d15-68e3-497a-8ab7-00d4a75c475e] succeeded in 2.1713578559997586s: None
2024-03-21T00:00:09.927693304Z [2024-03-21 00:00:09,927: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fbf71f63-7d79-453a-b54a-4aa29fef9e11] received
2024-03-21T00:00:09.940056928Z [2024-03-21 00:00:09,939: INFO/ForkPoolWorker-15] [fbf71f63-7d79-453a-b54a-4aa29fef9e11] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-20T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:00:10.236453030Z [2024-03-21 00:00:10,233: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:00:11.425771360Z [2024-03-21 00:00:11,425: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:00:11.429318421Z [2024-03-21 00:00:11,428: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:00:11.447253809Z [2024-03-21 00:00:11,447: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:00:11.449260099Z [2024-03-21 00:00:11,449: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:00:11.449423099Z [2024-03-21 00:00:11,449: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:00:11.449599526Z [2024-03-21 00:00:11,449: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:00:11.449699409Z [2024-03-21 00:00:11,449: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:00:11.450095893Z [2024-03-21 00:00:11,449: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:00:11.450258380Z [2024-03-21 00:00:11,450: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:00:11.535714851Z [2024-03-21 00:00:11,535: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-20T23:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:00:12.069345685Z [2024-03-21 00:00:12,068: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fbf71f63-7d79-453a-b54a-4aa29fef9e11] succeeded in 2.1381591590002245s: None
2024-03-21T00:01:00.746042636Z [2024-03-21 00:01:00,745: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2fc5600c-eb7c-4e70-bcf6-b3cb5ed3e532] received
2024-03-21T00:01:00.751185885Z [2024-03-21 00:01:00,750: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f761e89f-afb7-4fdf-abc3-43b8107ec4dd] received
2024-03-21T00:01:00.756128899Z [2024-03-21 00:01:00,755: INFO/ForkPoolWorker-15] [2fc5600c-eb7c-4e70-bcf6-b3cb5ed3e532] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:01:00.757081086Z [2024-03-21 00:01:00,756: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6dc5163-a74b-4a94-9586-1cb8c9ba86bd] received
2024-03-21T00:01:00.757833486Z [2024-03-21 00:01:00,757: INFO/ForkPoolWorker-16] [f761e89f-afb7-4fdf-abc3-43b8107ec4dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:01:00.776054633Z [2024-03-21 00:01:00,775: INFO/ForkPoolWorker-1] [a6dc5163-a74b-4a94-9586-1cb8c9ba86bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:01:01.052771378Z [2024-03-21 00:01:01,049: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:01:01.058562313Z [2024-03-21 00:01:01,055: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:01:01.113427146Z [2024-03-21 00:01:01,110: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:01:01.221549261Z [2024-03-21 00:01:01,220: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T00:01:01.244107490Z [2024-03-21 00:01:01,243: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:01:01.284275919Z [2024-03-21 00:01:01,283: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:01:01.290961197Z [2024-03-21 00:01:01,290: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:01:01.291031203Z [2024-03-21 00:01:01,290: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:01:01.291100845Z [2024-03-21 00:01:01,290: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T00:01:01.291547705Z [2024-03-21 00:01:01,291: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:01:01.415963186Z [2024-03-21 00:01:01,415: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:01:02.130808776Z [2024-03-21 00:01:02,130: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2fc5600c-eb7c-4e70-bcf6-b3cb5ed3e532] succeeded in 1.3824942320002265s: None
2024-03-21T00:01:02.366830694Z [2024-03-21 00:01:02,366: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:01:02.372412987Z [2024-03-21 00:01:02,369: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:01:02.392587820Z [2024-03-21 00:01:02,392: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:01:02.394228388Z [2024-03-21 00:01:02,393: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:01:02.394420500Z [2024-03-21 00:01:02,394: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:01:02.394712507Z [2024-03-21 00:01:02,394: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:01:02.394853354Z [2024-03-21 00:01:02,394: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:01:02.395214040Z [2024-03-21 00:01:02,395: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:01:02.395695399Z [2024-03-21 00:01:02,395: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:01:02.478831565Z [2024-03-21 00:01:02,478: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:01:02.481754041Z [2024-03-21 00:01:02,481: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:01:02.487621088Z [2024-03-21 00:01:02,486: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:01:02.518774308Z [2024-03-21 00:01:02,517: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:01:02.523207309Z [2024-03-21 00:01:02,522: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:01:02.523267499Z [2024-03-21 00:01:02,523: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:01:02.523437071Z [2024-03-21 00:01:02,523: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:01:02.523505753Z [2024-03-21 00:01:02,523: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:01:02.524750098Z [2024-03-21 00:01:02,524: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:01:02.524907138Z [2024-03-21 00:01:02,524: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:01:02.631184519Z [2024-03-21 00:01:02,630: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:01:04.051347513Z [2024-03-21 00:01:04,050: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a6dc5163-a74b-4a94-9586-1cb8c9ba86bd] succeeded in 3.2855747710000287s: None
2024-03-21T00:01:04.548730686Z [2024-03-21 00:01:04,548: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f761e89f-afb7-4fdf-abc3-43b8107ec4dd] succeeded in 3.7959767190000093s: None
2024-03-21T00:02:01.159296913Z [2024-03-21 00:02:01,158: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[281e2cc4-235b-4122-8b78-0c54c9b16b95] received
2024-03-21T00:02:01.160649335Z [2024-03-21 00:02:01,160: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ed8e62b-c740-4981-92e5-071a6a519d49] received
2024-03-21T00:02:01.164103298Z [2024-03-21 00:02:01,163: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c46470d-4c04-44ea-8758-a54f1300a9f8] received
2024-03-21T00:02:01.166122265Z [2024-03-21 00:02:01,165: INFO/ForkPoolWorker-16] [5ed8e62b-c740-4981-92e5-071a6a519d49] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:02:01.170070147Z [2024-03-21 00:02:01,169: INFO/ForkPoolWorker-1] [2c46470d-4c04-44ea-8758-a54f1300a9f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:02:01.171670738Z [2024-03-21 00:02:01,171: INFO/ForkPoolWorker-15] [281e2cc4-235b-4122-8b78-0c54c9b16b95] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:02:01.178243618Z [2024-03-21 00:02:01,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd80115c-e58c-47d1-b6e2-613e658c1a16] received
2024-03-21T00:02:01.190051995Z [2024-03-21 00:02:01,189: INFO/ForkPoolWorker-2] [fd80115c-e58c-47d1-b6e2-613e658c1a16] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:02:01.521706297Z [2024-03-21 00:02:01,518: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:02:01.574464940Z [2024-03-21 00:02:01,570: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:02:01.603972368Z [2024-03-21 00:02:01,598: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:02:01.646033676Z [2024-03-21 00:02:01,627: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:02:02.053530297Z [2024-03-21 00:02:02,053: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T00:02:02.064967967Z [2024-03-21 00:02:02,064: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:02:02.118118425Z [2024-03-21 00:02:02,117: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:02:02.122923451Z [2024-03-21 00:02:02,122: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:02:02.123275865Z [2024-03-21 00:02:02,122: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:02:02.123450254Z [2024-03-21 00:02:02,123: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T00:02:02.123824578Z [2024-03-21 00:02:02,123: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:02:02.160301459Z [2024-03-21 00:02:02,159: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:02:02.283904182Z [2024-03-21 00:02:02,283: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:02:03.087191276Z [2024-03-21 00:02:03,086: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[281e2cc4-235b-4122-8b78-0c54c9b16b95] succeeded in 1.9253629039999396s: None
2024-03-21T00:02:03.254234645Z [2024-03-21 00:02:03,253: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fd80115c-e58c-47d1-b6e2-613e658c1a16] succeeded in 2.070573142000285s: None
2024-03-21T00:02:03.301808169Z [2024-03-21 00:02:03,301: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:02:03.305468475Z [2024-03-21 00:02:03,304: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:02:03.329274637Z [2024-03-21 00:02:03,328: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:02:03.333619772Z [2024-03-21 00:02:03,332: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:02:03.333973644Z [2024-03-21 00:02:03,333: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:02:03.334283241Z [2024-03-21 00:02:03,333: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:02:03.334366652Z [2024-03-21 00:02:03,334: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:02:03.334887646Z [2024-03-21 00:02:03,334: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:02:03.335122948Z [2024-03-21 00:02:03,334: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:02:03.423890216Z [2024-03-21 00:02:03,423: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:02:03.473642765Z [2024-03-21 00:02:03,473: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:02:03.477187901Z [2024-03-21 00:02:03,476: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:02:03.495058464Z [2024-03-21 00:02:03,494: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:02:03.496209807Z [2024-03-21 00:02:03,495: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:02:03.496224855Z [2024-03-21 00:02:03,496: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:02:03.496391137Z [2024-03-21 00:02:03,496: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:02:03.496428961Z [2024-03-21 00:02:03,496: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:02:03.496675003Z [2024-03-21 00:02:03,496: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:02:03.496684272Z [2024-03-21 00:02:03,496: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:02:03.581139569Z [2024-03-21 00:02:03,580: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:02:04.894759376Z [2024-03-21 00:02:04,894: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2c46470d-4c04-44ea-8758-a54f1300a9f8] succeeded in 3.7286119710001913s: None
2024-03-21T00:02:05.402408798Z [2024-03-21 00:02:05,402: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5ed8e62b-c740-4981-92e5-071a6a519d49] succeeded in 4.240740953000113s: None
2024-03-21T00:03:00.997691025Z [2024-03-21 00:03:00,996: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bcdffb61-70c0-4935-896e-54bb278c1e82] received
2024-03-21T00:03:01.027001373Z [2024-03-21 00:03:01,026: INFO/ForkPoolWorker-15] [bcdffb61-70c0-4935-896e-54bb278c1e82] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:03:01.045605863Z [2024-03-21 00:03:01,045: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9eaf8006-00cd-47d1-802a-6097e09d7571] received
2024-03-21T00:03:01.071516199Z [2024-03-21 00:03:01,067: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1a8cd0d-d6db-4fdf-a492-3eb885018aa4] received
2024-03-21T00:03:01.077465728Z [2024-03-21 00:03:01,077: INFO/ForkPoolWorker-16] [9eaf8006-00cd-47d1-802a-6097e09d7571] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:03:01.091044124Z [2024-03-21 00:03:01,090: INFO/ForkPoolWorker-1] [b1a8cd0d-d6db-4fdf-a492-3eb885018aa4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:03:02.966531213Z [2024-03-21 00:03:02,941: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:03:03.212977698Z [2024-03-21 00:03:03,189: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:03:03.282111598Z [2024-03-21 00:03:03,276: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:03:04.222458959Z [2024-03-21 00:03:04,221: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T00:03:04.232678458Z [2024-03-21 00:03:04,231: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:03:04.537300164Z [2024-03-21 00:03:04,533: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:03:04.589234181Z [2024-03-21 00:03:04,588: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:03:04.592416793Z [2024-03-21 00:03:04,589: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:03:04.596939898Z [2024-03-21 00:03:04,593: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T00:03:04.607209642Z [2024-03-21 00:03:04,598: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:03:05.239179664Z [2024-03-21 00:03:05,238: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:03:06.623100287Z [2024-03-21 00:03:06,621: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b1a8cd0d-d6db-4fdf-a492-3eb885018aa4] succeeded in 5.540277459999743s: None
2024-03-21T00:03:07.464117304Z [2024-03-21 00:03:07,463: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:03:07.468703533Z [2024-03-21 00:03:07,468: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:03:07.513428814Z [2024-03-21 00:03:07,513: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:03:07.514625143Z [2024-03-21 00:03:07,514: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:03:07.514702195Z [2024-03-21 00:03:07,514: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:03:07.514916337Z [2024-03-21 00:03:07,514: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:03:07.514990190Z [2024-03-21 00:03:07,514: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:03:07.515309219Z [2024-03-21 00:03:07,515: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:03:07.515363751Z [2024-03-21 00:03:07,515: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:03:07.648134328Z [2024-03-21 00:03:07,647: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:03:07.656795633Z [2024-03-21 00:03:07,656: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:03:07.660027450Z [2024-03-21 00:03:07,657: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:03:07.686620400Z [2024-03-21 00:03:07,686: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:03:07.689019813Z [2024-03-21 00:03:07,688: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:03:07.689042799Z [2024-03-21 00:03:07,688: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:03:07.689177823Z [2024-03-21 00:03:07,688: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:03:07.690095317Z [2024-03-21 00:03:07,689: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:03:07.690364507Z [2024-03-21 00:03:07,690: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:03:07.690742744Z [2024-03-21 00:03:07,690: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:03:07.805095123Z [2024-03-21 00:03:07,803: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:03:09.941426205Z [2024-03-21 00:03:09,940: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bcdffb61-70c0-4935-896e-54bb278c1e82] succeeded in 8.932547326000076s: None
2024-03-21T00:03:10.219819019Z [2024-03-21 00:03:10,219: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9eaf8006-00cd-47d1-802a-6097e09d7571] succeeded in 9.17142289200001s: None
2024-03-21T00:04:00.451428294Z [2024-03-21 00:04:00,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab0319ce-6b4f-4ca4-a4f5-d10a3ea54f57] received
2024-03-21T00:04:00.455852472Z [2024-03-21 00:04:00,455: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[effee55b-eea4-46d4-8e07-e3164cb86ea4] received
2024-03-21T00:04:00.456798294Z [2024-03-21 00:04:00,456: INFO/ForkPoolWorker-15] [ab0319ce-6b4f-4ca4-a4f5-d10a3ea54f57] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:04:00.459184087Z [2024-03-21 00:04:00,459: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d98876e-bb80-4f18-89dc-05d8c1f3348b] received
2024-03-21T00:04:00.467905320Z [2024-03-21 00:04:00,467: INFO/ForkPoolWorker-16] [effee55b-eea4-46d4-8e07-e3164cb86ea4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:04:00.469040147Z [2024-03-21 00:04:00,468: INFO/ForkPoolWorker-1] [8d98876e-bb80-4f18-89dc-05d8c1f3348b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:04:00.472987761Z [2024-03-21 00:04:00,472: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0bf4fb76-6068-4d59-9a1e-15ae4fa9448a] received
2024-03-21T00:04:00.487793218Z [2024-03-21 00:04:00,487: INFO/ForkPoolWorker-2] [0bf4fb76-6068-4d59-9a1e-15ae4fa9448a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:04:00.840360633Z [2024-03-21 00:04:00,837: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:04:00.887533594Z [2024-03-21 00:04:00,883: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:04:00.890561741Z [2024-03-21 00:04:00,885: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:04:00.914907458Z [2024-03-21 00:04:00,911: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:04:01.014123101Z [2024-03-21 00:04:01,013: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T00:04:01.018436839Z [2024-03-21 00:04:01,018: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:04:01.057770649Z [2024-03-21 00:04:01,057: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:04:01.061545047Z [2024-03-21 00:04:01,061: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:04:01.061760564Z [2024-03-21 00:04:01,061: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:04:01.061814216Z [2024-03-21 00:04:01,061: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T00:04:01.062129795Z [2024-03-21 00:04:01,061: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:04:01.151683307Z [2024-03-21 00:04:01,151: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:04:01.304603163Z [2024-03-21 00:04:01,304: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:04:02.416373100Z [2024-03-21 00:04:02,415: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[effee55b-eea4-46d4-8e07-e3164cb86ea4] succeeded in 1.9552846510000563s: None
2024-03-21T00:04:02.435770196Z [2024-03-21 00:04:02,435: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ab0319ce-6b4f-4ca4-a4f5-d10a3ea54f57] succeeded in 1.9840942619998714s: None
2024-03-21T00:04:02.974301874Z [2024-03-21 00:04:02,973: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T00:04:02.987879837Z [2024-03-21 00:04:02,987: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:04:02.990146213Z [2024-03-21 00:04:02,989: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:04:02.997205158Z [2024-03-21 00:04:02,995: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:04:03.031841168Z [2024-03-21 00:04:03,031: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:04:03.038214563Z [2024-03-21 00:04:03,037: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:04:03.039109767Z [2024-03-21 00:04:03,037: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:04:03.040115187Z [2024-03-21 00:04:03,039: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:04:03.041991256Z [2024-03-21 00:04:03,040: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T00:04:03.042940696Z [2024-03-21 00:04:03,042: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:04:03.042953327Z [2024-03-21 00:04:03,042: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:04:03.071365346Z [2024-03-21 00:04:03,070: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:04:03.072386754Z [2024-03-21 00:04:03,071: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:04:03.072395013Z [2024-03-21 00:04:03,072: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:04:03.073761769Z [2024-03-21 00:04:03,072: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:04:03.073775135Z [2024-03-21 00:04:03,072: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:04:03.073779207Z [2024-03-21 00:04:03,072: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:04:03.073782558Z [2024-03-21 00:04:03,072: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:04:03.173434630Z [2024-03-21 00:04:03,172: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:04:03.219005245Z [2024-03-21 00:04:03,218: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:04:04.680873088Z [2024-03-21 00:04:04,680: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0bf4fb76-6068-4d59-9a1e-15ae4fa9448a] succeeded in 4.205133277000186s: None
2024-03-21T00:04:05.133337253Z [2024-03-21 00:04:05,132: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8d98876e-bb80-4f18-89dc-05d8c1f3348b] succeeded in 4.67115417299965s: None
2024-03-21T00:05:00.376911693Z [2024-03-21 00:05:00,376: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67e60dba-e50d-475e-a3d3-97f03b273c57] received
2024-03-21T00:05:00.380122917Z [2024-03-21 00:05:00,379: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75f32c1a-2cf2-4347-96c8-48c59b1f916f] received
2024-03-21T00:05:00.385277746Z [2024-03-21 00:05:00,384: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70f24697-d7c0-4db8-a16a-258c59521294] received
2024-03-21T00:05:00.389748638Z [2024-03-21 00:05:00,389: INFO/ForkPoolWorker-15] [67e60dba-e50d-475e-a3d3-97f03b273c57] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:05:00.397451818Z [2024-03-21 00:05:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[49d072e0-c689-452a-889e-503341a8e462] received
2024-03-21T00:05:00.402168573Z [2024-03-21 00:05:00,401: INFO/ForkPoolWorker-1] [70f24697-d7c0-4db8-a16a-258c59521294] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:05:00.409075181Z [2024-03-21 00:05:00,408: INFO/ForkPoolWorker-16] [75f32c1a-2cf2-4347-96c8-48c59b1f916f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:05:00.409145447Z [2024-03-21 00:05:00,408: INFO/ForkPoolWorker-2] [49d072e0-c689-452a-889e-503341a8e462] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:05:00.692739921Z [2024-03-21 00:05:00,689: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:05:00.755702687Z [2024-03-21 00:05:00,751: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:05:00.905104985Z [2024-03-21 00:05:00,900: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:05:00.908274252Z [2024-03-21 00:05:00,905: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:05:01.091764423Z [2024-03-21 00:05:01,091: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T00:05:01.096056060Z [2024-03-21 00:05:01,095: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:05:01.125557218Z [2024-03-21 00:05:01,124: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:05:01.129170987Z [2024-03-21 00:05:01,128: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:05:01.129368599Z [2024-03-21 00:05:01,129: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:05:01.129566114Z [2024-03-21 00:05:01,129: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T00:05:01.129877017Z [2024-03-21 00:05:01,129: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:05:01.232078733Z [2024-03-21 00:05:01,231: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:05:01.816499641Z [2024-03-21 00:05:01,815: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[75f32c1a-2cf2-4347-96c8-48c59b1f916f] succeeded in 1.4323269840001558s: None
2024-03-21T00:05:01.947186377Z [2024-03-21 00:05:01,946: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T00:05:01.950955693Z [2024-03-21 00:05:01,950: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:05:01.993950124Z [2024-03-21 00:05:01,993: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:05:01.996299768Z [2024-03-21 00:05:01,994: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:05:01.999848867Z [2024-03-21 00:05:01,999: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:05:02.007748378Z [2024-03-21 00:05:02,007: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:05:02.007769523Z [2024-03-21 00:05:02,007: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:05:02.007822888Z [2024-03-21 00:05:02,007: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:05:02.007846191Z [2024-03-21 00:05:02,007: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T00:05:02.008130833Z [2024-03-21 00:05:02,007: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:05:02.008163754Z [2024-03-21 00:05:02,008: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:05:02.027426163Z [2024-03-21 00:05:02,027: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:05:02.028859874Z [2024-03-21 00:05:02,028: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:05:02.028894467Z [2024-03-21 00:05:02,028: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:05:02.029019437Z [2024-03-21 00:05:02,028: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:05:02.029061834Z [2024-03-21 00:05:02,028: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:05:02.029272787Z [2024-03-21 00:05:02,029: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:05:02.029318982Z [2024-03-21 00:05:02,029: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:05:02.106539529Z [2024-03-21 00:05:02,106: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:05:02.132840132Z [2024-03-21 00:05:02,132: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T00:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:05:02.387321897Z [2024-03-21 00:05:02,386: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:05:02.391254017Z [2024-03-21 00:05:02,390: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:05:02.445212671Z [2024-03-21 00:05:02,444: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:05:02.447645215Z [2024-03-21 00:05:02,447: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:05:02.447669205Z [2024-03-21 00:05:02,447: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:05:02.447870226Z [2024-03-21 00:05:02,447: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:05:02.447971837Z [2024-03-21 00:05:02,447: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:05:02.448369515Z [2024-03-21 00:05:02,448: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:05:02.448527112Z [2024-03-21 00:05:02,448: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:05:02.572351828Z [2024-03-21 00:05:02,572: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:05:02.948686820Z [2024-03-21 00:05:02,948: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[67e60dba-e50d-475e-a3d3-97f03b273c57] succeeded in 2.565764728999966s: None
2024-03-21T00:05:03.213790109Z [2024-03-21 00:05:03,213: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37ff5d86-a7a2-4373-a042-f812f222e5b7] received
2024-03-21T00:05:03.225901158Z [2024-03-21 00:05:03,225: INFO/ForkPoolWorker-15] [37ff5d86-a7a2-4373-a042-f812f222e5b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:05:03.615894981Z [2024-03-21 00:05:03,611: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:05:03.762511438Z [2024-03-21 00:05:03,762: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[49d072e0-c689-452a-889e-503341a8e462] succeeded in 3.3582247350000216s: None
2024-03-21T00:05:04.808092652Z [2024-03-21 00:05:04,807: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[70f24697-d7c0-4db8-a16a-258c59521294] succeeded in 4.418796535999718s: None
2024-03-21T00:05:05.442987447Z [2024-03-21 00:05:05,442: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:05:05.448274753Z [2024-03-21 00:05:05,447: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:05:05.488572658Z [2024-03-21 00:05:05,488: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:05:05.492661464Z [2024-03-21 00:05:05,492: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:05:05.493390562Z [2024-03-21 00:05:05,492: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:05:05.494583529Z [2024-03-21 00:05:05,493: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:05:05.495243323Z [2024-03-21 00:05:05,494: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:05:05.496011610Z [2024-03-21 00:05:05,495: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:05:05.496407669Z [2024-03-21 00:05:05,495: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:05:05.709868901Z [2024-03-21 00:05:05,709: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T00:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:05:06.975116953Z [2024-03-21 00:05:06,974: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[37ff5d86-a7a2-4373-a042-f812f222e5b7] succeeded in 3.75622107900017s: None
2024-03-21T00:05:07.122920907Z [2024-03-21 00:05:07,122: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7a334ce-a3da-4022-93ad-cb8cc04803df] received
2024-03-21T00:05:07.163971519Z [2024-03-21 00:05:07,163: INFO/ForkPoolWorker-15] [a7a334ce-a3da-4022-93ad-cb8cc04803df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T00:05:07.609688073Z [2024-03-21 00:05:07,604: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:05:09.397217344Z [2024-03-21 00:05:09,396: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:05:09.406867359Z [2024-03-21 00:05:09,403: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:05:09.433012277Z [2024-03-21 00:05:09,432: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:05:09.434416988Z [2024-03-21 00:05:09,434: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:05:09.434473296Z [2024-03-21 00:05:09,434: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:05:09.434608062Z [2024-03-21 00:05:09,434: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:05:09.434645013Z [2024-03-21 00:05:09,434: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:05:09.434924083Z [2024-03-21 00:05:09,434: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:05:09.434980733Z [2024-03-21 00:05:09,434: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:05:09.508734276Z [2024-03-21 00:05:09,508: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T00:00:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:05:10.078007075Z [2024-03-21 00:05:10,077: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a7a334ce-a3da-4022-93ad-cb8cc04803df] succeeded in 2.9337701659997037s: None
2024-03-21T00:05:10.708097684Z [2024-03-21 00:05:10,707: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50a4f4ef-f615-4225-81e9-540fa650006d] received
2024-03-21T00:05:10.715279923Z [2024-03-21 00:05:10,715: INFO/ForkPoolWorker-15] [50a4f4ef-f615-4225-81e9-540fa650006d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:05:11.067313687Z [2024-03-21 00:05:11,064: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:05:12.184878928Z [2024-03-21 00:05:12,184: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:05:12.188498996Z [2024-03-21 00:05:12,188: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:05:12.211491787Z [2024-03-21 00:05:12,211: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:05:12.213665235Z [2024-03-21 00:05:12,213: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:05:12.213681413Z [2024-03-21 00:05:12,213: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:05:12.213804552Z [2024-03-21 00:05:12,213: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:05:12.213813670Z [2024-03-21 00:05:12,213: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:05:12.214083224Z [2024-03-21 00:05:12,213: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:05:12.214264932Z [2024-03-21 00:05:12,214: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:05:12.368298588Z [2024-03-21 00:05:12,367: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T00:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:05:13.021748919Z [2024-03-21 00:05:13,021: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[50a4f4ef-f615-4225-81e9-540fa650006d] succeeded in 2.3115245349999896s: None
2024-03-21T00:06:00.912916381Z [2024-03-21 00:06:00,912: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9f042fe-5dd3-47f8-9c4a-2f2848d0ab74] received
2024-03-21T00:06:00.917039357Z [2024-03-21 00:06:00,916: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54bd061f-ec7b-4b42-b819-a4ba74582760] received
2024-03-21T00:06:00.925332975Z [2024-03-21 00:06:00,925: INFO/ForkPoolWorker-15] [e9f042fe-5dd3-47f8-9c4a-2f2848d0ab74] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:06:00.925980162Z [2024-03-21 00:06:00,925: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba7fe2e5-392f-4a10-a326-93a76eb38f8d] received
2024-03-21T00:06:00.928351890Z [2024-03-21 00:06:00,928: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3a690a3-5594-4e6f-84aa-a5aefb26706f] received
2024-03-21T00:06:00.940885069Z [2024-03-21 00:06:00,940: INFO/ForkPoolWorker-1] [ba7fe2e5-392f-4a10-a326-93a76eb38f8d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:06:00.943947034Z [2024-03-21 00:06:00,943: INFO/ForkPoolWorker-2] [e3a690a3-5594-4e6f-84aa-a5aefb26706f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:06:00.944821489Z [2024-03-21 00:06:00,944: INFO/ForkPoolWorker-16] [54bd061f-ec7b-4b42-b819-a4ba74582760] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:06:01.259656578Z [2024-03-21 00:06:01,255: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:06:01.312258001Z [2024-03-21 00:06:01,307: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:06:01.359702952Z [2024-03-21 00:06:01,355: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:06:01.380745003Z [2024-03-21 00:06:01,376: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:06:01.556431291Z [2024-03-21 00:06:01,555: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:06:01.599938865Z [2024-03-21 00:06:01,599: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T00:06:01.605100331Z [2024-03-21 00:06:01,604: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:06:01.651258318Z [2024-03-21 00:06:01,650: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:06:01.652720667Z [2024-03-21 00:06:01,652: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:06:01.652933812Z [2024-03-21 00:06:01,652: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:06:01.653088639Z [2024-03-21 00:06:01,652: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T00:06:01.653488479Z [2024-03-21 00:06:01,653: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:06:01.820010109Z [2024-03-21 00:06:01,819: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:06:02.347178281Z [2024-03-21 00:06:02,346: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e9f042fe-5dd3-47f8-9c4a-2f2848d0ab74] succeeded in 1.4306716859996413s: None
2024-03-21T00:06:02.719624517Z [2024-03-21 00:06:02,719: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ba7fe2e5-392f-4a10-a326-93a76eb38f8d] succeeded in 1.7915502209998522s: None
2024-03-21T00:06:03.030975907Z [2024-03-21 00:06:03,030: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T00:06:03.035398878Z [2024-03-21 00:06:03,034: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:06:03.059427750Z [2024-03-21 00:06:03,059: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:06:03.061404256Z [2024-03-21 00:06:03,061: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:06:03.062548388Z [2024-03-21 00:06:03,062: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:06:03.062893884Z [2024-03-21 00:06:03,062: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:06:03.063038570Z [2024-03-21 00:06:03,062: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T00:06:03.063489890Z [2024-03-21 00:06:03,063: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:06:03.063510614Z [2024-03-21 00:06:03,063: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:06:03.107638102Z [2024-03-21 00:06:03,107: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:06:03.111628288Z [2024-03-21 00:06:03,110: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:06:03.141547470Z [2024-03-21 00:06:03,141: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:06:03.143087002Z [2024-03-21 00:06:03,142: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:06:03.143109073Z [2024-03-21 00:06:03,142: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:06:03.143173560Z [2024-03-21 00:06:03,142: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:06:03.143219529Z [2024-03-21 00:06:03,143: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:06:03.143499052Z [2024-03-21 00:06:03,143: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:06:03.143563215Z [2024-03-21 00:06:03,143: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:06:03.175285779Z [2024-03-21 00:06:03,174: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:06:03.259475183Z [2024-03-21 00:06:03,259: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:06:04.940894324Z [2024-03-21 00:06:04,935: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e3a690a3-5594-4e6f-84aa-a5aefb26706f] succeeded in 4.005656697000177s: None
2024-03-21T00:06:05.393320889Z [2024-03-21 00:06:05,392: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[54bd061f-ec7b-4b42-b819-a4ba74582760] succeeded in 4.472389903000021s: None
2024-03-21T00:07:01.132268527Z [2024-03-21 00:07:01,131: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a68e0c99-c5b6-4146-b691-017aac6978fc] received
2024-03-21T00:07:01.136059876Z [2024-03-21 00:07:01,135: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b86c03ac-75aa-4018-9e6e-31582c3b9c1f] received
2024-03-21T00:07:01.142758464Z [2024-03-21 00:07:01,142: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a748bff0-c59e-4f8e-9187-7a21f4e80da1] received
2024-03-21T00:07:01.143013387Z [2024-03-21 00:07:01,142: INFO/ForkPoolWorker-16] [b86c03ac-75aa-4018-9e6e-31582c3b9c1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:07:01.149627734Z [2024-03-21 00:07:01,149: INFO/ForkPoolWorker-15] [a68e0c99-c5b6-4146-b691-017aac6978fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:07:01.153352459Z [2024-03-21 00:07:01,153: INFO/ForkPoolWorker-1] [a748bff0-c59e-4f8e-9187-7a21f4e80da1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:07:01.454412113Z [2024-03-21 00:07:01,450: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:07:01.561212296Z [2024-03-21 00:07:01,557: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:07:01.581213085Z [2024-03-21 00:07:01,577: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:07:01.714186847Z [2024-03-21 00:07:01,713: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T00:07:01.719508179Z [2024-03-21 00:07:01,718: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:07:01.754195380Z [2024-03-21 00:07:01,753: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:07:01.761566374Z [2024-03-21 00:07:01,761: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:07:01.762146903Z [2024-03-21 00:07:01,761: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:07:01.762956439Z [2024-03-21 00:07:01,762: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T00:07:01.764853037Z [2024-03-21 00:07:01,763: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:07:01.889244689Z [2024-03-21 00:07:01,888: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:07:02.795448817Z [2024-03-21 00:07:02,794: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b86c03ac-75aa-4018-9e6e-31582c3b9c1f] succeeded in 1.6578972920001434s: None
2024-03-21T00:07:03.047430281Z [2024-03-21 00:07:03,047: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:07:03.051697274Z [2024-03-21 00:07:03,051: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:07:03.072666219Z [2024-03-21 00:07:03,072: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:07:03.074138370Z [2024-03-21 00:07:03,073: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:07:03.074330683Z [2024-03-21 00:07:03,074: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:07:03.074560594Z [2024-03-21 00:07:03,074: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:07:03.074739113Z [2024-03-21 00:07:03,074: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:07:03.075225776Z [2024-03-21 00:07:03,074: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:07:03.075404975Z [2024-03-21 00:07:03,075: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:07:03.138472102Z [2024-03-21 00:07:03,138: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:07:03.142208950Z [2024-03-21 00:07:03,141: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:07:03.169609579Z [2024-03-21 00:07:03,169: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:07:03.173469627Z [2024-03-21 00:07:03,173: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:07:03.173652037Z [2024-03-21 00:07:03,173: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:07:03.173982505Z [2024-03-21 00:07:03,173: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:07:03.174212851Z [2024-03-21 00:07:03,174: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:07:03.174864510Z [2024-03-21 00:07:03,174: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:07:03.175137416Z [2024-03-21 00:07:03,174: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:07:03.176203519Z [2024-03-21 00:07:03,175: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:07:03.287241852Z [2024-03-21 00:07:03,286: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:07:05.164911364Z [2024-03-21 00:07:05,164: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a748bff0-c59e-4f8e-9187-7a21f4e80da1] succeeded in 4.018691177999699s: None
2024-03-21T00:07:05.449876339Z [2024-03-21 00:07:05,449: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a68e0c99-c5b6-4146-b691-017aac6978fc] succeeded in 4.312169686999823s: None
2024-03-21T00:08:00.323098987Z [2024-03-21 00:08:00,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61f0e114-966c-4c82-bb5b-dc6c10d8922d] received
2024-03-21T00:08:00.329365483Z [2024-03-21 00:08:00,329: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83f34ffb-c52c-45d9-8a75-3bf6554130e1] received
2024-03-21T00:08:00.331925548Z [2024-03-21 00:08:00,331: INFO/ForkPoolWorker-15] [61f0e114-966c-4c82-bb5b-dc6c10d8922d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:08:00.335801218Z [2024-03-21 00:08:00,335: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c860ea49-c0ef-40d0-a1ed-79a9cd996128] received
2024-03-21T00:08:00.339504782Z [2024-03-21 00:08:00,339: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68d401b2-5d9e-4d84-966b-ed4398257729] received
2024-03-21T00:08:00.340702154Z [2024-03-21 00:08:00,340: INFO/ForkPoolWorker-16] [83f34ffb-c52c-45d9-8a75-3bf6554130e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:08:00.347571699Z [2024-03-21 00:08:00,347: INFO/ForkPoolWorker-1] [c860ea49-c0ef-40d0-a1ed-79a9cd996128] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:08:00.351126119Z [2024-03-21 00:08:00,350: INFO/ForkPoolWorker-2] [68d401b2-5d9e-4d84-966b-ed4398257729] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:08:00.627974549Z [2024-03-21 00:08:00,624: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:08:00.644468698Z [2024-03-21 00:08:00,641: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:08:00.696658154Z [2024-03-21 00:08:00,693: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:08:00.699455225Z [2024-03-21 00:08:00,695: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:08:00.874987838Z [2024-03-21 00:08:00,874: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T00:08:00.879367842Z [2024-03-21 00:08:00,878: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:08:00.905321707Z [2024-03-21 00:08:00,905: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:08:00.906509928Z [2024-03-21 00:08:00,906: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:08:00.906736946Z [2024-03-21 00:08:00,906: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:08:00.906888977Z [2024-03-21 00:08:00,906: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T00:08:00.907217388Z [2024-03-21 00:08:00,907: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:08:00.970201234Z [2024-03-21 00:08:00,969: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:08:01.049959477Z [2024-03-21 00:08:01,049: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:08:01.621648671Z [2024-03-21 00:08:01,621: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[61f0e114-966c-4c82-bb5b-dc6c10d8922d] succeeded in 1.2967528299996047s: None
2024-03-21T00:08:01.728737164Z [2024-03-21 00:08:01,728: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[83f34ffb-c52c-45d9-8a75-3bf6554130e1] succeeded in 1.397117784999864s: None
2024-03-21T00:08:02.151882016Z [2024-03-21 00:08:02,151: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T00:08:02.155886830Z [2024-03-21 00:08:02,155: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:08:02.190180034Z [2024-03-21 00:08:02,189: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:08:02.191674962Z [2024-03-21 00:08:02,191: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:08:02.191726191Z [2024-03-21 00:08:02,191: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:08:02.191922371Z [2024-03-21 00:08:02,191: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:08:02.192093834Z [2024-03-21 00:08:02,191: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T00:08:02.192874748Z [2024-03-21 00:08:02,192: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:08:02.192896969Z [2024-03-21 00:08:02,192: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:08:02.218542179Z [2024-03-21 00:08:02,218: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:08:02.222457293Z [2024-03-21 00:08:02,221: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:08:02.308152779Z [2024-03-21 00:08:02,307: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:08:02.309772943Z [2024-03-21 00:08:02,309: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:08:02.310129923Z [2024-03-21 00:08:02,309: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:08:02.310437725Z [2024-03-21 00:08:02,310: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:08:02.310583706Z [2024-03-21 00:08:02,310: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:08:02.313079219Z [2024-03-21 00:08:02,311: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:08:02.313110304Z [2024-03-21 00:08:02,311: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:08:02.349200138Z [2024-03-21 00:08:02,348: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:08:02.475636167Z [2024-03-21 00:08:02,475: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:08:04.404800839Z [2024-03-21 00:08:04,404: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c860ea49-c0ef-40d0-a1ed-79a9cd996128] succeeded in 4.065409437999733s: None
2024-03-21T00:08:04.524197642Z [2024-03-21 00:08:04,523: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[68d401b2-5d9e-4d84-966b-ed4398257729] succeeded in 4.1810352130000865s: None
2024-03-21T00:09:00.538481123Z [2024-03-21 00:09:00,538: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b0dc0f3-18bf-4c67-b377-611ae7756e47] received
2024-03-21T00:09:00.546764455Z [2024-03-21 00:09:00,546: INFO/ForkPoolWorker-15] [8b0dc0f3-18bf-4c67-b377-611ae7756e47] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:09:00.547250091Z [2024-03-21 00:09:00,546: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[827bcefa-7849-4b26-9aa9-e0d0280474ef] received
2024-03-21T00:09:00.555274813Z [2024-03-21 00:09:00,555: INFO/ForkPoolWorker-16] [827bcefa-7849-4b26-9aa9-e0d0280474ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:09:00.558523155Z [2024-03-21 00:09:00,558: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8db9daf1-b6f0-4a1f-bcbf-a5a78b10129b] received
2024-03-21T00:09:00.568565570Z [2024-03-21 00:09:00,568: INFO/ForkPoolWorker-1] [8db9daf1-b6f0-4a1f-bcbf-a5a78b10129b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:09:00.847279042Z [2024-03-21 00:09:00,843: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:09:00.861911739Z [2024-03-21 00:09:00,858: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:09:00.928677667Z [2024-03-21 00:09:00,924: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:09:01.066964777Z [2024-03-21 00:09:01,066: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T00:09:01.072209518Z [2024-03-21 00:09:01,071: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:09:01.101050188Z [2024-03-21 00:09:01,100: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:09:01.103493799Z [2024-03-21 00:09:01,103: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:09:01.103746903Z [2024-03-21 00:09:01,103: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:09:01.103883499Z [2024-03-21 00:09:01,103: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T00:09:01.104265671Z [2024-03-21 00:09:01,104: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:09:01.236502308Z [2024-03-21 00:09:01,236: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:09:01.994167076Z [2024-03-21 00:09:01,993: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8db9daf1-b6f0-4a1f-bcbf-a5a78b10129b] succeeded in 1.4333364029998847s: None
2024-03-21T00:09:02.055045490Z [2024-03-21 00:09:02,054: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:09:02.059073826Z [2024-03-21 00:09:02,058: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:09:02.099202701Z [2024-03-21 00:09:02,098: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:09:02.102011347Z [2024-03-21 00:09:02,101: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:09:02.102366024Z [2024-03-21 00:09:02,102: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:09:02.102603291Z [2024-03-21 00:09:02,102: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:09:02.102812245Z [2024-03-21 00:09:02,102: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:09:02.103361688Z [2024-03-21 00:09:02,103: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:09:02.104771017Z [2024-03-21 00:09:02,103: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:09:02.218976397Z [2024-03-21 00:09:02,218: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:09:02.587901285Z [2024-03-21 00:09:02,587: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:09:02.591914369Z [2024-03-21 00:09:02,591: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:09:02.618581919Z [2024-03-21 00:09:02,618: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:09:02.620376879Z [2024-03-21 00:09:02,620: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:09:02.620669095Z [2024-03-21 00:09:02,620: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:09:02.621003620Z [2024-03-21 00:09:02,620: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:09:02.621218945Z [2024-03-21 00:09:02,621: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:09:02.621656051Z [2024-03-21 00:09:02,621: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:09:02.621857216Z [2024-03-21 00:09:02,621: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:09:02.729037555Z [2024-03-21 00:09:02,728: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:09:04.120108275Z [2024-03-21 00:09:04,119: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[827bcefa-7849-4b26-9aa9-e0d0280474ef] succeeded in 3.5709273269999358s: None
2024-03-21T00:09:04.512078560Z [2024-03-21 00:09:04,511: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8b0dc0f3-18bf-4c67-b377-611ae7756e47] succeeded in 3.971149811000032s: None
2024-03-21T00:10:00.490815757Z [2024-03-21 00:10:00,490: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5ce45ae-8717-4dbc-a787-e0a05ece3542] received
2024-03-21T00:10:00.492656903Z [2024-03-21 00:10:00,492: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aafbd662-6eb5-437e-92f2-1b4da887e378] received
2024-03-21T00:10:00.497497428Z [2024-03-21 00:10:00,497: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f30cb0e-f626-4408-8b4b-875278a956b7] received
2024-03-21T00:10:00.499260703Z [2024-03-21 00:10:00,499: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d00eddd4-108f-47e0-964d-e0f2ada72bc9] received
2024-03-21T00:10:00.501054645Z [2024-03-21 00:10:00,500: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e48465be-48c7-484b-a1e1-4889572bb247] received
2024-03-21T00:10:00.508739418Z [2024-03-21 00:10:00,508: INFO/ForkPoolWorker-15] [b5ce45ae-8717-4dbc-a787-e0a05ece3542] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:10:00.509768652Z [2024-03-21 00:10:00,509: INFO/ForkPoolWorker-1] [3f30cb0e-f626-4408-8b4b-875278a956b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:10:00.515641361Z [2024-03-21 00:10:00,515: INFO/ForkPoolWorker-2] [d00eddd4-108f-47e0-964d-e0f2ada72bc9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:10:00.516987422Z [2024-03-21 00:10:00,516: INFO/ForkPoolWorker-16] [aafbd662-6eb5-437e-92f2-1b4da887e378] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:10:00.528493359Z [2024-03-21 00:10:00,527: INFO/ForkPoolWorker-3] [e48465be-48c7-484b-a1e1-4889572bb247] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:10:00.893953003Z [2024-03-21 00:10:00,886: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:10:00.930380842Z [2024-03-21 00:10:00,927: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:10:01.068179099Z [2024-03-21 00:10:01,060: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:10:01.167308508Z [2024-03-21 00:10:01,163: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:10:01.203684004Z [2024-03-21 00:10:01,199: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:10:01.538112375Z [2024-03-21 00:10:01,537: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T00:10:01.542760889Z [2024-03-21 00:10:01,542: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:10:01.578172821Z [2024-03-21 00:10:01,577: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:10:01.608485991Z [2024-03-21 00:10:01,608: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:10:01.612230164Z [2024-03-21 00:10:01,611: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:10:01.612558583Z [2024-03-21 00:10:01,612: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:10:01.612628518Z [2024-03-21 00:10:01,612: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T00:10:01.612899706Z [2024-03-21 00:10:01,612: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:10:01.797702384Z [2024-03-21 00:10:01,797: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:10:02.703672806Z [2024-03-21 00:10:02,703: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3f30cb0e-f626-4408-8b4b-875278a956b7] succeeded in 2.203538734999711s: None
2024-03-21T00:10:02.854594894Z [2024-03-21 00:10:02,854: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aafbd662-6eb5-437e-92f2-1b4da887e378] succeeded in 2.360163400000147s: None
2024-03-21T00:10:03.164060217Z [2024-03-21 00:10:03,163: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T00:10:03.167639250Z [2024-03-21 00:10:03,167: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:10:03.199387896Z [2024-03-21 00:10:03,198: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:10:03.207092810Z [2024-03-21 00:10:03,206: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:10:03.207496540Z [2024-03-21 00:10:03,207: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:10:03.209291248Z [2024-03-21 00:10:03,209: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:10:03.209305789Z [2024-03-21 00:10:03,209: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:10:03.209512978Z [2024-03-21 00:10:03,209: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:10:03.209651821Z [2024-03-21 00:10:03,209: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T00:10:03.209984038Z [2024-03-21 00:10:03,209: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:10:03.209997236Z [2024-03-21 00:10:03,209: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:10:03.233648636Z [2024-03-21 00:10:03,233: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:10:03.235645391Z [2024-03-21 00:10:03,235: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:10:03.235679770Z [2024-03-21 00:10:03,235: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:10:03.235929420Z [2024-03-21 00:10:03,235: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:10:03.236058222Z [2024-03-21 00:10:03,235: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:10:03.236542890Z [2024-03-21 00:10:03,236: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:10:03.236730466Z [2024-03-21 00:10:03,236: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:10:03.262530881Z [2024-03-21 00:10:03,262: INFO/ForkPoolWorker-3] Getting VIM list
2024-03-21T00:10:03.267423816Z [2024-03-21 00:10:03,266: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:10:03.293094235Z [2024-03-21 00:10:03,292: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-21T00:10:03.294651147Z [2024-03-21 00:10:03,294: INFO/ForkPoolWorker-3] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:10:03.294663349Z [2024-03-21 00:10:03,294: INFO/ForkPoolWorker-3] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:10:03.294824165Z [2024-03-21 00:10:03,294: INFO/ForkPoolWorker-3] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:10:03.294835696Z [2024-03-21 00:10:03,294: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-03-21T00:10:03.295093771Z [2024-03-21 00:10:03,294: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:10:03.295192224Z [2024-03-21 00:10:03,295: INFO/ForkPoolWorker-3] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:10:03.338338384Z [2024-03-21 00:10:03,338: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:10:03.381089156Z [2024-03-21 00:10:03,380: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T00:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:10:03.418243103Z [2024-03-21 00:10:03,417: INFO/ForkPoolWorker-3] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:10:04.121138301Z [2024-03-21 00:10:04,120: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b5ce45ae-8717-4dbc-a787-e0a05ece3542] succeeded in 3.6269313600000714s: None
2024-03-21T00:10:04.990858555Z [2024-03-21 00:10:04,989: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[e48465be-48c7-484b-a1e1-4889572bb247] succeeded in 4.48263395999993s: None
2024-03-21T00:10:05.034918279Z [2024-03-21 00:10:05,034: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[571d58c8-37bb-4907-a28a-7c1dcd03497c] received
2024-03-21T00:10:05.049976457Z [2024-03-21 00:10:05,049: INFO/ForkPoolWorker-15] [571d58c8-37bb-4907-a28a-7c1dcd03497c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:10:05.194454071Z [2024-03-21 00:10:05,193: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d00eddd4-108f-47e0-964d-e0f2ada72bc9] succeeded in 4.692895147999934s: None
2024-03-21T00:10:05.376741753Z [2024-03-21 00:10:05,373: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:10:06.543081844Z [2024-03-21 00:10:06,542: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:10:06.546672685Z [2024-03-21 00:10:06,546: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:10:06.572868622Z [2024-03-21 00:10:06,572: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:10:06.574248245Z [2024-03-21 00:10:06,573: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:10:06.574274709Z [2024-03-21 00:10:06,574: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:10:06.574555192Z [2024-03-21 00:10:06,574: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:10:06.574589799Z [2024-03-21 00:10:06,574: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:10:06.574858724Z [2024-03-21 00:10:06,574: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:10:06.574914749Z [2024-03-21 00:10:06,574: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:10:06.652235012Z [2024-03-21 00:10:06,651: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T00:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:10:07.254102013Z [2024-03-21 00:10:07,253: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[571d58c8-37bb-4907-a28a-7c1dcd03497c] succeeded in 2.215707246999955s: None
2024-03-21T00:10:07.424034261Z [2024-03-21 00:10:07,423: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36ae029f-1d62-4ed4-8504-fba76e451804] received
2024-03-21T00:10:07.431635373Z [2024-03-21 00:10:07,431: INFO/ForkPoolWorker-15] [36ae029f-1d62-4ed4-8504-fba76e451804] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T00:10:07.708344585Z [2024-03-21 00:10:07,704: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:10:08.932691418Z [2024-03-21 00:10:08,930: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:10:08.944295156Z [2024-03-21 00:10:08,942: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:10:08.978636870Z [2024-03-21 00:10:08,978: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:10:08.979842978Z [2024-03-21 00:10:08,979: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:10:08.979861544Z [2024-03-21 00:10:08,979: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:10:08.979959741Z [2024-03-21 00:10:08,979: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:10:08.980013104Z [2024-03-21 00:10:08,979: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:10:08.980391078Z [2024-03-21 00:10:08,980: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:10:08.980402508Z [2024-03-21 00:10:08,980: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:10:09.098757716Z [2024-03-21 00:10:09,098: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T00:05:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:10:09.802886690Z [2024-03-21 00:10:09,802: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cdda6c47-bc12-4ec3-b620-e4b975771415] received
2024-03-21T00:10:09.821326494Z [2024-03-21 00:10:09,820: INFO/ForkPoolWorker-16] [cdda6c47-bc12-4ec3-b620-e4b975771415] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:10:09.864141266Z [2024-03-21 00:10:09,863: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[36ae029f-1d62-4ed4-8504-fba76e451804] succeeded in 2.437928256000305s: None
2024-03-21T00:10:10.163690590Z [2024-03-21 00:10:10,160: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:10:11.301934466Z [2024-03-21 00:10:11,301: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:10:11.305389426Z [2024-03-21 00:10:11,304: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:10:11.322378304Z [2024-03-21 00:10:11,322: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:10:11.323467820Z [2024-03-21 00:10:11,323: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:10:11.323498184Z [2024-03-21 00:10:11,323: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:10:11.323609920Z [2024-03-21 00:10:11,323: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:10:11.323658942Z [2024-03-21 00:10:11,323: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:10:11.323835917Z [2024-03-21 00:10:11,323: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:10:11.323861634Z [2024-03-21 00:10:11,323: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:10:11.403673350Z [2024-03-21 00:10:11,403: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T00:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:10:11.907213885Z [2024-03-21 00:10:11,906: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cdda6c47-bc12-4ec3-b620-e4b975771415] succeeded in 2.0989796680000836s: None
2024-03-21T00:11:00.422451602Z [2024-03-21 00:11:00,422: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05462a41-aaa2-47c9-8e83-8e81bcaf5b74] received
2024-03-21T00:11:00.424375280Z [2024-03-21 00:11:00,424: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33d15e6d-198a-41c5-92f4-d2b11d629e84] received
2024-03-21T00:11:00.428965937Z [2024-03-21 00:11:00,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e379ba5-02dd-446e-84de-15e716687574] received
2024-03-21T00:11:00.430789289Z [2024-03-21 00:11:00,430: INFO/ForkPoolWorker-15] [05462a41-aaa2-47c9-8e83-8e81bcaf5b74] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:11:00.437149780Z [2024-03-21 00:11:00,436: INFO/ForkPoolWorker-16] [33d15e6d-198a-41c5-92f4-d2b11d629e84] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:11:00.454391602Z [2024-03-21 00:11:00,453: INFO/ForkPoolWorker-1] [5e379ba5-02dd-446e-84de-15e716687574] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:11:00.723869212Z [2024-03-21 00:11:00,720: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:11:00.762787626Z [2024-03-21 00:11:00,759: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:11:00.808919710Z [2024-03-21 00:11:00,804: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:11:00.927881643Z [2024-03-21 00:11:00,927: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T00:11:00.931790532Z [2024-03-21 00:11:00,931: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:11:00.953122221Z [2024-03-21 00:11:00,952: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:11:00.954188065Z [2024-03-21 00:11:00,953: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:11:00.954246861Z [2024-03-21 00:11:00,954: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:11:00.954338612Z [2024-03-21 00:11:00,954: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T00:11:00.954603715Z [2024-03-21 00:11:00,954: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:11:01.073194687Z [2024-03-21 00:11:01,072: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:11:01.723350390Z [2024-03-21 00:11:01,722: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[05462a41-aaa2-47c9-8e83-8e81bcaf5b74] succeeded in 1.2979062819999854s: None
2024-03-21T00:11:02.087056039Z [2024-03-21 00:11:02,086: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:11:02.090761407Z [2024-03-21 00:11:02,090: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:11:02.126094557Z [2024-03-21 00:11:02,125: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:11:02.130101874Z [2024-03-21 00:11:02,129: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:11:02.130200670Z [2024-03-21 00:11:02,130: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:11:02.130702128Z [2024-03-21 00:11:02,130: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:11:02.131022417Z [2024-03-21 00:11:02,130: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:11:02.131669366Z [2024-03-21 00:11:02,131: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:11:02.131946661Z [2024-03-21 00:11:02,131: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:11:02.169827548Z [2024-03-21 00:11:02,169: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:11:02.173854941Z [2024-03-21 00:11:02,173: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:11:02.202302778Z [2024-03-21 00:11:02,202: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:11:02.203768678Z [2024-03-21 00:11:02,203: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:11:02.203818153Z [2024-03-21 00:11:02,203: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:11:02.203916477Z [2024-03-21 00:11:02,203: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:11:02.203935130Z [2024-03-21 00:11:02,203: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:11:02.204444810Z [2024-03-21 00:11:02,204: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:11:02.204546010Z [2024-03-21 00:11:02,204: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:11:02.280480257Z [2024-03-21 00:11:02,279: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:11:02.374144499Z [2024-03-21 00:11:02,373: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:11:04.436994398Z [2024-03-21 00:11:04,436: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5e379ba5-02dd-446e-84de-15e716687574] succeeded in 4.002698919000068s: None
2024-03-21T00:11:04.656560594Z [2024-03-21 00:11:04,656: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[33d15e6d-198a-41c5-92f4-d2b11d629e84] succeeded in 4.229380851999849s: None
2024-03-21T00:12:00.410012062Z [2024-03-21 00:12:00,409: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9c7f151-99c2-4a02-8f0f-9855e3a920aa] received
2024-03-21T00:12:00.412120285Z [2024-03-21 00:12:00,411: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f3a00f5-741d-4d44-83c6-0db7fa0b6589] received
2024-03-21T00:12:00.424789947Z [2024-03-21 00:12:00,424: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29247da6-bfc2-49fd-a01b-8a9eb3bd73b4] received
2024-03-21T00:12:00.428437555Z [2024-03-21 00:12:00,427: INFO/ForkPoolWorker-16] [1f3a00f5-741d-4d44-83c6-0db7fa0b6589] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:12:00.429166382Z [2024-03-21 00:12:00,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7d4b3fa-9542-4945-a603-b0f756bc47a2] received
2024-03-21T00:12:00.440962786Z [2024-03-21 00:12:00,440: INFO/ForkPoolWorker-1] [29247da6-bfc2-49fd-a01b-8a9eb3bd73b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:12:00.453034901Z [2024-03-21 00:12:00,452: INFO/ForkPoolWorker-2] [f7d4b3fa-9542-4945-a603-b0f756bc47a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:12:00.457163187Z [2024-03-21 00:12:00,456: INFO/ForkPoolWorker-15] [d9c7f151-99c2-4a02-8f0f-9855e3a920aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:12:00.820018166Z [2024-03-21 00:12:00,795: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:12:01.032267736Z [2024-03-21 00:12:01,029: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:12:01.062433157Z [2024-03-21 00:12:01,055: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:12:01.201147060Z [2024-03-21 00:12:01,195: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:12:01.351437405Z [2024-03-21 00:12:01,350: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T00:12:01.356866237Z [2024-03-21 00:12:01,356: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:12:01.403267326Z [2024-03-21 00:12:01,403: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:12:01.409604775Z [2024-03-21 00:12:01,409: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:12:01.409960459Z [2024-03-21 00:12:01,409: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:12:01.410285793Z [2024-03-21 00:12:01,410: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T00:12:01.410676338Z [2024-03-21 00:12:01,410: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:12:01.435688866Z [2024-03-21 00:12:01,435: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:12:01.540155004Z [2024-03-21 00:12:01,539: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:12:02.165772431Z [2024-03-21 00:12:02,165: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d9c7f151-99c2-4a02-8f0f-9855e3a920aa] succeeded in 1.7460360620002575s: None
2024-03-21T00:12:02.418061863Z [2024-03-21 00:12:02,417: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f7d4b3fa-9542-4945-a603-b0f756bc47a2] succeeded in 1.9856083130002844s: None
2024-03-21T00:12:02.683060179Z [2024-03-21 00:12:02,682: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:12:02.686532014Z [2024-03-21 00:12:02,686: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:12:02.711136571Z [2024-03-21 00:12:02,710: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:12:02.712899584Z [2024-03-21 00:12:02,712: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:12:02.713009700Z [2024-03-21 00:12:02,712: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:12:02.713389996Z [2024-03-21 00:12:02,713: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:12:02.713597887Z [2024-03-21 00:12:02,713: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:12:02.714026458Z [2024-03-21 00:12:02,713: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:12:02.714216227Z [2024-03-21 00:12:02,714: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:12:02.810830266Z [2024-03-21 00:12:02,810: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:12:03.034111577Z [2024-03-21 00:12:03,033: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:12:03.037915790Z [2024-03-21 00:12:03,037: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:12:03.058495791Z [2024-03-21 00:12:03,058: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:12:03.059964977Z [2024-03-21 00:12:03,059: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:12:03.059979981Z [2024-03-21 00:12:03,059: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:12:03.060200551Z [2024-03-21 00:12:03,060: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:12:03.060388653Z [2024-03-21 00:12:03,060: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:12:03.060704886Z [2024-03-21 00:12:03,060: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:12:03.060897084Z [2024-03-21 00:12:03,060: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:12:03.164002373Z [2024-03-21 00:12:03,163: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:12:04.335805683Z [2024-03-21 00:12:04,335: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[29247da6-bfc2-49fd-a01b-8a9eb3bd73b4] succeeded in 3.9080384730000333s: None
2024-03-21T00:12:05.271038103Z [2024-03-21 00:12:05,270: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1f3a00f5-741d-4d44-83c6-0db7fa0b6589] succeeded in 4.856096846000128s: None
2024-03-21T00:13:00.225785709Z [2024-03-21 00:13:00,225: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c701e29e-453c-4fbd-840c-aa365b0158c2] received
2024-03-21T00:13:00.228897442Z [2024-03-21 00:13:00,228: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f38d4e48-f8cd-42d3-b3a8-43585c8389f2] received
2024-03-21T00:13:00.234099045Z [2024-03-21 00:13:00,233: INFO/ForkPoolWorker-15] [c701e29e-453c-4fbd-840c-aa365b0158c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:13:00.235878466Z [2024-03-21 00:13:00,235: INFO/ForkPoolWorker-16] [f38d4e48-f8cd-42d3-b3a8-43585c8389f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:13:00.237835149Z [2024-03-21 00:13:00,237: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c6aeaf4-c10a-4bbd-aa3d-5ad91c9fac56] received
2024-03-21T00:13:00.245788111Z [2024-03-21 00:13:00,245: INFO/ForkPoolWorker-1] [5c6aeaf4-c10a-4bbd-aa3d-5ad91c9fac56] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:13:00.508612785Z [2024-03-21 00:13:00,505: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:13:00.557835702Z [2024-03-21 00:13:00,554: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:13:00.588834663Z [2024-03-21 00:13:00,585: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:13:00.756580190Z [2024-03-21 00:13:00,756: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T00:13:00.760922464Z [2024-03-21 00:13:00,760: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:13:00.790345854Z [2024-03-21 00:13:00,790: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:13:00.791406502Z [2024-03-21 00:13:00,791: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:13:00.791592607Z [2024-03-21 00:13:00,791: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:13:00.791976201Z [2024-03-21 00:13:00,791: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T00:13:00.792558699Z [2024-03-21 00:13:00,792: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:13:00.878240166Z [2024-03-21 00:13:00,877: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:13:01.489430902Z [2024-03-21 00:13:01,488: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5c6aeaf4-c10a-4bbd-aa3d-5ad91c9fac56] succeeded in 1.2497799829998257s: None
2024-03-21T00:13:01.690388280Z [2024-03-21 00:13:01,689: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:13:01.694198480Z [2024-03-21 00:13:01,693: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:13:01.714585976Z [2024-03-21 00:13:01,714: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:13:01.715264385Z [2024-03-21 00:13:01,714: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:13:01.716479998Z [2024-03-21 00:13:01,716: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:13:01.716505477Z [2024-03-21 00:13:01,716: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:13:01.716871959Z [2024-03-21 00:13:01,716: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:13:01.716905041Z [2024-03-21 00:13:01,716: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:13:01.717127381Z [2024-03-21 00:13:01,716: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:13:01.717216041Z [2024-03-21 00:13:01,717: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:13:01.724065447Z [2024-03-21 00:13:01,722: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:13:01.768125352Z [2024-03-21 00:13:01,767: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:13:01.775397924Z [2024-03-21 00:13:01,774: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:13:01.775476743Z [2024-03-21 00:13:01,775: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:13:01.777467507Z [2024-03-21 00:13:01,775: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:13:01.777489310Z [2024-03-21 00:13:01,776: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:13:01.777495528Z [2024-03-21 00:13:01,777: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:13:01.777500834Z [2024-03-21 00:13:01,777: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:13:01.873254030Z [2024-03-21 00:13:01,872: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:13:01.951953821Z [2024-03-21 00:13:01,951: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:13:03.635855058Z [2024-03-21 00:13:03,635: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f38d4e48-f8cd-42d3-b3a8-43585c8389f2] succeeded in 3.405243663999954s: None
2024-03-21T00:13:04.001103251Z [2024-03-21 00:13:04,000: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c701e29e-453c-4fbd-840c-aa365b0158c2] succeeded in 3.7734923819998585s: None
2024-03-21T00:14:01.235966050Z [2024-03-21 00:14:01,235: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[624e377c-8047-4438-a03f-b1e5962097f1] received
2024-03-21T00:14:01.242961450Z [2024-03-21 00:14:01,241: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb342aa1-0d8b-453b-bea6-4f59ae48895a] received
2024-03-21T00:14:01.246255206Z [2024-03-21 00:14:01,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[847b6e45-2684-4f7d-a78d-d2ba4701d254] received
2024-03-21T00:14:01.248681475Z [2024-03-21 00:14:01,247: INFO/ForkPoolWorker-15] [624e377c-8047-4438-a03f-b1e5962097f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:14:01.252412665Z [2024-03-21 00:14:01,252: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9436a1eb-1c02-4382-adab-9e69021f11fa] received
2024-03-21T00:14:01.265249162Z [2024-03-21 00:14:01,264: INFO/ForkPoolWorker-2] [9436a1eb-1c02-4382-adab-9e69021f11fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:14:01.274699134Z [2024-03-21 00:14:01,274: INFO/ForkPoolWorker-16] [fb342aa1-0d8b-453b-bea6-4f59ae48895a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:14:01.276332897Z [2024-03-21 00:14:01,275: INFO/ForkPoolWorker-1] [847b6e45-2684-4f7d-a78d-d2ba4701d254] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:14:01.623748371Z [2024-03-21 00:14:01,620: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:14:01.648607756Z [2024-03-21 00:14:01,645: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:14:01.696454061Z [2024-03-21 00:14:01,692: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:14:01.820921715Z [2024-03-21 00:14:01,814: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:14:01.987276847Z [2024-03-21 00:14:01,986: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:14:02.061390675Z [2024-03-21 00:14:02,060: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T00:14:02.065850932Z [2024-03-21 00:14:02,065: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:14:02.112265270Z [2024-03-21 00:14:02,111: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:14:02.114340253Z [2024-03-21 00:14:02,114: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:14:02.114685020Z [2024-03-21 00:14:02,114: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:14:02.114915555Z [2024-03-21 00:14:02,114: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T00:14:02.115404215Z [2024-03-21 00:14:02,115: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:14:02.270504057Z [2024-03-21 00:14:02,267: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:14:02.935109026Z [2024-03-21 00:14:02,934: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[624e377c-8047-4438-a03f-b1e5962097f1] succeeded in 1.696723646999999s: None
2024-03-21T00:14:03.308788320Z [2024-03-21 00:14:03,308: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fb342aa1-0d8b-453b-bea6-4f59ae48895a] succeeded in 2.0628250300001127s: None
2024-03-21T00:14:03.550351522Z [2024-03-21 00:14:03,549: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:14:03.555932613Z [2024-03-21 00:14:03,555: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:14:03.585764597Z [2024-03-21 00:14:03,585: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:14:03.587643086Z [2024-03-21 00:14:03,587: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:14:03.587875805Z [2024-03-21 00:14:03,587: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:14:03.588159957Z [2024-03-21 00:14:03,587: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:14:03.588207562Z [2024-03-21 00:14:03,588: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:14:03.588690383Z [2024-03-21 00:14:03,588: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:14:03.588863960Z [2024-03-21 00:14:03,588: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:14:03.691159112Z [2024-03-21 00:14:03,690: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T00:14:03.695126433Z [2024-03-21 00:14:03,694: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:14:03.700898203Z [2024-03-21 00:14:03,700: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:14:03.715880858Z [2024-03-21 00:14:03,715: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:14:03.717443834Z [2024-03-21 00:14:03,717: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:14:03.717486077Z [2024-03-21 00:14:03,717: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:14:03.717604248Z [2024-03-21 00:14:03,717: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:14:03.717662518Z [2024-03-21 00:14:03,717: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T00:14:03.717934344Z [2024-03-21 00:14:03,717: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:14:03.717979876Z [2024-03-21 00:14:03,717: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:14:03.818196244Z [2024-03-21 00:14:03,817: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:14:07.707928729Z [2024-03-21 00:14:07,707: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9436a1eb-1c02-4382-adab-9e69021f11fa] succeeded in 6.453759368000192s: None
2024-03-21T00:14:08.541943707Z [2024-03-21 00:14:08,541: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[847b6e45-2684-4f7d-a78d-d2ba4701d254] succeeded in 7.290214629999809s: None
2024-03-21T00:15:00.831454334Z [2024-03-21 00:15:00,831: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8a65b72-56de-4b02-8616-56196d045e88] received
2024-03-21T00:15:00.833627618Z [2024-03-21 00:15:00,833: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9cd4991-a164-42e7-a344-90b4ed96b822] received
2024-03-21T00:15:00.839138541Z [2024-03-21 00:15:00,838: INFO/ForkPoolWorker-15] [e8a65b72-56de-4b02-8616-56196d045e88] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:15:00.839314738Z [2024-03-21 00:15:00,838: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a991275-a9e1-488e-8585-5ced03d5f431] received
2024-03-21T00:15:00.844548766Z [2024-03-21 00:15:00,844: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24deb7ca-1775-4e74-b52f-3fa0aa35a548] received
2024-03-21T00:15:00.847313074Z [2024-03-21 00:15:00,847: INFO/ForkPoolWorker-16] [f9cd4991-a164-42e7-a344-90b4ed96b822] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:15:00.853937286Z [2024-03-21 00:15:00,853: INFO/ForkPoolWorker-1] [4a991275-a9e1-488e-8585-5ced03d5f431] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:15:00.856602764Z [2024-03-21 00:15:00,856: INFO/ForkPoolWorker-2] [24deb7ca-1775-4e74-b52f-3fa0aa35a548] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:15:01.164163230Z [2024-03-21 00:15:01,160: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:15:01.225834962Z [2024-03-21 00:15:01,222: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:15:01.304574529Z [2024-03-21 00:15:01,300: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:15:01.343116448Z [2024-03-21 00:15:01,340: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:15:01.383572134Z [2024-03-21 00:15:01,383: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T00:15:01.387844742Z [2024-03-21 00:15:01,387: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:15:01.421877062Z [2024-03-21 00:15:01,421: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:15:01.423873699Z [2024-03-21 00:15:01,423: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:15:01.424348534Z [2024-03-21 00:15:01,424: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:15:01.424553235Z [2024-03-21 00:15:01,424: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T00:15:01.424845435Z [2024-03-21 00:15:01,424: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:15:01.519451104Z [2024-03-21 00:15:01,519: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:15:02.136295840Z [2024-03-21 00:15:02,135: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e8a65b72-56de-4b02-8616-56196d045e88] succeeded in 1.303067060000103s: None
2024-03-21T00:15:02.637875079Z [2024-03-21 00:15:02,637: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:15:02.641754792Z [2024-03-21 00:15:02,641: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:15:02.665603181Z [2024-03-21 00:15:02,665: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:15:02.667366138Z [2024-03-21 00:15:02,667: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:15:02.667556711Z [2024-03-21 00:15:02,667: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:15:02.667815726Z [2024-03-21 00:15:02,667: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:15:02.667994987Z [2024-03-21 00:15:02,667: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:15:02.668884279Z [2024-03-21 00:15:02,668: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:15:02.669301281Z [2024-03-21 00:15:02,669: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:15:02.777633564Z [2024-03-21 00:15:02,777: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:15:02.791327826Z [2024-03-21 00:15:02,790: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T00:15:02.796626119Z [2024-03-21 00:15:02,796: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:15:02.806693870Z [2024-03-21 00:15:02,806: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:15:02.810896317Z [2024-03-21 00:15:02,810: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:15:02.826233191Z [2024-03-21 00:15:02,825: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:15:02.828824310Z [2024-03-21 00:15:02,828: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:15:02.828891613Z [2024-03-21 00:15:02,828: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:15:02.829163222Z [2024-03-21 00:15:02,828: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:15:02.829312372Z [2024-03-21 00:15:02,829: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T00:15:02.829807256Z [2024-03-21 00:15:02,829: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:15:02.829980015Z [2024-03-21 00:15:02,829: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:15:02.832555642Z [2024-03-21 00:15:02,832: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:15:02.834367605Z [2024-03-21 00:15:02,834: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:15:02.834388036Z [2024-03-21 00:15:02,834: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:15:02.834567424Z [2024-03-21 00:15:02,834: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:15:02.834612083Z [2024-03-21 00:15:02,834: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:15:02.834920125Z [2024-03-21 00:15:02,834: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:15:02.834943735Z [2024-03-21 00:15:02,834: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:15:02.938122735Z [2024-03-21 00:15:02,937: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:15:02.953730547Z [2024-03-21 00:15:02,953: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T00:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:15:03.606206016Z [2024-03-21 00:15:03,605: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f9cd4991-a164-42e7-a344-90b4ed96b822] succeeded in 2.7700649920002434s: None
2024-03-21T00:15:04.560799739Z [2024-03-21 00:15:04,560: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3765fc9-09cb-4f75-bf89-c5a6c0a32cc8] received
2024-03-21T00:15:04.569256628Z [2024-03-21 00:15:04,568: INFO/ForkPoolWorker-15] [b3765fc9-09cb-4f75-bf89-c5a6c0a32cc8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:15:04.689136462Z [2024-03-21 00:15:04,688: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4a991275-a9e1-488e-8585-5ced03d5f431] succeeded in 3.8478997889997117s: None
2024-03-21T00:15:04.900303348Z [2024-03-21 00:15:04,897: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:15:05.024903080Z [2024-03-21 00:15:05,024: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[24deb7ca-1775-4e74-b52f-3fa0aa35a548] succeeded in 4.176474482000231s: None
2024-03-21T00:15:06.031851795Z [2024-03-21 00:15:06,031: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:15:06.035375988Z [2024-03-21 00:15:06,034: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:15:06.059588384Z [2024-03-21 00:15:06,059: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:15:06.061870558Z [2024-03-21 00:15:06,060: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:15:06.061897723Z [2024-03-21 00:15:06,060: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:15:06.061905838Z [2024-03-21 00:15:06,061: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:15:06.061910753Z [2024-03-21 00:15:06,061: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:15:06.061950159Z [2024-03-21 00:15:06,061: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:15:06.065219573Z [2024-03-21 00:15:06,061: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:15:06.164693229Z [2024-03-21 00:15:06,164: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T00:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:15:06.835955643Z [2024-03-21 00:15:06,835: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b3765fc9-09cb-4f75-bf89-c5a6c0a32cc8] succeeded in 2.273090723000223s: None
2024-03-21T00:15:07.313238744Z [2024-03-21 00:15:07,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4cc2e7f-4443-4872-913c-51db58865475] received
2024-03-21T00:15:07.321608870Z [2024-03-21 00:15:07,321: INFO/ForkPoolWorker-15] [d4cc2e7f-4443-4872-913c-51db58865475] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T00:15:07.651137573Z [2024-03-21 00:15:07,647: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:15:08.882522871Z [2024-03-21 00:15:08,882: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:15:08.886672299Z [2024-03-21 00:15:08,886: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:15:08.913243151Z [2024-03-21 00:15:08,912: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:15:08.914684671Z [2024-03-21 00:15:08,914: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:15:08.914834476Z [2024-03-21 00:15:08,914: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:15:08.915100314Z [2024-03-21 00:15:08,914: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:15:08.915131739Z [2024-03-21 00:15:08,915: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:15:08.915434853Z [2024-03-21 00:15:08,915: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:15:08.915875851Z [2024-03-21 00:15:08,915: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:15:09.018881737Z [2024-03-21 00:15:09,018: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T00:10:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:15:09.907760863Z [2024-03-21 00:15:09,907: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d4cc2e7f-4443-4872-913c-51db58865475] succeeded in 2.591964834999999s: None
2024-03-21T00:15:10.834857985Z [2024-03-21 00:15:10,834: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28a45ed4-fab9-4e20-b414-708516383bde] received
2024-03-21T00:15:10.847538099Z [2024-03-21 00:15:10,846: INFO/ForkPoolWorker-15] [28a45ed4-fab9-4e20-b414-708516383bde] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:15:11.153078020Z [2024-03-21 00:15:11,149: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:15:12.486217463Z [2024-03-21 00:15:12,485: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:15:12.489936877Z [2024-03-21 00:15:12,489: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:15:12.521354934Z [2024-03-21 00:15:12,521: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:15:12.523171987Z [2024-03-21 00:15:12,522: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:15:12.523215519Z [2024-03-21 00:15:12,523: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:15:12.523524228Z [2024-03-21 00:15:12,523: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:15:12.523631913Z [2024-03-21 00:15:12,523: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:15:12.524241504Z [2024-03-21 00:15:12,523: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:15:12.524408039Z [2024-03-21 00:15:12,524: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:15:12.637313007Z [2024-03-21 00:15:12,636: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T00:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:15:13.257958470Z [2024-03-21 00:15:13,256: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[28a45ed4-fab9-4e20-b414-708516383bde] succeeded in 2.417568901999857s: None
2024-03-21T00:16:01.154931823Z [2024-03-21 00:16:01,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[623ab7b1-3c1f-4681-a5cb-8dd576dde14c] received
2024-03-21T00:16:01.161433798Z [2024-03-21 00:16:01,161: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f702e710-e18a-4f75-8017-63b75d7d52c8] received
2024-03-21T00:16:01.167932237Z [2024-03-21 00:16:01,167: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b56b50c7-6c3a-4be9-beb9-2b629983791c] received
2024-03-21T00:16:01.175955614Z [2024-03-21 00:16:01,175: INFO/ForkPoolWorker-16] [f702e710-e18a-4f75-8017-63b75d7d52c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:16:01.179900910Z [2024-03-21 00:16:01,179: INFO/ForkPoolWorker-1] [b56b50c7-6c3a-4be9-beb9-2b629983791c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:16:01.188333780Z [2024-03-21 00:16:01,187: INFO/ForkPoolWorker-15] [623ab7b1-3c1f-4681-a5cb-8dd576dde14c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:16:01.193657150Z [2024-03-21 00:16:01,193: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df451e5b-62ef-4824-a35b-91b13c153a75] received
2024-03-21T00:16:01.201270692Z [2024-03-21 00:16:01,201: INFO/ForkPoolWorker-2] [df451e5b-62ef-4824-a35b-91b13c153a75] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:16:01.536381808Z [2024-03-21 00:16:01,533: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:16:01.546316795Z [2024-03-21 00:16:01,542: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:16:01.558156905Z [2024-03-21 00:16:01,553: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:16:01.722269329Z [2024-03-21 00:16:01,721: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T00:16:01.726534890Z [2024-03-21 00:16:01,726: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:16:01.739993789Z [2024-03-21 00:16:01,733: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:16:01.768136939Z [2024-03-21 00:16:01,767: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:16:01.770308426Z [2024-03-21 00:16:01,770: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:16:01.770643540Z [2024-03-21 00:16:01,770: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:16:01.770937993Z [2024-03-21 00:16:01,770: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T00:16:01.771401454Z [2024-03-21 00:16:01,771: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:16:01.882347783Z [2024-03-21 00:16:01,882: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:16:02.154378565Z [2024-03-21 00:16:02,154: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:16:02.693936887Z [2024-03-21 00:16:02,693: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[df451e5b-62ef-4824-a35b-91b13c153a75] succeeded in 1.498181360000217s: None
2024-03-21T00:16:02.985100743Z [2024-03-21 00:16:02,984: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f702e710-e18a-4f75-8017-63b75d7d52c8] succeeded in 1.820721711999795s: None
2024-03-21T00:16:03.278128200Z [2024-03-21 00:16:03,277: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:16:03.281954977Z [2024-03-21 00:16:03,281: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:16:03.306345777Z [2024-03-21 00:16:03,306: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:16:03.307827113Z [2024-03-21 00:16:03,307: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:16:03.307981240Z [2024-03-21 00:16:03,307: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:16:03.308166545Z [2024-03-21 00:16:03,307: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:16:03.308265230Z [2024-03-21 00:16:03,308: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:16:03.308652077Z [2024-03-21 00:16:03,308: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:16:03.308787362Z [2024-03-21 00:16:03,308: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:16:03.397537591Z [2024-03-21 00:16:03,397: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:16:03.401203750Z [2024-03-21 00:16:03,400: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:16:03.417238725Z [2024-03-21 00:16:03,416: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:16:03.429792614Z [2024-03-21 00:16:03,429: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:16:03.432185865Z [2024-03-21 00:16:03,431: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:16:03.432202378Z [2024-03-21 00:16:03,432: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:16:03.432289773Z [2024-03-21 00:16:03,432: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:16:03.432370398Z [2024-03-21 00:16:03,432: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:16:03.433897554Z [2024-03-21 00:16:03,433: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:16:03.433924103Z [2024-03-21 00:16:03,433: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:16:03.523413945Z [2024-03-21 00:16:03,523: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:16:04.940477185Z [2024-03-21 00:16:04,939: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b56b50c7-6c3a-4be9-beb9-2b629983791c] succeeded in 3.7694646459999603s: None
2024-03-21T00:16:05.319681081Z [2024-03-21 00:16:05,319: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[623ab7b1-3c1f-4681-a5cb-8dd576dde14c] succeeded in 4.156238826999925s: None
2024-03-21T00:17:00.382961437Z [2024-03-21 00:17:00,382: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2eaeb8a3-0278-4aa8-90f8-d5305d73dd3b] received
2024-03-21T00:17:00.386727458Z [2024-03-21 00:17:00,386: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a3c48b5-8029-4d34-aa57-b453282f834a] received
2024-03-21T00:17:00.396799015Z [2024-03-21 00:17:00,396: INFO/ForkPoolWorker-16] [5a3c48b5-8029-4d34-aa57-b453282f834a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:17:00.400577243Z [2024-03-21 00:17:00,395: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7dbf6f09-cbc6-4b41-804b-d5c39a74ddc4] received
2024-03-21T00:17:00.400676320Z [2024-03-21 00:17:00,400: INFO/ForkPoolWorker-15] [2eaeb8a3-0278-4aa8-90f8-d5305d73dd3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:17:00.407675254Z [2024-03-21 00:17:00,407: INFO/ForkPoolWorker-1] [7dbf6f09-cbc6-4b41-804b-d5c39a74ddc4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:17:00.703361555Z [2024-03-21 00:17:00,700: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:17:00.713864153Z [2024-03-21 00:17:00,710: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:17:00.758239900Z [2024-03-21 00:17:00,754: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:17:00.866292172Z [2024-03-21 00:17:00,865: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T00:17:00.870054819Z [2024-03-21 00:17:00,869: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:17:00.894989926Z [2024-03-21 00:17:00,894: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:17:00.896179216Z [2024-03-21 00:17:00,895: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:17:00.896835205Z [2024-03-21 00:17:00,896: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:17:00.896933379Z [2024-03-21 00:17:00,896: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T00:17:00.897566883Z [2024-03-21 00:17:00,897: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:17:00.992224417Z [2024-03-21 00:17:00,991: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:17:01.554155906Z [2024-03-21 00:17:01,553: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5a3c48b5-8029-4d34-aa57-b453282f834a] succeeded in 1.1643999599996278s: None
2024-03-21T00:17:01.980782975Z [2024-03-21 00:17:01,980: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:17:01.984554973Z [2024-03-21 00:17:01,983: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:17:02.023039933Z [2024-03-21 00:17:02,022: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:17:02.025323842Z [2024-03-21 00:17:02,024: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:17:02.025558050Z [2024-03-21 00:17:02,025: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:17:02.025857495Z [2024-03-21 00:17:02,025: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:17:02.026024742Z [2024-03-21 00:17:02,025: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:17:02.026606925Z [2024-03-21 00:17:02,026: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:17:02.026807099Z [2024-03-21 00:17:02,026: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:17:02.133465210Z [2024-03-21 00:17:02,132: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:17:02.136912271Z [2024-03-21 00:17:02,136: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:17:02.157009519Z [2024-03-21 00:17:02,156: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:17:02.165904621Z [2024-03-21 00:17:02,165: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:17:02.168042984Z [2024-03-21 00:17:02,167: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:17:02.168160764Z [2024-03-21 00:17:02,167: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:17:02.168435627Z [2024-03-21 00:17:02,168: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:17:02.168582394Z [2024-03-21 00:17:02,168: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:17:02.169222645Z [2024-03-21 00:17:02,168: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:17:02.169242704Z [2024-03-21 00:17:02,169: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:17:02.343706004Z [2024-03-21 00:17:02,343: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:17:03.781390161Z [2024-03-21 00:17:03,780: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2eaeb8a3-0278-4aa8-90f8-d5305d73dd3b] succeeded in 3.391559189000418s: None
2024-03-21T00:17:04.205612315Z [2024-03-21 00:17:04,205: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7dbf6f09-cbc6-4b41-804b-d5c39a74ddc4] succeeded in 3.8030327860001307s: None
2024-03-21T00:18:00.925511621Z [2024-03-21 00:18:00,924: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4cf7b63-a8eb-45f3-968f-5397fe53ab5b] received
2024-03-21T00:18:00.930429287Z [2024-03-21 00:18:00,930: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27e8df35-8f99-4fe9-9d98-1859bf92f3a9] received
2024-03-21T00:18:00.936405052Z [2024-03-21 00:18:00,936: INFO/ForkPoolWorker-15] [b4cf7b63-a8eb-45f3-968f-5397fe53ab5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:18:00.941231775Z [2024-03-21 00:18:00,940: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71080cbd-b659-4dd4-994b-42606fe639d9] received
2024-03-21T00:18:00.942298991Z [2024-03-21 00:18:00,942: INFO/ForkPoolWorker-16] [27e8df35-8f99-4fe9-9d98-1859bf92f3a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:18:00.961933690Z [2024-03-21 00:18:00,961: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17e7d4f9-36fb-401a-91f0-0147f227c7e6] received
2024-03-21T00:18:00.967180764Z [2024-03-21 00:18:00,966: INFO/ForkPoolWorker-1] [71080cbd-b659-4dd4-994b-42606fe639d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:18:00.986683140Z [2024-03-21 00:18:00,986: INFO/ForkPoolWorker-2] [17e7d4f9-36fb-401a-91f0-0147f227c7e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:18:01.335467618Z [2024-03-21 00:18:01,331: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:18:01.373825460Z [2024-03-21 00:18:01,370: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:18:01.420207286Z [2024-03-21 00:18:01,417: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:18:01.471678117Z [2024-03-21 00:18:01,466: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:18:01.591315464Z [2024-03-21 00:18:01,590: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T00:18:01.596179221Z [2024-03-21 00:18:01,595: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:18:01.635705016Z [2024-03-21 00:18:01,635: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:18:01.637606891Z [2024-03-21 00:18:01,637: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:18:01.637930822Z [2024-03-21 00:18:01,637: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:18:01.637984177Z [2024-03-21 00:18:01,637: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T00:18:01.638290580Z [2024-03-21 00:18:01,638: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:18:01.716940591Z [2024-03-21 00:18:01,716: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:18:01.802837375Z [2024-03-21 00:18:01,802: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:18:02.480119894Z [2024-03-21 00:18:02,479: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[27e8df35-8f99-4fe9-9d98-1859bf92f3a9] succeeded in 1.5458535480001956s: None
2024-03-21T00:18:02.742446044Z [2024-03-21 00:18:02,741: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b4cf7b63-a8eb-45f3-968f-5397fe53ab5b] succeeded in 1.8146381159999692s: None
2024-03-21T00:18:03.177022128Z [2024-03-21 00:18:03,176: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:18:03.180841395Z [2024-03-21 00:18:03,180: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:18:03.200141109Z [2024-03-21 00:18:03,199: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:18:03.202116635Z [2024-03-21 00:18:03,201: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:18:03.202353832Z [2024-03-21 00:18:03,202: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:18:03.202687376Z [2024-03-21 00:18:03,202: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:18:03.202895993Z [2024-03-21 00:18:03,202: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:18:03.203253989Z [2024-03-21 00:18:03,203: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:18:03.203415790Z [2024-03-21 00:18:03,203: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:18:03.206735166Z [2024-03-21 00:18:03,206: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T00:18:03.212817745Z [2024-03-21 00:18:03,211: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:18:03.237474412Z [2024-03-21 00:18:03,237: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:18:03.241155857Z [2024-03-21 00:18:03,240: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:18:03.241307746Z [2024-03-21 00:18:03,241: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:18:03.241550485Z [2024-03-21 00:18:03,241: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:18:03.241677762Z [2024-03-21 00:18:03,241: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T00:18:03.242023533Z [2024-03-21 00:18:03,241: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:18:03.242153942Z [2024-03-21 00:18:03,242: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:18:03.286164081Z [2024-03-21 00:18:03,285: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:18:03.327330628Z [2024-03-21 00:18:03,326: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:18:04.772436313Z [2024-03-21 00:18:04,771: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[17e7d4f9-36fb-401a-91f0-0147f227c7e6] succeeded in 3.803913018000003s: None
2024-03-21T00:18:05.756129505Z [2024-03-21 00:18:05,755: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[71080cbd-b659-4dd4-994b-42606fe639d9] succeeded in 4.806228417000057s: None
2024-03-21T00:19:00.620349690Z [2024-03-21 00:19:00,620: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1be20846-7403-4279-b31d-8c4c1ca4bcbc] received
2024-03-21T00:19:00.627378227Z [2024-03-21 00:19:00,627: INFO/ForkPoolWorker-15] [1be20846-7403-4279-b31d-8c4c1ca4bcbc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:19:00.628940123Z [2024-03-21 00:19:00,628: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a024e3ed-887b-4632-b012-7c86909ff324] received
2024-03-21T00:19:00.641342769Z [2024-03-21 00:19:00,640: INFO/ForkPoolWorker-16] [a024e3ed-887b-4632-b012-7c86909ff324] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:19:00.645903742Z [2024-03-21 00:19:00,645: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73c86310-d88a-4f9c-9ed0-e5e36cceb933] received
2024-03-21T00:19:00.652051867Z [2024-03-21 00:19:00,651: INFO/ForkPoolWorker-1] [73c86310-d88a-4f9c-9ed0-e5e36cceb933] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:19:00.945917250Z [2024-03-21 00:19:00,942: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:19:00.951533234Z [2024-03-21 00:19:00,948: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:19:00.972381059Z [2024-03-21 00:19:00,969: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:19:01.134215169Z [2024-03-21 00:19:01,133: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T00:19:01.138768554Z [2024-03-21 00:19:01,138: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:19:01.161633681Z [2024-03-21 00:19:01,161: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:19:01.162648509Z [2024-03-21 00:19:01,162: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:19:01.162881768Z [2024-03-21 00:19:01,162: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:19:01.162999845Z [2024-03-21 00:19:01,162: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T00:19:01.163251541Z [2024-03-21 00:19:01,163: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:19:01.252666664Z [2024-03-21 00:19:01,252: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:19:02.088958996Z [2024-03-21 00:19:02,088: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[73c86310-d88a-4f9c-9ed0-e5e36cceb933] succeeded in 1.441573352999967s: None
2024-03-21T00:19:02.531322590Z [2024-03-21 00:19:02,530: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:19:02.535135418Z [2024-03-21 00:19:02,534: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:19:02.550939405Z [2024-03-21 00:19:02,550: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:19:02.552416538Z [2024-03-21 00:19:02,552: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:19:02.552613778Z [2024-03-21 00:19:02,552: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:19:02.552826267Z [2024-03-21 00:19:02,552: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:19:02.552968631Z [2024-03-21 00:19:02,552: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:19:02.553456072Z [2024-03-21 00:19:02,553: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:19:02.553608702Z [2024-03-21 00:19:02,553: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:19:02.594780518Z [2024-03-21 00:19:02,594: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:19:02.598678314Z [2024-03-21 00:19:02,598: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:19:02.620992666Z [2024-03-21 00:19:02,620: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:19:02.622345421Z [2024-03-21 00:19:02,622: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:19:02.622438533Z [2024-03-21 00:19:02,622: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:19:02.622641707Z [2024-03-21 00:19:02,622: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:19:02.622743052Z [2024-03-21 00:19:02,622: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:19:02.623031974Z [2024-03-21 00:19:02,622: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:19:02.623080690Z [2024-03-21 00:19:02,622: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:19:02.643257461Z [2024-03-21 00:19:02,642: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:19:02.702650477Z [2024-03-21 00:19:02,702: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:19:04.200933921Z [2024-03-21 00:19:04,200: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a024e3ed-887b-4632-b012-7c86909ff324] succeeded in 3.569988285999898s: None
2024-03-21T00:19:04.678302026Z [2024-03-21 00:19:04,677: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1be20846-7403-4279-b31d-8c4c1ca4bcbc] succeeded in 4.05639303199996s: None
2024-03-21T00:20:00.373509422Z [2024-03-21 00:20:00,373: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08563077-ce93-4434-acbd-24241510c2e8] received
2024-03-21T00:20:00.375676623Z [2024-03-21 00:20:00,375: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c5575df-9611-400a-ab1d-8109412dd688] received
2024-03-21T00:20:00.384030221Z [2024-03-21 00:20:00,383: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f0ef9cf-2d98-4296-9b84-1e75aaac3d0c] received
2024-03-21T00:20:00.384987597Z [2024-03-21 00:20:00,384: INFO/ForkPoolWorker-16] [8c5575df-9611-400a-ab1d-8109412dd688] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:20:00.385634878Z [2024-03-21 00:20:00,385: INFO/ForkPoolWorker-15] [08563077-ce93-4434-acbd-24241510c2e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:20:00.395008323Z [2024-03-21 00:20:00,394: INFO/ForkPoolWorker-1] [6f0ef9cf-2d98-4296-9b84-1e75aaac3d0c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:20:00.399395317Z [2024-03-21 00:20:00,399: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a25096fd-6c14-4217-ad7f-86cf990d5e06] received
2024-03-21T00:20:00.402692575Z [2024-03-21 00:20:00,402: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3b75db6-056c-4ccd-b2d3-e8ea4a1814df] received
2024-03-21T00:20:00.422107688Z [2024-03-21 00:20:00,421: INFO/ForkPoolWorker-2] [a25096fd-6c14-4217-ad7f-86cf990d5e06] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:20:00.427284563Z [2024-03-21 00:20:00,426: INFO/ForkPoolWorker-3] [a3b75db6-056c-4ccd-b2d3-e8ea4a1814df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:20:00.965276643Z [2024-03-21 00:20:00,961: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:20:00.980836228Z [2024-03-21 00:20:00,977: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:20:01.059162583Z [2024-03-21 00:20:01,055: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:20:01.081102490Z [2024-03-21 00:20:01,077: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:20:01.089534062Z [2024-03-21 00:20:01,086: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:20:01.344751767Z [2024-03-21 00:20:01,344: INFO/ForkPoolWorker-2] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:20:01.451954450Z [2024-03-21 00:20:01,451: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T00:20:01.456868645Z [2024-03-21 00:20:01,456: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:20:01.505341495Z [2024-03-21 00:20:01,505: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:20:01.509381219Z [2024-03-21 00:20:01,509: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:20:01.509596633Z [2024-03-21 00:20:01,509: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:20:01.509720070Z [2024-03-21 00:20:01,509: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T00:20:01.510022880Z [2024-03-21 00:20:01,509: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:20:01.786959080Z [2024-03-21 00:20:01,786: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:20:02.023622438Z [2024-03-21 00:20:02,023: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a25096fd-6c14-4217-ad7f-86cf990d5e06] succeeded in 1.6228250159997515s: None
2024-03-21T00:20:02.815183266Z [2024-03-21 00:20:02,814: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[08563077-ce93-4434-acbd-24241510c2e8] succeeded in 2.4386507770000208s: None
2024-03-21T00:20:03.181396317Z [2024-03-21 00:20:03,180: INFO/ForkPoolWorker-3] Getting VIM list
2024-03-21T00:20:03.185220818Z [2024-03-21 00:20:03,184: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:20:03.208298375Z [2024-03-21 00:20:03,208: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-21T00:20:03.209846066Z [2024-03-21 00:20:03,209: INFO/ForkPoolWorker-3] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:20:03.209979136Z [2024-03-21 00:20:03,209: INFO/ForkPoolWorker-3] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:20:03.210242916Z [2024-03-21 00:20:03,210: INFO/ForkPoolWorker-3] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:20:03.210330691Z [2024-03-21 00:20:03,210: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-03-21T00:20:03.211014773Z [2024-03-21 00:20:03,210: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:20:03.211039947Z [2024-03-21 00:20:03,210: INFO/ForkPoolWorker-3] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:20:03.383628176Z [2024-03-21 00:20:03,383: INFO/ForkPoolWorker-3] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:20:03.402571373Z [2024-03-21 00:20:03,402: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:20:03.413407613Z [2024-03-21 00:20:03,412: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:20:03.429700194Z [2024-03-21 00:20:03,429: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:20:03.433640113Z [2024-03-21 00:20:03,433: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:20:03.468146636Z [2024-03-21 00:20:03,467: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:20:03.470279996Z [2024-03-21 00:20:03,469: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:20:03.470337788Z [2024-03-21 00:20:03,470: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:20:03.470539663Z [2024-03-21 00:20:03,470: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:20:03.470602138Z [2024-03-21 00:20:03,470: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:20:03.470990908Z [2024-03-21 00:20:03,470: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:20:03.471049816Z [2024-03-21 00:20:03,470: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:20:03.490226902Z [2024-03-21 00:20:03,489: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:20:03.497287502Z [2024-03-21 00:20:03,496: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:20:03.497327060Z [2024-03-21 00:20:03,497: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:20:03.497416192Z [2024-03-21 00:20:03,497: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:20:03.497464032Z [2024-03-21 00:20:03,497: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:20:03.497756904Z [2024-03-21 00:20:03,497: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:20:03.497774327Z [2024-03-21 00:20:03,497: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:20:03.667293509Z [2024-03-21 00:20:03,666: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T00:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:20:03.680222538Z [2024-03-21 00:20:03,679: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:20:04.538922365Z [2024-03-21 00:20:04,538: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8c5575df-9611-400a-ab1d-8109412dd688] succeeded in 4.1612410539996745s: None
2024-03-21T00:20:04.836676882Z [2024-03-21 00:20:04,836: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[966d7b8f-c0eb-48d0-921c-7a121c77cfdf] received
2024-03-21T00:20:04.844527905Z [2024-03-21 00:20:04,844: INFO/ForkPoolWorker-15] [966d7b8f-c0eb-48d0-921c-7a121c77cfdf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:20:05.178507129Z [2024-03-21 00:20:05,175: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:20:05.209028454Z [2024-03-21 00:20:05,208: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[a3b75db6-056c-4ccd-b2d3-e8ea4a1814df] succeeded in 4.795476961999611s: None
2024-03-21T00:20:05.703416933Z [2024-03-21 00:20:05,702: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6f0ef9cf-2d98-4296-9b84-1e75aaac3d0c] succeeded in 5.312706070000331s: None
2024-03-21T00:20:06.395262130Z [2024-03-21 00:20:06,394: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:20:06.398806404Z [2024-03-21 00:20:06,398: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:20:06.418928734Z [2024-03-21 00:20:06,418: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:20:06.420187129Z [2024-03-21 00:20:06,419: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:20:06.420207547Z [2024-03-21 00:20:06,420: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:20:06.420444970Z [2024-03-21 00:20:06,420: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:20:06.420470530Z [2024-03-21 00:20:06,420: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:20:06.420693813Z [2024-03-21 00:20:06,420: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:20:06.420714263Z [2024-03-21 00:20:06,420: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:20:06.508578011Z [2024-03-21 00:20:06,508: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T00:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:20:07.111572614Z [2024-03-21 00:20:07,110: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[966d7b8f-c0eb-48d0-921c-7a121c77cfdf] succeeded in 2.2716942290003317s: None
2024-03-21T00:20:08.083879909Z [2024-03-21 00:20:08,083: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9135e775-0dd6-44af-9359-104d793817cf] received
2024-03-21T00:20:08.090700205Z [2024-03-21 00:20:08,090: INFO/ForkPoolWorker-15] [9135e775-0dd6-44af-9359-104d793817cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T00:20:08.397613483Z [2024-03-21 00:20:08,394: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:20:09.695194318Z [2024-03-21 00:20:09,694: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:20:09.698746751Z [2024-03-21 00:20:09,698: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:20:09.718762210Z [2024-03-21 00:20:09,718: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:20:09.719981659Z [2024-03-21 00:20:09,719: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:20:09.719996794Z [2024-03-21 00:20:09,719: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:20:09.720118182Z [2024-03-21 00:20:09,719: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:20:09.720131113Z [2024-03-21 00:20:09,720: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:20:09.720451099Z [2024-03-21 00:20:09,720: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:20:09.720558551Z [2024-03-21 00:20:09,720: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:20:09.811988340Z [2024-03-21 00:20:09,811: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T00:15:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:20:10.322265083Z [2024-03-21 00:20:10,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8696494c-0a04-4cb1-b8e6-003195e2490b] received
2024-03-21T00:20:10.340444762Z [2024-03-21 00:20:10,339: INFO/ForkPoolWorker-16] [8696494c-0a04-4cb1-b8e6-003195e2490b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:20:10.404558574Z [2024-03-21 00:20:10,403: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9135e775-0dd6-44af-9359-104d793817cf] succeeded in 2.3189344849997724s: None
2024-03-21T00:20:10.707538402Z [2024-03-21 00:20:10,704: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:20:11.884699487Z [2024-03-21 00:20:11,884: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:20:11.888183788Z [2024-03-21 00:20:11,887: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:20:11.907338345Z [2024-03-21 00:20:11,907: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:20:11.909613499Z [2024-03-21 00:20:11,909: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:20:11.909704193Z [2024-03-21 00:20:11,909: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:20:11.909903785Z [2024-03-21 00:20:11,909: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:20:11.909990159Z [2024-03-21 00:20:11,909: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:20:11.910380674Z [2024-03-21 00:20:11,910: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:20:11.910385013Z [2024-03-21 00:20:11,910: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:20:11.986691865Z [2024-03-21 00:20:11,986: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T00:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:20:12.567084726Z [2024-03-21 00:20:12,566: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8696494c-0a04-4cb1-b8e6-003195e2490b] succeeded in 2.2399745679999796s: None
2024-03-21T00:21:00.754634506Z [2024-03-21 00:21:00,754: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9641f5a-4309-42b8-ac5d-e4938de423fe] received
2024-03-21T00:21:00.767546091Z [2024-03-21 00:21:00,767: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[815398b2-8b29-4d9b-8092-6dc3b3010476] received
2024-03-21T00:21:00.767614759Z [2024-03-21 00:21:00,767: INFO/ForkPoolWorker-15] [b9641f5a-4309-42b8-ac5d-e4938de423fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:21:00.777172535Z [2024-03-21 00:21:00,776: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0658c565-ea20-468e-8c0e-546c6d20be88] received
2024-03-21T00:21:00.783820262Z [2024-03-21 00:21:00,783: INFO/ForkPoolWorker-16] [815398b2-8b29-4d9b-8092-6dc3b3010476] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:21:00.791779701Z [2024-03-21 00:21:00,791: INFO/ForkPoolWorker-1] [0658c565-ea20-468e-8c0e-546c6d20be88] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:21:01.148654485Z [2024-03-21 00:21:01,143: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:21:01.217343012Z [2024-03-21 00:21:01,212: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:21:01.220068561Z [2024-03-21 00:21:01,216: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:21:01.393903349Z [2024-03-21 00:21:01,393: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T00:21:01.398164947Z [2024-03-21 00:21:01,397: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:21:01.420230803Z [2024-03-21 00:21:01,420: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:21:01.421765867Z [2024-03-21 00:21:01,421: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:21:01.421924936Z [2024-03-21 00:21:01,421: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:21:01.421985129Z [2024-03-21 00:21:01,421: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T00:21:01.422530400Z [2024-03-21 00:21:01,422: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:21:01.533204844Z [2024-03-21 00:21:01,532: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:21:02.477939395Z [2024-03-21 00:21:02,477: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[815398b2-8b29-4d9b-8092-6dc3b3010476] succeeded in 1.7066607020001356s: None
2024-03-21T00:21:02.759083042Z [2024-03-21 00:21:02,758: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:21:02.762845928Z [2024-03-21 00:21:02,762: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:21:02.787987336Z [2024-03-21 00:21:02,787: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:21:02.790385303Z [2024-03-21 00:21:02,790: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:21:02.790865189Z [2024-03-21 00:21:02,790: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:21:02.791079822Z [2024-03-21 00:21:02,790: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:21:02.791148403Z [2024-03-21 00:21:02,791: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:21:02.791439215Z [2024-03-21 00:21:02,791: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:21:02.791509281Z [2024-03-21 00:21:02,791: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:21:02.855501419Z [2024-03-21 00:21:02,855: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:21:02.860586036Z [2024-03-21 00:21:02,859: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:21:02.888755189Z [2024-03-21 00:21:02,888: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:21:02.890194613Z [2024-03-21 00:21:02,889: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:21:02.890252146Z [2024-03-21 00:21:02,890: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:21:02.890437647Z [2024-03-21 00:21:02,890: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:21:02.890498804Z [2024-03-21 00:21:02,890: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:21:02.890778786Z [2024-03-21 00:21:02,890: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:21:02.890846720Z [2024-03-21 00:21:02,890: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:21:02.898258823Z [2024-03-21 00:21:02,897: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:21:02.986041463Z [2024-03-21 00:21:02,985: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:21:04.839730489Z [2024-03-21 00:21:04,839: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0658c565-ea20-468e-8c0e-546c6d20be88] succeeded in 4.05772865400013s: None
2024-03-21T00:21:05.055554359Z [2024-03-21 00:21:05,055: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b9641f5a-4309-42b8-ac5d-e4938de423fe] succeeded in 4.297759611999936s: None
2024-03-21T00:22:01.117650175Z [2024-03-21 00:22:01,117: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2822b07e-fa93-4a51-ad5e-6909db3aef29] received
2024-03-21T00:22:01.119936648Z [2024-03-21 00:22:01,119: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb7326a9-c09d-4b69-9efc-c78c94f1547f] received
2024-03-21T00:22:01.122984632Z [2024-03-21 00:22:01,122: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2052c1ad-0cdf-4905-a73b-afd1b8b2bff1] received
2024-03-21T00:22:01.127174941Z [2024-03-21 00:22:01,126: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35e1d7e7-82ec-4545-b1af-7a18a16f6dec] received
2024-03-21T00:22:01.128879687Z [2024-03-21 00:22:01,128: INFO/ForkPoolWorker-15] [2822b07e-fa93-4a51-ad5e-6909db3aef29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:22:01.135736878Z [2024-03-21 00:22:01,135: INFO/ForkPoolWorker-16] [bb7326a9-c09d-4b69-9efc-c78c94f1547f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:22:01.140794686Z [2024-03-21 00:22:01,140: INFO/ForkPoolWorker-2] [35e1d7e7-82ec-4545-b1af-7a18a16f6dec] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:22:01.141403350Z [2024-03-21 00:22:01,141: INFO/ForkPoolWorker-1] [2052c1ad-0cdf-4905-a73b-afd1b8b2bff1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:22:01.491070353Z [2024-03-21 00:22:01,487: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:22:01.565784843Z [2024-03-21 00:22:01,562: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:22:01.705964948Z [2024-03-21 00:22:01,701: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:22:01.729238732Z [2024-03-21 00:22:01,725: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:22:01.860196163Z [2024-03-21 00:22:01,859: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:22:01.985252534Z [2024-03-21 00:22:01,984: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T00:22:01.995200469Z [2024-03-21 00:22:01,994: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:22:02.067752169Z [2024-03-21 00:22:02,067: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:22:02.081169144Z [2024-03-21 00:22:02,080: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:22:02.084933094Z [2024-03-21 00:22:02,081: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:22:02.088345315Z [2024-03-21 00:22:02,084: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T00:22:02.093039864Z [2024-03-21 00:22:02,092: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:22:02.307318615Z [2024-03-21 00:22:02,307: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:22:02.813616834Z [2024-03-21 00:22:02,813: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bb7326a9-c09d-4b69-9efc-c78c94f1547f] succeeded in 1.691300210999998s: None
2024-03-21T00:22:03.272433867Z [2024-03-21 00:22:03,272: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[35e1d7e7-82ec-4545-b1af-7a18a16f6dec] succeeded in 2.139202927000042s: None
2024-03-21T00:22:03.745977104Z [2024-03-21 00:22:03,744: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:22:03.753974405Z [2024-03-21 00:22:03,753: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:22:03.761417696Z [2024-03-21 00:22:03,761: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:22:03.765332782Z [2024-03-21 00:22:03,764: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:22:03.781944059Z [2024-03-21 00:22:03,781: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:22:03.785256420Z [2024-03-21 00:22:03,784: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:22:03.785273842Z [2024-03-21 00:22:03,785: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:22:03.785418617Z [2024-03-21 00:22:03,785: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:22:03.785430986Z [2024-03-21 00:22:03,785: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:22:03.785710724Z [2024-03-21 00:22:03,785: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:22:03.785767456Z [2024-03-21 00:22:03,785: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:22:03.798640379Z [2024-03-21 00:22:03,798: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:22:03.799981451Z [2024-03-21 00:22:03,799: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:22:03.799996981Z [2024-03-21 00:22:03,799: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:22:03.800096109Z [2024-03-21 00:22:03,799: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:22:03.800103172Z [2024-03-21 00:22:03,800: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:22:03.800460933Z [2024-03-21 00:22:03,800: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:22:03.800915176Z [2024-03-21 00:22:03,800: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:22:03.885273507Z [2024-03-21 00:22:03,885: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:22:03.919326794Z [2024-03-21 00:22:03,919: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:22:06.021864408Z [2024-03-21 00:22:06,021: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2822b07e-fa93-4a51-ad5e-6909db3aef29] succeeded in 4.900051820000044s: None
2024-03-21T00:22:07.086069891Z [2024-03-21 00:22:07,085: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2052c1ad-0cdf-4905-a73b-afd1b8b2bff1] succeeded in 5.959455561000141s: None
2024-03-21T00:23:00.474465366Z [2024-03-21 00:23:00,474: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae6affc5-c8fd-42ea-b3e7-f8ca75aeade8] received
2024-03-21T00:23:00.476338696Z [2024-03-21 00:23:00,476: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f02e7f1c-9f55-4cbc-84d2-4da5675befd3] received
2024-03-21T00:23:00.483817808Z [2024-03-21 00:23:00,483: INFO/ForkPoolWorker-16] [f02e7f1c-9f55-4cbc-84d2-4da5675befd3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:23:00.484423992Z [2024-03-21 00:23:00,484: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abee73b8-99c6-4c59-af32-d280e6de5679] received
2024-03-21T00:23:00.495388850Z [2024-03-21 00:23:00,494: INFO/ForkPoolWorker-1] [abee73b8-99c6-4c59-af32-d280e6de5679] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:23:00.496840543Z [2024-03-21 00:23:00,496: INFO/ForkPoolWorker-15] [ae6affc5-c8fd-42ea-b3e7-f8ca75aeade8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:23:00.764434501Z [2024-03-21 00:23:00,760: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:23:00.891305462Z [2024-03-21 00:23:00,887: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:23:00.979374166Z [2024-03-21 00:23:00,975: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:23:01.102244222Z [2024-03-21 00:23:01,101: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T00:23:01.109833242Z [2024-03-21 00:23:01,108: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:23:01.136976064Z [2024-03-21 00:23:01,136: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:23:01.139215625Z [2024-03-21 00:23:01,138: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:23:01.139693360Z [2024-03-21 00:23:01,139: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:23:01.139858816Z [2024-03-21 00:23:01,139: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T00:23:01.140166193Z [2024-03-21 00:23:01,140: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:23:01.278474762Z [2024-03-21 00:23:01,278: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:23:02.041151327Z [2024-03-21 00:23:02,040: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[abee73b8-99c6-4c59-af32-d280e6de5679] succeeded in 1.553462751999632s: None
2024-03-21T00:23:02.354217659Z [2024-03-21 00:23:02,353: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:23:02.358383632Z [2024-03-21 00:23:02,357: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:23:02.409979653Z [2024-03-21 00:23:02,409: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:23:02.418255677Z [2024-03-21 00:23:02,417: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:23:02.418555448Z [2024-03-21 00:23:02,418: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:23:02.418803337Z [2024-03-21 00:23:02,418: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:23:02.418981773Z [2024-03-21 00:23:02,418: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:23:02.419543183Z [2024-03-21 00:23:02,419: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:23:02.419788528Z [2024-03-21 00:23:02,419: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:23:02.495209009Z [2024-03-21 00:23:02,494: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:23:02.499440554Z [2024-03-21 00:23:02,498: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:23:02.525903286Z [2024-03-21 00:23:02,525: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:23:02.527573530Z [2024-03-21 00:23:02,527: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:23:02.527591767Z [2024-03-21 00:23:02,527: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:23:02.527682287Z [2024-03-21 00:23:02,527: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:23:02.527691445Z [2024-03-21 00:23:02,527: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:23:02.527970512Z [2024-03-21 00:23:02,527: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:23:02.528003653Z [2024-03-21 00:23:02,527: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:23:02.543918304Z [2024-03-21 00:23:02,543: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:23:02.658886443Z [2024-03-21 00:23:02,658: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:23:04.600548528Z [2024-03-21 00:23:04,599: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f02e7f1c-9f55-4cbc-84d2-4da5675befd3] succeeded in 4.122272262000024s: None
2024-03-21T00:23:05.011410904Z [2024-03-21 00:23:05,010: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ae6affc5-c8fd-42ea-b3e7-f8ca75aeade8] succeeded in 4.533584313999654s: None
2024-03-21T00:24:00.664224348Z [2024-03-21 00:24:00,663: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2125c07d-5215-47d0-84bd-c8224105365a] received
2024-03-21T00:24:00.670504639Z [2024-03-21 00:24:00,670: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a292a0d-d9dc-4845-b11e-aefaa65de4fa] received
2024-03-21T00:24:00.677643202Z [2024-03-21 00:24:00,677: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[958cb035-4ce7-4ee3-9c4c-912423366f05] received
2024-03-21T00:24:00.681377152Z [2024-03-21 00:24:00,681: INFO/ForkPoolWorker-15] [2125c07d-5215-47d0-84bd-c8224105365a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:24:00.686223947Z [2024-03-21 00:24:00,685: INFO/ForkPoolWorker-16] [3a292a0d-d9dc-4845-b11e-aefaa65de4fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:24:00.690772493Z [2024-03-21 00:24:00,690: INFO/ForkPoolWorker-1] [958cb035-4ce7-4ee3-9c4c-912423366f05] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:24:00.697029844Z [2024-03-21 00:24:00,696: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[47839730-2817-499c-9b2b-15b8f34ff4c4] received
2024-03-21T00:24:00.716420088Z [2024-03-21 00:24:00,716: INFO/ForkPoolWorker-2] [47839730-2817-499c-9b2b-15b8f34ff4c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:24:01.018433134Z [2024-03-21 00:24:01,015: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:24:01.072348550Z [2024-03-21 00:24:01,068: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:24:01.085198036Z [2024-03-21 00:24:01,081: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:24:01.086402526Z [2024-03-21 00:24:01,079: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:24:01.247018947Z [2024-03-21 00:24:01,246: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T00:24:01.264955487Z [2024-03-21 00:24:01,264: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:24:01.292687667Z [2024-03-21 00:24:01,292: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:24:01.294561467Z [2024-03-21 00:24:01,294: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:24:01.294636904Z [2024-03-21 00:24:01,294: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:24:01.294691228Z [2024-03-21 00:24:01,294: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T00:24:01.294885415Z [2024-03-21 00:24:01,294: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:24:01.399900991Z [2024-03-21 00:24:01,399: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:24:01.439296416Z [2024-03-21 00:24:01,439: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:24:02.025259817Z [2024-03-21 00:24:02,024: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2125c07d-5215-47d0-84bd-c8224105365a] succeeded in 1.358919225000136s: None
2024-03-21T00:24:02.149982095Z [2024-03-21 00:24:02,149: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[47839730-2817-499c-9b2b-15b8f34ff4c4] succeeded in 1.4511704309998095s: None
2024-03-21T00:24:02.546020050Z [2024-03-21 00:24:02,545: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:24:02.551352175Z [2024-03-21 00:24:02,550: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:24:02.587709095Z [2024-03-21 00:24:02,587: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:24:02.589998193Z [2024-03-21 00:24:02,589: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:24:02.590584969Z [2024-03-21 00:24:02,590: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:24:02.590850692Z [2024-03-21 00:24:02,590: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:24:02.591031132Z [2024-03-21 00:24:02,590: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:24:02.591411080Z [2024-03-21 00:24:02,591: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:24:02.591597640Z [2024-03-21 00:24:02,591: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:24:02.689569075Z [2024-03-21 00:24:02,689: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:24:02.695535497Z [2024-03-21 00:24:02,695: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:24:02.697309155Z [2024-03-21 00:24:02,696: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:24:02.726780499Z [2024-03-21 00:24:02,726: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:24:02.728457995Z [2024-03-21 00:24:02,728: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:24:02.728729142Z [2024-03-21 00:24:02,728: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:24:02.729036222Z [2024-03-21 00:24:02,728: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:24:02.729199002Z [2024-03-21 00:24:02,728: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:24:02.729888784Z [2024-03-21 00:24:02,729: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:24:02.729925283Z [2024-03-21 00:24:02,729: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:24:02.829860973Z [2024-03-21 00:24:02,829: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:24:05.366854367Z [2024-03-21 00:24:05,366: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[958cb035-4ce7-4ee3-9c4c-912423366f05] succeeded in 4.685436797999955s: None
2024-03-21T00:24:05.605798657Z [2024-03-21 00:24:05,605: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3a292a0d-d9dc-4845-b11e-aefaa65de4fa] succeeded in 4.9308998869996685s: None
2024-03-21T00:25:00.541467950Z [2024-03-21 00:25:00,541: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5271827c-3564-4876-a028-b92c1783d6e3] received
2024-03-21T00:25:00.545520496Z [2024-03-21 00:25:00,545: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f4bb27f-249f-43c3-8d7a-3c879f38f5bb] received
2024-03-21T00:25:00.549356242Z [2024-03-21 00:25:00,549: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8dff8bc-17fd-4cbf-90c9-2edfdcff5528] received
2024-03-21T00:25:00.551168742Z [2024-03-21 00:25:00,551: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5f29d95-a08a-4003-a7c9-76798041f9df] received
2024-03-21T00:25:00.552689528Z [2024-03-21 00:25:00,552: INFO/ForkPoolWorker-15] [5271827c-3564-4876-a028-b92c1783d6e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:25:00.560869822Z [2024-03-21 00:25:00,560: INFO/ForkPoolWorker-1] [d8dff8bc-17fd-4cbf-90c9-2edfdcff5528] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:25:00.565987527Z [2024-03-21 00:25:00,565: INFO/ForkPoolWorker-16] [7f4bb27f-249f-43c3-8d7a-3c879f38f5bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:25:00.567101539Z [2024-03-21 00:25:00,566: INFO/ForkPoolWorker-2] [d5f29d95-a08a-4003-a7c9-76798041f9df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:25:00.903035507Z [2024-03-21 00:25:00,899: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:25:00.939100178Z [2024-03-21 00:25:00,935: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:25:00.958730634Z [2024-03-21 00:25:00,954: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:25:00.980537628Z [2024-03-21 00:25:00,976: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:25:01.107560003Z [2024-03-21 00:25:01,107: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T00:25:01.111510098Z [2024-03-21 00:25:01,111: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:25:01.137393799Z [2024-03-21 00:25:01,133: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:25:01.139695056Z [2024-03-21 00:25:01,139: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:25:01.139876494Z [2024-03-21 00:25:01,139: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:25:01.139951737Z [2024-03-21 00:25:01,139: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T00:25:01.140729899Z [2024-03-21 00:25:01,140: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:25:01.266793933Z [2024-03-21 00:25:01,266: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:25:02.060953547Z [2024-03-21 00:25:02,060: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7f4bb27f-249f-43c3-8d7a-3c879f38f5bb] succeeded in 1.5104030229999807s: None
2024-03-21T00:25:02.347205846Z [2024-03-21 00:25:02,345: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T00:25:02.350580052Z [2024-03-21 00:25:02,349: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:25:02.385903250Z [2024-03-21 00:25:02,385: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:25:02.390281333Z [2024-03-21 00:25:02,389: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:25:02.443786875Z [2024-03-21 00:25:02,443: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:25:02.445419754Z [2024-03-21 00:25:02,445: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:25:02.445676196Z [2024-03-21 00:25:02,445: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:25:02.445921497Z [2024-03-21 00:25:02,445: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:25:02.446055271Z [2024-03-21 00:25:02,445: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:25:02.446523522Z [2024-03-21 00:25:02,446: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:25:02.446681028Z [2024-03-21 00:25:02,446: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:25:02.450533926Z [2024-03-21 00:25:02,450: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:25:02.453905385Z [2024-03-21 00:25:02,453: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:25:02.454308997Z [2024-03-21 00:25:02,453: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:25:02.454825978Z [2024-03-21 00:25:02,454: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:25:02.456582668Z [2024-03-21 00:25:02,454: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T00:25:02.456595060Z [2024-03-21 00:25:02,455: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:25:02.456598704Z [2024-03-21 00:25:02,455: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:25:02.473721316Z [2024-03-21 00:25:02,473: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:25:02.477711178Z [2024-03-21 00:25:02,477: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:25:02.510157200Z [2024-03-21 00:25:02,509: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:25:02.513567296Z [2024-03-21 00:25:02,513: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:25:02.513827150Z [2024-03-21 00:25:02,513: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:25:02.514048396Z [2024-03-21 00:25:02,513: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:25:02.514210350Z [2024-03-21 00:25:02,514: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:25:02.514665952Z [2024-03-21 00:25:02,514: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:25:02.514840264Z [2024-03-21 00:25:02,514: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:25:02.548235085Z [2024-03-21 00:25:02,547: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T00:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:25:02.590486199Z [2024-03-21 00:25:02,590: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:25:02.600978544Z [2024-03-21 00:25:02,600: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:25:03.354424968Z [2024-03-21 00:25:03,353: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5271827c-3564-4876-a028-b92c1783d6e3] succeeded in 2.8110854599999584s: None
2024-03-21T00:25:04.232363089Z [2024-03-21 00:25:04,231: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19827366-1028-4869-9f4c-ecea93aa85fe] received
2024-03-21T00:25:04.243667790Z [2024-03-21 00:25:04,243: INFO/ForkPoolWorker-15] [19827366-1028-4869-9f4c-ecea93aa85fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:25:04.290920704Z [2024-03-21 00:25:04,290: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d5f29d95-a08a-4003-a7c9-76798041f9df] succeeded in 3.737179780999668s: None
2024-03-21T00:25:04.624853929Z [2024-03-21 00:25:04,621: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:25:04.688471847Z [2024-03-21 00:25:04,688: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d8dff8bc-17fd-4cbf-90c9-2edfdcff5528] succeeded in 4.135056968999834s: None
2024-03-21T00:25:05.822770718Z [2024-03-21 00:25:05,822: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:25:05.826443715Z [2024-03-21 00:25:05,825: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:25:05.849907673Z [2024-03-21 00:25:05,848: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:25:05.850713325Z [2024-03-21 00:25:05,850: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:25:05.850874125Z [2024-03-21 00:25:05,850: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:25:05.851262484Z [2024-03-21 00:25:05,850: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:25:05.851273524Z [2024-03-21 00:25:05,851: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:25:05.851629910Z [2024-03-21 00:25:05,851: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:25:05.851807073Z [2024-03-21 00:25:05,851: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:25:05.939505076Z [2024-03-21 00:25:05,939: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T00:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:25:06.568991016Z [2024-03-21 00:25:06,568: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[19827366-1028-4869-9f4c-ecea93aa85fe] succeeded in 2.334471936999762s: None
2024-03-21T00:25:07.233803001Z [2024-03-21 00:25:07,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[157bd9d4-a3ae-4f97-bc3a-7a6d29f68350] received
2024-03-21T00:25:07.242220943Z [2024-03-21 00:25:07,241: INFO/ForkPoolWorker-15] [157bd9d4-a3ae-4f97-bc3a-7a6d29f68350] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T00:25:07.591187540Z [2024-03-21 00:25:07,586: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:25:08.905456344Z [2024-03-21 00:25:08,904: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:25:08.909138634Z [2024-03-21 00:25:08,908: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:25:08.933211587Z [2024-03-21 00:25:08,932: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:25:08.934846632Z [2024-03-21 00:25:08,934: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:25:08.935007184Z [2024-03-21 00:25:08,934: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:25:08.935265187Z [2024-03-21 00:25:08,934: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:25:08.935423371Z [2024-03-21 00:25:08,935: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:25:08.936226533Z [2024-03-21 00:25:08,936: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:25:08.936449289Z [2024-03-21 00:25:08,936: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:25:09.032820377Z [2024-03-21 00:25:09,032: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T00:20:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:25:09.629965668Z [2024-03-21 00:25:09,629: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5ed0187-357d-40cd-bba6-3bed20f3835c] received
2024-03-21T00:25:09.636695255Z [2024-03-21 00:25:09,636: INFO/ForkPoolWorker-16] [e5ed0187-357d-40cd-bba6-3bed20f3835c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:25:09.733226468Z [2024-03-21 00:25:09,732: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[157bd9d4-a3ae-4f97-bc3a-7a6d29f68350] succeeded in 2.4969464539999535s: None
2024-03-21T00:25:10.040525307Z [2024-03-21 00:25:10,036: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:25:11.387462651Z [2024-03-21 00:25:11,387: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:25:11.391107140Z [2024-03-21 00:25:11,390: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:25:11.418360892Z [2024-03-21 00:25:11,418: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:25:11.420289066Z [2024-03-21 00:25:11,419: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:25:11.420485367Z [2024-03-21 00:25:11,420: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:25:11.420721796Z [2024-03-21 00:25:11,420: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:25:11.420875899Z [2024-03-21 00:25:11,420: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:25:11.421242532Z [2024-03-21 00:25:11,421: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:25:11.421364597Z [2024-03-21 00:25:11,421: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:25:11.546335688Z [2024-03-21 00:25:11,545: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T00:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:25:12.271782844Z [2024-03-21 00:25:12,264: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e5ed0187-357d-40cd-bba6-3bed20f3835c] succeeded in 2.633363105999706s: None
2024-03-21T00:26:00.908862627Z [2024-03-21 00:26:00,908: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e7f6c13-f0d5-4987-95f4-f8a6c2ba13ba] received
2024-03-21T00:26:00.911051840Z [2024-03-21 00:26:00,910: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b91573b3-026b-4fc6-865f-f01dbff227af] received
2024-03-21T00:26:00.920879745Z [2024-03-21 00:26:00,920: INFO/ForkPoolWorker-15] [6e7f6c13-f0d5-4987-95f4-f8a6c2ba13ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:26:00.926782539Z [2024-03-21 00:26:00,926: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f0fd214-6824-43c2-8449-720716aaf611] received
2024-03-21T00:26:00.927637954Z [2024-03-21 00:26:00,927: INFO/ForkPoolWorker-16] [b91573b3-026b-4fc6-865f-f01dbff227af] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:26:00.942627023Z [2024-03-21 00:26:00,942: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3bdf198-6488-45bf-bc48-61cf89debfc6] received
2024-03-21T00:26:00.949759096Z [2024-03-21 00:26:00,949: INFO/ForkPoolWorker-1] [2f0fd214-6824-43c2-8449-720716aaf611] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:26:00.951647520Z [2024-03-21 00:26:00,951: INFO/ForkPoolWorker-2] [d3bdf198-6488-45bf-bc48-61cf89debfc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:26:01.224061609Z [2024-03-21 00:26:01,220: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:26:01.269343345Z [2024-03-21 00:26:01,265: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:26:01.300258333Z [2024-03-21 00:26:01,294: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:26:01.376165087Z [2024-03-21 00:26:01,372: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:26:01.479214525Z [2024-03-21 00:26:01,478: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T00:26:01.484943487Z [2024-03-21 00:26:01,484: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:26:01.497337532Z [2024-03-21 00:26:01,497: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:26:01.527316082Z [2024-03-21 00:26:01,527: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:26:01.534134788Z [2024-03-21 00:26:01,533: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:26:01.534331765Z [2024-03-21 00:26:01,534: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:26:01.534491681Z [2024-03-21 00:26:01,534: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T00:26:01.534790031Z [2024-03-21 00:26:01,534: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:26:01.676484806Z [2024-03-21 00:26:01,676: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:26:02.142935990Z [2024-03-21 00:26:02,142: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6e7f6c13-f0d5-4987-95f4-f8a6c2ba13ba] succeeded in 1.2307623189999504s: None
2024-03-21T00:26:02.568593165Z [2024-03-21 00:26:02,567: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b91573b3-026b-4fc6-865f-f01dbff227af] succeeded in 1.651310468000247s: None
2024-03-21T00:26:02.953725401Z [2024-03-21 00:26:02,953: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:26:02.958243377Z [2024-03-21 00:26:02,957: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:26:02.982963641Z [2024-03-21 00:26:02,982: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:26:02.984919627Z [2024-03-21 00:26:02,984: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:26:02.984959777Z [2024-03-21 00:26:02,984: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:26:02.985173765Z [2024-03-21 00:26:02,984: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:26:02.985225781Z [2024-03-21 00:26:02,985: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:26:02.985659279Z [2024-03-21 00:26:02,985: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:26:02.985849928Z [2024-03-21 00:26:02,985: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:26:03.050706504Z [2024-03-21 00:26:03,050: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T00:26:03.054172049Z [2024-03-21 00:26:03,053: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:26:03.079031096Z [2024-03-21 00:26:03,078: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:26:03.080409333Z [2024-03-21 00:26:03,080: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:26:03.080419744Z [2024-03-21 00:26:03,080: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:26:03.080610780Z [2024-03-21 00:26:03,080: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:26:03.080703038Z [2024-03-21 00:26:03,080: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T00:26:03.081335571Z [2024-03-21 00:26:03,081: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:26:03.081447380Z [2024-03-21 00:26:03,081: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:26:03.096258792Z [2024-03-21 00:26:03,095: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:26:03.156885764Z [2024-03-21 00:26:03,156: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:26:05.850337594Z [2024-03-21 00:26:05,849: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d3bdf198-6488-45bf-bc48-61cf89debfc6] succeeded in 4.903920586999902s: None
2024-03-21T00:26:06.026541258Z [2024-03-21 00:26:06,025: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2f0fd214-6824-43c2-8449-720716aaf611] succeeded in 5.09477096899991s: None
2024-03-21T00:27:00.960176252Z [2024-03-21 00:27:00,959: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd1d8562-95f4-4abf-8ccc-106d40554309] received
2024-03-21T00:27:00.972544306Z [2024-03-21 00:27:00,972: INFO/ForkPoolWorker-15] [bd1d8562-95f4-4abf-8ccc-106d40554309] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:27:00.974255758Z [2024-03-21 00:27:00,974: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6f1224e-a999-477e-bc0f-1117931e42ff] received
2024-03-21T00:27:00.984230773Z [2024-03-21 00:27:00,983: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5438a338-284d-4a53-90a6-aeb31bf0c00e] received
2024-03-21T00:27:00.984453610Z [2024-03-21 00:27:00,984: INFO/ForkPoolWorker-16] [c6f1224e-a999-477e-bc0f-1117931e42ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:27:01.004909810Z [2024-03-21 00:27:01,004: INFO/ForkPoolWorker-1] [5438a338-284d-4a53-90a6-aeb31bf0c00e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:27:01.277065052Z [2024-03-21 00:27:01,274: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:27:01.307612671Z [2024-03-21 00:27:01,304: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:27:01.373560918Z [2024-03-21 00:27:01,370: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:27:01.432817666Z [2024-03-21 00:27:01,432: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T00:27:01.436863036Z [2024-03-21 00:27:01,436: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:27:01.482996438Z [2024-03-21 00:27:01,482: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:27:01.485417762Z [2024-03-21 00:27:01,485: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:27:01.486070649Z [2024-03-21 00:27:01,485: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:27:01.486392087Z [2024-03-21 00:27:01,486: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T00:27:01.487084233Z [2024-03-21 00:27:01,486: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:27:01.615352391Z [2024-03-21 00:27:01,615: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:27:02.377531367Z [2024-03-21 00:27:02,377: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bd1d8562-95f4-4abf-8ccc-106d40554309] succeeded in 1.4143044249999548s: None
2024-03-21T00:27:02.614895157Z [2024-03-21 00:27:02,614: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:27:02.621559574Z [2024-03-21 00:27:02,620: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:27:02.649619942Z [2024-03-21 00:27:02,649: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:27:02.651910572Z [2024-03-21 00:27:02,651: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:27:02.652013359Z [2024-03-21 00:27:02,651: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:27:02.652204540Z [2024-03-21 00:27:02,651: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:27:02.652353297Z [2024-03-21 00:27:02,652: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:27:02.652781562Z [2024-03-21 00:27:02,652: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:27:02.652865585Z [2024-03-21 00:27:02,652: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:27:02.780112566Z [2024-03-21 00:27:02,779: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:27:02.850124173Z [2024-03-21 00:27:02,849: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:27:02.854003242Z [2024-03-21 00:27:02,853: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:27:02.884291643Z [2024-03-21 00:27:02,884: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:27:02.886277161Z [2024-03-21 00:27:02,885: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:27:02.886554658Z [2024-03-21 00:27:02,886: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:27:02.886865582Z [2024-03-21 00:27:02,886: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:27:02.887232943Z [2024-03-21 00:27:02,887: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:27:02.887797184Z [2024-03-21 00:27:02,887: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:27:02.888047277Z [2024-03-21 00:27:02,887: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:27:03.011511843Z [2024-03-21 00:27:03,011: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:27:05.472132957Z [2024-03-21 00:27:05,471: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c6f1224e-a999-477e-bc0f-1117931e42ff] succeeded in 4.495883566999964s: None
2024-03-21T00:27:06.067288386Z [2024-03-21 00:27:06,066: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5438a338-284d-4a53-90a6-aeb31bf0c00e] succeeded in 5.080394106000313s: None
2024-03-21T00:28:00.748487268Z [2024-03-21 00:28:00,747: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[389b9971-5d18-4627-8aff-510bc508e2f8] received
2024-03-21T00:28:00.754704307Z [2024-03-21 00:28:00,753: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b87ff16-80ba-4831-8e4a-5d08e5454132] received
2024-03-21T00:28:00.766632165Z [2024-03-21 00:28:00,766: INFO/ForkPoolWorker-15] [389b9971-5d18-4627-8aff-510bc508e2f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:28:00.769854713Z [2024-03-21 00:28:00,769: INFO/ForkPoolWorker-16] [7b87ff16-80ba-4831-8e4a-5d08e5454132] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:28:00.775839032Z [2024-03-21 00:28:00,775: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac3fba00-9f66-49e1-89ce-37879d52a9b8] received
2024-03-21T00:28:00.781186213Z [2024-03-21 00:28:00,780: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f53e07aa-924a-4b48-8512-ea1bb33e1592] received
2024-03-21T00:28:00.789991558Z [2024-03-21 00:28:00,789: INFO/ForkPoolWorker-2] [f53e07aa-924a-4b48-8512-ea1bb33e1592] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:28:00.791649670Z [2024-03-21 00:28:00,791: INFO/ForkPoolWorker-1] [ac3fba00-9f66-49e1-89ce-37879d52a9b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:28:01.151863175Z [2024-03-21 00:28:01,148: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:28:01.198465654Z [2024-03-21 00:28:01,194: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:28:01.273261642Z [2024-03-21 00:28:01,269: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:28:01.323267389Z [2024-03-21 00:28:01,322: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T00:28:01.326553844Z [2024-03-21 00:28:01,321: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:28:01.327059859Z [2024-03-21 00:28:01,326: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:28:01.361046340Z [2024-03-21 00:28:01,360: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:28:01.362376024Z [2024-03-21 00:28:01,362: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:28:01.362428472Z [2024-03-21 00:28:01,362: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:28:01.362469572Z [2024-03-21 00:28:01,362: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T00:28:01.362726103Z [2024-03-21 00:28:01,362: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:28:01.473637009Z [2024-03-21 00:28:01,473: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:28:01.655391910Z [2024-03-21 00:28:01,654: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:28:02.123139840Z [2024-03-21 00:28:02,122: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[389b9971-5d18-4627-8aff-510bc508e2f8] succeeded in 1.3711720590004006s: None
2024-03-21T00:28:02.448517571Z [2024-03-21 00:28:02,447: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7b87ff16-80ba-4831-8e4a-5d08e5454132] succeeded in 1.6906090630000108s: None
2024-03-21T00:28:02.753979807Z [2024-03-21 00:28:02,753: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:28:02.757678481Z [2024-03-21 00:28:02,757: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:28:02.778020904Z [2024-03-21 00:28:02,777: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:28:02.784152761Z [2024-03-21 00:28:02,783: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:28:02.784174262Z [2024-03-21 00:28:02,784: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:28:02.784415875Z [2024-03-21 00:28:02,784: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:28:02.784427701Z [2024-03-21 00:28:02,784: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:28:02.784756480Z [2024-03-21 00:28:02,784: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:28:02.784840585Z [2024-03-21 00:28:02,784: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:28:02.878929481Z [2024-03-21 00:28:02,878: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T00:28:02.882720112Z [2024-03-21 00:28:02,882: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:28:02.897009751Z [2024-03-21 00:28:02,896: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:28:02.901608239Z [2024-03-21 00:28:02,901: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:28:02.903672388Z [2024-03-21 00:28:02,903: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:28:02.903834478Z [2024-03-21 00:28:02,903: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:28:02.903856544Z [2024-03-21 00:28:02,903: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:28:02.903863012Z [2024-03-21 00:28:02,903: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T00:28:02.904224374Z [2024-03-21 00:28:02,903: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:28:02.904232528Z [2024-03-21 00:28:02,904: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:28:02.987995449Z [2024-03-21 00:28:02,987: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:28:05.163966485Z [2024-03-21 00:28:05,163: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f53e07aa-924a-4b48-8512-ea1bb33e1592] succeeded in 4.380667508999977s: None
2024-03-21T00:28:05.263099418Z [2024-03-21 00:28:05,262: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ac3fba00-9f66-49e1-89ce-37879d52a9b8] succeeded in 4.48506857700022s: None
2024-03-21T00:29:00.533406717Z [2024-03-21 00:29:00,532: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79940293-4dbc-4136-a793-ac3588ac44b0] received
2024-03-21T00:29:00.538280038Z [2024-03-21 00:29:00,537: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b2fc349-d1ca-4897-95b5-6e1c78206380] received
2024-03-21T00:29:00.541355002Z [2024-03-21 00:29:00,541: INFO/ForkPoolWorker-15] [79940293-4dbc-4136-a793-ac3588ac44b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:29:00.541549153Z [2024-03-21 00:29:00,541: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ceb9764-cd4d-4bb6-9c5c-0bc8d74db3b4] received
2024-03-21T00:29:00.553137321Z [2024-03-21 00:29:00,552: INFO/ForkPoolWorker-1] [6ceb9764-cd4d-4bb6-9c5c-0bc8d74db3b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:29:00.554063294Z [2024-03-21 00:29:00,553: INFO/ForkPoolWorker-16] [5b2fc349-d1ca-4897-95b5-6e1c78206380] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:29:00.871475218Z [2024-03-21 00:29:00,863: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:29:00.874762927Z [2024-03-21 00:29:00,871: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:29:00.886974592Z [2024-03-21 00:29:00,883: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:29:01.072930461Z [2024-03-21 00:29:01,072: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T00:29:01.077436704Z [2024-03-21 00:29:01,076: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:29:01.109778795Z [2024-03-21 00:29:01,109: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:29:01.114556692Z [2024-03-21 00:29:01,114: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:29:01.114791444Z [2024-03-21 00:29:01,114: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:29:01.115055923Z [2024-03-21 00:29:01,114: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T00:29:01.115469361Z [2024-03-21 00:29:01,115: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:29:01.220542461Z [2024-03-21 00:29:01,219: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:29:01.841448894Z [2024-03-21 00:29:01,840: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5b2fc349-d1ca-4897-95b5-6e1c78206380] succeeded in 1.2976334799996039s: None
2024-03-21T00:29:02.112675927Z [2024-03-21 00:29:02,112: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:29:02.116292582Z [2024-03-21 00:29:02,115: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:29:02.138860997Z [2024-03-21 00:29:02,138: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:29:02.140689326Z [2024-03-21 00:29:02,140: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:29:02.141117624Z [2024-03-21 00:29:02,140: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:29:02.141343695Z [2024-03-21 00:29:02,141: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:29:02.141493845Z [2024-03-21 00:29:02,141: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:29:02.141896751Z [2024-03-21 00:29:02,141: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:29:02.142094406Z [2024-03-21 00:29:02,141: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:29:02.230003707Z [2024-03-21 00:29:02,229: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:29:02.310207799Z [2024-03-21 00:29:02,294: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:29:02.310232398Z [2024-03-21 00:29:02,304: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:29:02.450989195Z [2024-03-21 00:29:02,450: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:29:02.453339857Z [2024-03-21 00:29:02,453: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:29:02.453485308Z [2024-03-21 00:29:02,453: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:29:02.453859717Z [2024-03-21 00:29:02,453: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:29:02.454468717Z [2024-03-21 00:29:02,453: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:29:02.456574046Z [2024-03-21 00:29:02,456: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:29:02.456685171Z [2024-03-21 00:29:02,456: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:29:02.558350982Z [2024-03-21 00:29:02,557: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:29:04.205143307Z [2024-03-21 00:29:04,204: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6ceb9764-cd4d-4bb6-9c5c-0bc8d74db3b4] succeeded in 3.661304454000856s: None
2024-03-21T00:29:04.816912434Z [2024-03-21 00:29:04,816: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[79940293-4dbc-4136-a793-ac3588ac44b0] succeeded in 4.281396795000546s: None
2024-03-21T00:30:00.548498490Z [2024-03-21 00:30:00,547: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[395eb4e5-c5e5-4b04-ab1d-ee74a4c0615a] received
2024-03-21T00:30:00.550779905Z [2024-03-21 00:30:00,550: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d6ab019-9cfe-412a-870e-03f5bc78e22e] received
2024-03-21T00:30:00.557553337Z [2024-03-21 00:30:00,557: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[375ae0b0-c7a5-4682-8822-e19379ad8ff0] received
2024-03-21T00:30:00.558334807Z [2024-03-21 00:30:00,558: INFO/ForkPoolWorker-15] [395eb4e5-c5e5-4b04-ab1d-ee74a4c0615a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:30:00.561134106Z [2024-03-21 00:30:00,560: INFO/ForkPoolWorker-16] [3d6ab019-9cfe-412a-870e-03f5bc78e22e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:30:00.564378018Z [2024-03-21 00:30:00,564: INFO/ForkPoolWorker-1] [375ae0b0-c7a5-4682-8822-e19379ad8ff0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:30:00.569975149Z [2024-03-21 00:30:00,569: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c32e01bc-f675-4039-b8e2-41e16588316c] received
2024-03-21T00:30:00.571235448Z [2024-03-21 00:30:00,571: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef3ede8d-9d1f-47e6-98e9-aa4621ecdce3] received
2024-03-21T00:30:00.579201903Z [2024-03-21 00:30:00,578: INFO/ForkPoolWorker-2] [c32e01bc-f675-4039-b8e2-41e16588316c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:30:00.600394974Z [2024-03-21 00:30:00,599: INFO/ForkPoolWorker-3] [ef3ede8d-9d1f-47e6-98e9-aa4621ecdce3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:30:01.007654470Z [2024-03-21 00:30:01,004: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:30:01.124057740Z [2024-03-21 00:30:01,120: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:30:01.128401375Z [2024-03-21 00:30:01,122: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:30:01.184483935Z [2024-03-21 00:30:01,184: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T00:30:01.188621305Z [2024-03-21 00:30:01,188: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:30:01.221914280Z [2024-03-21 00:30:01,221: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:30:01.223471024Z [2024-03-21 00:30:01,223: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:30:01.223598879Z [2024-03-21 00:30:01,223: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:30:01.223673319Z [2024-03-21 00:30:01,223: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T00:30:01.223968874Z [2024-03-21 00:30:01,223: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:30:01.366020264Z [2024-03-21 00:30:01,365: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:30:01.474749349Z [2024-03-21 00:30:01,440: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:30:01.565852331Z [2024-03-21 00:30:01,560: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:30:01.757524114Z [2024-03-21 00:30:01,757: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:30:02.028404994Z [2024-03-21 00:30:02,027: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c32e01bc-f675-4039-b8e2-41e16588316c] succeeded in 1.4557355080005436s: None
2024-03-21T00:30:02.667710666Z [2024-03-21 00:30:02,667: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3d6ab019-9cfe-412a-870e-03f5bc78e22e] succeeded in 2.1142896230003316s: None
2024-03-21T00:30:03.290071165Z [2024-03-21 00:30:03,289: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:30:03.293823392Z [2024-03-21 00:30:03,293: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:30:03.319420312Z [2024-03-21 00:30:03,319: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:30:03.321019240Z [2024-03-21 00:30:03,320: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:30:03.321096244Z [2024-03-21 00:30:03,320: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:30:03.321348746Z [2024-03-21 00:30:03,321: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:30:03.321395433Z [2024-03-21 00:30:03,321: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:30:03.321689429Z [2024-03-21 00:30:03,321: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:30:03.321751994Z [2024-03-21 00:30:03,321: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:30:03.359357948Z [2024-03-21 00:30:03,358: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:30:03.367938211Z [2024-03-21 00:30:03,367: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:30:03.402555585Z [2024-03-21 00:30:03,402: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:30:03.405798611Z [2024-03-21 00:30:03,405: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:30:03.405978862Z [2024-03-21 00:30:03,405: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:30:03.406232798Z [2024-03-21 00:30:03,406: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:30:03.406388004Z [2024-03-21 00:30:03,406: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:30:03.406882406Z [2024-03-21 00:30:03,406: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:30:03.407382336Z [2024-03-21 00:30:03,407: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:30:03.410555161Z [2024-03-21 00:30:03,410: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T00:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:30:03.506603047Z [2024-03-21 00:30:03,506: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:30:03.555306827Z [2024-03-21 00:30:03,554: INFO/ForkPoolWorker-3] Getting VIM list
2024-03-21T00:30:03.559624597Z [2024-03-21 00:30:03,559: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:30:03.601589890Z [2024-03-21 00:30:03,601: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-21T00:30:03.604133362Z [2024-03-21 00:30:03,603: INFO/ForkPoolWorker-3] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:30:03.604152962Z [2024-03-21 00:30:03,604: INFO/ForkPoolWorker-3] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:30:03.604544749Z [2024-03-21 00:30:03,604: INFO/ForkPoolWorker-3] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:30:03.604693254Z [2024-03-21 00:30:03,604: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-03-21T00:30:03.605041995Z [2024-03-21 00:30:03,604: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:30:03.605150675Z [2024-03-21 00:30:03,604: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:30:03.707862603Z [2024-03-21 00:30:03,707: INFO/ForkPoolWorker-3] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:30:04.102802457Z [2024-03-21 00:30:04,102: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[395eb4e5-c5e5-4b04-ab1d-ee74a4c0615a] succeeded in 3.5495299429994702s: None
2024-03-21T00:30:04.541008291Z [2024-03-21 00:30:04,540: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a7335af-47bc-49ec-8bf2-6ca612550641] received
2024-03-21T00:30:04.549658385Z [2024-03-21 00:30:04,549: INFO/ForkPoolWorker-15] [6a7335af-47bc-49ec-8bf2-6ca612550641] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:30:04.860440977Z [2024-03-21 00:30:04,856: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:30:05.271904917Z [2024-03-21 00:30:05,271: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[375ae0b0-c7a5-4682-8822-e19379ad8ff0] succeeded in 4.712776493000092s: None
2024-03-21T00:30:05.823390524Z [2024-03-21 00:30:05,822: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[ef3ede8d-9d1f-47e6-98e9-aa4621ecdce3] succeeded in 5.246169193999776s: None
2024-03-21T00:30:05.994290858Z [2024-03-21 00:30:05,993: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:30:05.997665341Z [2024-03-21 00:30:05,997: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:30:06.025553867Z [2024-03-21 00:30:06,025: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:30:06.026927968Z [2024-03-21 00:30:06,026: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:30:06.026944510Z [2024-03-21 00:30:06,026: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:30:06.027051439Z [2024-03-21 00:30:06,026: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:30:06.027098067Z [2024-03-21 00:30:06,026: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:30:06.027310257Z [2024-03-21 00:30:06,027: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:30:06.027326362Z [2024-03-21 00:30:06,027: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:30:06.110295709Z [2024-03-21 00:30:06,109: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T00:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:30:06.785608217Z [2024-03-21 00:30:06,784: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6a7335af-47bc-49ec-8bf2-6ca612550641] succeeded in 2.242683085999488s: None
2024-03-21T00:30:07.405101118Z [2024-03-21 00:30:07,404: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[754f5071-3764-459a-af23-7aed53df669b] received
2024-03-21T00:30:07.413511528Z [2024-03-21 00:30:07,413: INFO/ForkPoolWorker-15] [754f5071-3764-459a-af23-7aed53df669b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T00:30:07.692013129Z [2024-03-21 00:30:07,688: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:30:08.948278753Z [2024-03-21 00:30:08,947: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:30:08.951806634Z [2024-03-21 00:30:08,951: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:30:08.975099222Z [2024-03-21 00:30:08,974: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:30:08.976490499Z [2024-03-21 00:30:08,976: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:30:08.976507125Z [2024-03-21 00:30:08,976: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:30:08.976628124Z [2024-03-21 00:30:08,976: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:30:08.976688951Z [2024-03-21 00:30:08,976: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:30:08.976906856Z [2024-03-21 00:30:08,976: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:30:08.976947916Z [2024-03-21 00:30:08,976: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:30:09.087051735Z [2024-03-21 00:30:09,086: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T00:25:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:30:09.704377453Z [2024-03-21 00:30:09,703: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[754f5071-3764-459a-af23-7aed53df669b] succeeded in 2.295653439000489s: None
2024-03-21T00:30:09.729601304Z [2024-03-21 00:30:09,729: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8cbca75e-25b6-4c74-a3c4-a6a4a84c1c61] received
2024-03-21T00:30:09.740800812Z [2024-03-21 00:30:09,740: INFO/ForkPoolWorker-15] [8cbca75e-25b6-4c74-a3c4-a6a4a84c1c61] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:30:10.072919928Z [2024-03-21 00:30:10,069: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:30:11.222023039Z [2024-03-21 00:30:11,221: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:30:11.225509290Z [2024-03-21 00:30:11,225: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:30:11.249296561Z [2024-03-21 00:30:11,249: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:30:11.250755592Z [2024-03-21 00:30:11,250: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:30:11.250921708Z [2024-03-21 00:30:11,250: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:30:11.251185960Z [2024-03-21 00:30:11,250: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:30:11.251323332Z [2024-03-21 00:30:11,251: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:30:11.251799125Z [2024-03-21 00:30:11,251: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:30:11.251942441Z [2024-03-21 00:30:11,251: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:30:11.351563253Z [2024-03-21 00:30:11,351: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T00:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:30:11.953089683Z [2024-03-21 00:30:11,952: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8cbca75e-25b6-4c74-a3c4-a6a4a84c1c61] succeeded in 2.221261083999707s: None
2024-03-21T00:31:00.449350899Z [2024-03-21 00:31:00,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d990fd3c-ca6b-4836-8021-171806ed83cd] received
2024-03-21T00:31:00.456099600Z [2024-03-21 00:31:00,455: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f516cb7e-0618-4800-8685-b91b8f267e3b] received
2024-03-21T00:31:00.458173651Z [2024-03-21 00:31:00,457: INFO/ForkPoolWorker-15] [d990fd3c-ca6b-4836-8021-171806ed83cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:31:00.462461836Z [2024-03-21 00:31:00,462: INFO/ForkPoolWorker-16] [f516cb7e-0618-4800-8685-b91b8f267e3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:31:00.469279497Z [2024-03-21 00:31:00,469: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9de71e74-5030-47f8-90c1-04594b7576ed] received
2024-03-21T00:31:00.483108858Z [2024-03-21 00:31:00,482: INFO/ForkPoolWorker-1] [9de71e74-5030-47f8-90c1-04594b7576ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:31:00.766573287Z [2024-03-21 00:31:00,763: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:31:00.790237510Z [2024-03-21 00:31:00,787: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:31:00.872195266Z [2024-03-21 00:31:00,867: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:31:00.972245557Z [2024-03-21 00:31:00,971: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T00:31:00.976342010Z [2024-03-21 00:31:00,975: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:31:01.067395140Z [2024-03-21 00:31:01,067: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:31:01.075208234Z [2024-03-21 00:31:01,074: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:31:01.075237270Z [2024-03-21 00:31:01,075: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:31:01.075394579Z [2024-03-21 00:31:01,075: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T00:31:01.075716398Z [2024-03-21 00:31:01,075: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:31:01.188086735Z [2024-03-21 00:31:01,187: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:31:01.829635311Z [2024-03-21 00:31:01,829: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d990fd3c-ca6b-4836-8021-171806ed83cd] succeeded in 1.3782317699997293s: None
2024-03-21T00:31:02.182498722Z [2024-03-21 00:31:02,182: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:31:02.186448147Z [2024-03-21 00:31:02,185: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:31:02.216302949Z [2024-03-21 00:31:02,216: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:31:02.218509859Z [2024-03-21 00:31:02,218: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:31:02.218560552Z [2024-03-21 00:31:02,218: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:31:02.218689171Z [2024-03-21 00:31:02,218: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:31:02.218748752Z [2024-03-21 00:31:02,218: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:31:02.219637751Z [2024-03-21 00:31:02,219: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:31:02.219710017Z [2024-03-21 00:31:02,219: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:31:02.255769463Z [2024-03-21 00:31:02,255: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:31:02.259740479Z [2024-03-21 00:31:02,259: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:31:02.286056956Z [2024-03-21 00:31:02,285: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:31:02.290919785Z [2024-03-21 00:31:02,287: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:31:02.290931976Z [2024-03-21 00:31:02,287: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:31:02.290938446Z [2024-03-21 00:31:02,287: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:31:02.290944700Z [2024-03-21 00:31:02,287: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:31:02.290949237Z [2024-03-21 00:31:02,287: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:31:02.290953725Z [2024-03-21 00:31:02,288: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:31:02.361477755Z [2024-03-21 00:31:02,361: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:31:02.437061541Z [2024-03-21 00:31:02,436: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:31:03.959127116Z [2024-03-21 00:31:03,958: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9de71e74-5030-47f8-90c1-04594b7576ed] succeeded in 3.4850872799997887s: None
2024-03-21T00:31:04.300581853Z [2024-03-21 00:31:04,300: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f516cb7e-0618-4800-8685-b91b8f267e3b] succeeded in 3.842939875000411s: None
2024-03-21T00:32:00.364056063Z [2024-03-21 00:32:00,361: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[567d2e05-51d8-4809-8a1f-93de58896827] received
2024-03-21T00:32:00.376563573Z [2024-03-21 00:32:00,375: INFO/ForkPoolWorker-15] [567d2e05-51d8-4809-8a1f-93de58896827] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:32:00.381389543Z [2024-03-21 00:32:00,381: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26f8cd5d-71d5-4245-a089-6b430861b3a9] received
2024-03-21T00:32:00.383213616Z [2024-03-21 00:32:00,383: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a949455-c5b5-41a2-bb1a-c1416f6e5870] received
2024-03-21T00:32:00.384990937Z [2024-03-21 00:32:00,384: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d7df2e1d-8511-4d8d-a59a-9a35d03b904e] received
2024-03-21T00:32:00.409979541Z [2024-03-21 00:32:00,409: INFO/ForkPoolWorker-16] [26f8cd5d-71d5-4245-a089-6b430861b3a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:32:00.419806448Z [2024-03-21 00:32:00,419: INFO/ForkPoolWorker-2] [d7df2e1d-8511-4d8d-a59a-9a35d03b904e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:32:00.421786641Z [2024-03-21 00:32:00,421: INFO/ForkPoolWorker-1] [3a949455-c5b5-41a2-bb1a-c1416f6e5870] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:32:00.697528172Z [2024-03-21 00:32:00,694: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:32:00.721289500Z [2024-03-21 00:32:00,718: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:32:00.794356319Z [2024-03-21 00:32:00,788: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:32:00.845702696Z [2024-03-21 00:32:00,841: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:32:00.906774126Z [2024-03-21 00:32:00,906: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T00:32:00.910873412Z [2024-03-21 00:32:00,910: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:32:00.944766090Z [2024-03-21 00:32:00,944: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:32:00.946461354Z [2024-03-21 00:32:00,946: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:32:00.946752201Z [2024-03-21 00:32:00,946: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:32:00.946950243Z [2024-03-21 00:32:00,946: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T00:32:00.947345182Z [2024-03-21 00:32:00,947: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:32:00.955836259Z [2024-03-21 00:32:00,955: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:32:01.067022694Z [2024-03-21 00:32:01,066: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:32:01.643151471Z [2024-03-21 00:32:01,642: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[567d2e05-51d8-4809-8a1f-93de58896827] succeeded in 1.2733359409994591s: None
2024-03-21T00:32:01.769177805Z [2024-03-21 00:32:01,768: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[26f8cd5d-71d5-4245-a089-6b430861b3a9] succeeded in 1.364916778999941s: None
2024-03-21T00:32:02.100231113Z [2024-03-21 00:32:02,099: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T00:32:02.120489485Z [2024-03-21 00:32:02,103: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:32:02.158094325Z [2024-03-21 00:32:02,157: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:32:02.161145803Z [2024-03-21 00:32:02,160: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:32:02.161739543Z [2024-03-21 00:32:02,161: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:32:02.162087092Z [2024-03-21 00:32:02,161: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:32:02.162314650Z [2024-03-21 00:32:02,162: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T00:32:02.163234648Z [2024-03-21 00:32:02,162: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:32:02.163456362Z [2024-03-21 00:32:02,163: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:32:02.283579511Z [2024-03-21 00:32:02,283: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:32:02.631992565Z [2024-03-21 00:32:02,631: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:32:02.635438455Z [2024-03-21 00:32:02,634: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:32:02.666141742Z [2024-03-21 00:32:02,665: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:32:02.668187551Z [2024-03-21 00:32:02,667: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:32:02.668205412Z [2024-03-21 00:32:02,668: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:32:02.668386270Z [2024-03-21 00:32:02,668: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:32:02.668438377Z [2024-03-21 00:32:02,668: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:32:02.669404893Z [2024-03-21 00:32:02,668: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:32:02.669417699Z [2024-03-21 00:32:02,669: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:32:02.796238712Z [2024-03-21 00:32:02,795: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:32:03.921949880Z [2024-03-21 00:32:03,921: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d7df2e1d-8511-4d8d-a59a-9a35d03b904e] succeeded in 3.5101691399995616s: None
2024-03-21T00:32:05.708164824Z [2024-03-21 00:32:05,707: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3a949455-c5b5-41a2-bb1a-c1416f6e5870] succeeded in 5.302680331000374s: None
2024-03-21T00:33:00.995770007Z [2024-03-21 00:33:00,995: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84ffbff6-57ca-47a0-b129-fd207bdba8de] received
2024-03-21T00:33:00.998402144Z [2024-03-21 00:33:00,998: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3da1c125-d1ba-4791-9200-8a9e42739056] received
2024-03-21T00:33:01.009471409Z [2024-03-21 00:33:01,009: INFO/ForkPoolWorker-15] [84ffbff6-57ca-47a0-b129-fd207bdba8de] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:33:01.012440099Z [2024-03-21 00:33:01,012: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7dd71c0-a395-486c-800a-2e90d48110a7] received
2024-03-21T00:33:01.023958451Z [2024-03-21 00:33:01,023: INFO/ForkPoolWorker-16] [3da1c125-d1ba-4791-9200-8a9e42739056] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:33:01.024414107Z [2024-03-21 00:33:01,023: INFO/ForkPoolWorker-1] [c7dd71c0-a395-486c-800a-2e90d48110a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:33:01.376494704Z [2024-03-21 00:33:01,373: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:33:01.388902965Z [2024-03-21 00:33:01,385: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:33:01.446402072Z [2024-03-21 00:33:01,443: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:33:01.563381244Z [2024-03-21 00:33:01,562: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T00:33:01.567352465Z [2024-03-21 00:33:01,566: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:33:01.591162504Z [2024-03-21 00:33:01,590: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:33:01.592414475Z [2024-03-21 00:33:01,592: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:33:01.592637176Z [2024-03-21 00:33:01,592: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:33:01.592862228Z [2024-03-21 00:33:01,592: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T00:33:01.593340200Z [2024-03-21 00:33:01,593: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:33:01.723976599Z [2024-03-21 00:33:01,723: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:33:02.485505296Z [2024-03-21 00:33:02,484: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[84ffbff6-57ca-47a0-b129-fd207bdba8de] succeeded in 1.485857175000092s: None
2024-03-21T00:33:02.736382947Z [2024-03-21 00:33:02,735: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:33:02.740053141Z [2024-03-21 00:33:02,739: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:33:02.767969652Z [2024-03-21 00:33:02,767: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:33:02.770059529Z [2024-03-21 00:33:02,769: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:33:02.770088311Z [2024-03-21 00:33:02,769: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:33:02.770362048Z [2024-03-21 00:33:02,770: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:33:02.770470468Z [2024-03-21 00:33:02,770: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:33:02.770827610Z [2024-03-21 00:33:02,770: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:33:02.771428355Z [2024-03-21 00:33:02,770: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:33:02.863789695Z [2024-03-21 00:33:02,863: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:33:02.885145528Z [2024-03-21 00:33:02,884: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:33:02.888928855Z [2024-03-21 00:33:02,888: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:33:02.910209714Z [2024-03-21 00:33:02,909: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:33:02.911865616Z [2024-03-21 00:33:02,911: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:33:02.911997629Z [2024-03-21 00:33:02,911: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:33:02.912204433Z [2024-03-21 00:33:02,911: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:33:02.912379045Z [2024-03-21 00:33:02,912: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:33:02.912866070Z [2024-03-21 00:33:02,912: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:33:02.913098363Z [2024-03-21 00:33:02,912: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:33:02.999994311Z [2024-03-21 00:33:02,999: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:33:04.540640375Z [2024-03-21 00:33:04,540: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3da1c125-d1ba-4791-9200-8a9e42739056] succeeded in 3.529942254999696s: None
2024-03-21T00:33:05.073506530Z [2024-03-21 00:33:05,072: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c7dd71c0-a395-486c-800a-2e90d48110a7] succeeded in 4.058478517000367s: None
2024-03-21T00:34:00.825790093Z [2024-03-21 00:34:00,825: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[422c4475-1608-43a8-bce1-74be4ac6e178] received
2024-03-21T00:34:00.831876449Z [2024-03-21 00:34:00,831: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38ebd75b-b731-4bd2-b101-fac708dbc04e] received
2024-03-21T00:34:00.837911077Z [2024-03-21 00:34:00,837: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfd1445a-4174-4340-b090-b1317db71974] received
2024-03-21T00:34:00.839360318Z [2024-03-21 00:34:00,839: INFO/ForkPoolWorker-15] [422c4475-1608-43a8-bce1-74be4ac6e178] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:34:00.840785135Z [2024-03-21 00:34:00,840: INFO/ForkPoolWorker-16] [38ebd75b-b731-4bd2-b101-fac708dbc04e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:34:00.849231907Z [2024-03-21 00:34:00,848: INFO/ForkPoolWorker-1] [dfd1445a-4174-4340-b090-b1317db71974] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:34:00.859314472Z [2024-03-21 00:34:00,859: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2959a54e-5410-4d55-bf07-c796079891d8] received
2024-03-21T00:34:00.883925946Z [2024-03-21 00:34:00,883: INFO/ForkPoolWorker-2] [2959a54e-5410-4d55-bf07-c796079891d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:34:01.226797824Z [2024-03-21 00:34:01,223: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:34:01.244064943Z [2024-03-21 00:34:01,240: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:34:01.261069999Z [2024-03-21 00:34:01,257: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:34:01.325504789Z [2024-03-21 00:34:01,322: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:34:01.427382338Z [2024-03-21 00:34:01,426: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T00:34:01.432000927Z [2024-03-21 00:34:01,431: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:34:01.475372624Z [2024-03-21 00:34:01,475: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:34:01.481452770Z [2024-03-21 00:34:01,481: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:34:01.482204055Z [2024-03-21 00:34:01,481: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:34:01.482311511Z [2024-03-21 00:34:01,482: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T00:34:01.482622018Z [2024-03-21 00:34:01,482: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:34:01.614225384Z [2024-03-21 00:34:01,613: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:34:01.616125387Z [2024-03-21 00:34:01,615: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:34:02.267525080Z [2024-03-21 00:34:02,255: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[38ebd75b-b731-4bd2-b101-fac708dbc04e] succeeded in 1.4226039929999388s: None
2024-03-21T00:34:02.354979876Z [2024-03-21 00:34:02,349: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2959a54e-5410-4d55-bf07-c796079891d8] succeeded in 1.4883708609995665s: None
2024-03-21T00:34:02.797268604Z [2024-03-21 00:34:02,796: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:34:02.800764147Z [2024-03-21 00:34:02,800: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:34:02.818914509Z [2024-03-21 00:34:02,818: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:34:02.820143239Z [2024-03-21 00:34:02,819: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:34:02.820163026Z [2024-03-21 00:34:02,820: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:34:02.820267509Z [2024-03-21 00:34:02,820: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:34:02.820297808Z [2024-03-21 00:34:02,820: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:34:02.820609377Z [2024-03-21 00:34:02,820: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:34:02.820707150Z [2024-03-21 00:34:02,820: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:34:02.936061169Z [2024-03-21 00:34:02,935: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:34:03.097586737Z [2024-03-21 00:34:03,097: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:34:03.100980695Z [2024-03-21 00:34:03,100: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:34:03.126001553Z [2024-03-21 00:34:03,125: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:34:03.127476621Z [2024-03-21 00:34:03,127: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:34:03.127539116Z [2024-03-21 00:34:03,127: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:34:03.127672684Z [2024-03-21 00:34:03,127: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:34:03.127715159Z [2024-03-21 00:34:03,127: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:34:03.127963312Z [2024-03-21 00:34:03,127: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:34:03.128011311Z [2024-03-21 00:34:03,127: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:34:03.227540716Z [2024-03-21 00:34:03,227: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:34:04.726180988Z [2024-03-21 00:34:04,725: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[422c4475-1608-43a8-bce1-74be4ac6e178] succeeded in 3.892916150000019s: None
2024-03-21T00:34:04.843287227Z [2024-03-21 00:34:04,842: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dfd1445a-4174-4340-b090-b1317db71974] succeeded in 4.002133023999704s: None
2024-03-21T00:35:00.617689270Z [2024-03-21 00:35:00,617: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74a881e0-6eb9-4674-bb26-ae6feefe9eb1] received
2024-03-21T00:35:00.620193580Z [2024-03-21 00:35:00,619: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[992438c4-2c0b-44ed-b08b-ffd324c32e69] received
2024-03-21T00:35:00.623465207Z [2024-03-21 00:35:00,623: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8172ab81-25e6-43bb-8a0f-4981618aa4c9] received
2024-03-21T00:35:00.626515177Z [2024-03-21 00:35:00,626: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5112de88-95a0-4bc9-8ade-7a3f4a6c357e] received
2024-03-21T00:35:00.628543894Z [2024-03-21 00:35:00,628: INFO/ForkPoolWorker-16] [992438c4-2c0b-44ed-b08b-ffd324c32e69] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:35:00.628972328Z [2024-03-21 00:35:00,628: INFO/ForkPoolWorker-15] [74a881e0-6eb9-4674-bb26-ae6feefe9eb1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:35:00.633872000Z [2024-03-21 00:35:00,633: INFO/ForkPoolWorker-1] [8172ab81-25e6-43bb-8a0f-4981618aa4c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:35:00.640824231Z [2024-03-21 00:35:00,640: INFO/ForkPoolWorker-2] [5112de88-95a0-4bc9-8ade-7a3f4a6c357e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:35:01.029751097Z [2024-03-21 00:35:01,025: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:35:01.106292010Z [2024-03-21 00:35:01,103: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:35:01.167233794Z [2024-03-21 00:35:01,163: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:35:01.194575700Z [2024-03-21 00:35:01,188: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:35:01.240215971Z [2024-03-21 00:35:01,239: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T00:35:01.246968060Z [2024-03-21 00:35:01,246: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:35:01.284290809Z [2024-03-21 00:35:01,284: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:35:01.288951654Z [2024-03-21 00:35:01,288: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:35:01.289858912Z [2024-03-21 00:35:01,288: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:35:01.290868146Z [2024-03-21 00:35:01,289: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T00:35:01.291187318Z [2024-03-21 00:35:01,291: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:35:01.479813597Z [2024-03-21 00:35:01,479: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:35:02.227796176Z [2024-03-21 00:35:02,227: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5112de88-95a0-4bc9-8ade-7a3f4a6c357e] succeeded in 1.5993061190001754s: None
2024-03-21T00:35:02.703554649Z [2024-03-21 00:35:02,703: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:35:02.707874817Z [2024-03-21 00:35:02,707: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:35:02.749342080Z [2024-03-21 00:35:02,749: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:35:02.751818864Z [2024-03-21 00:35:02,751: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:35:02.752186387Z [2024-03-21 00:35:02,751: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:35:02.752548152Z [2024-03-21 00:35:02,752: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:35:02.752728071Z [2024-03-21 00:35:02,752: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:35:02.753438743Z [2024-03-21 00:35:02,753: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:35:02.753792568Z [2024-03-21 00:35:02,753: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:35:02.882483337Z [2024-03-21 00:35:02,882: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:35:03.019901538Z [2024-03-21 00:35:03,019: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:35:03.024955667Z [2024-03-21 00:35:03,023: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:35:03.120664915Z [2024-03-21 00:35:03,117: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:35:03.126918441Z [2024-03-21 00:35:03,125: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:35:03.126940338Z [2024-03-21 00:35:03,126: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:35:03.126945314Z [2024-03-21 00:35:03,126: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:35:03.126949925Z [2024-03-21 00:35:03,126: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:35:03.126969056Z [2024-03-21 00:35:03,126: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:35:03.126972600Z [2024-03-21 00:35:03,126: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:35:03.151295876Z [2024-03-21 00:35:03,150: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:35:03.161727748Z [2024-03-21 00:35:03,156: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:35:03.195801447Z [2024-03-21 00:35:03,195: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:35:03.197087436Z [2024-03-21 00:35:03,196: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:35:03.200682196Z [2024-03-21 00:35:03,197: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:35:03.200915700Z [2024-03-21 00:35:03,200: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:35:03.201048956Z [2024-03-21 00:35:03,200: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:35:03.201464884Z [2024-03-21 00:35:03,201: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:35:03.202047015Z [2024-03-21 00:35:03,201: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:35:03.254960780Z [2024-03-21 00:35:03,254: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:35:03.306418459Z [2024-03-21 00:35:03,306: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T00:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:35:04.003142535Z [2024-03-21 00:35:04,002: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8172ab81-25e6-43bb-8a0f-4981618aa4c9] succeeded in 3.3778121879995524s: None
2024-03-21T00:35:04.740925181Z [2024-03-21 00:35:04,740: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc633291-c6ee-4620-a5d6-5587c0fc2129] received
2024-03-21T00:35:04.757004796Z [2024-03-21 00:35:04,756: INFO/ForkPoolWorker-1] [cc633291-c6ee-4620-a5d6-5587c0fc2129] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:35:04.888437767Z [2024-03-21 00:35:04,883: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[992438c4-2c0b-44ed-b08b-ffd324c32e69] succeeded in 4.2617633280005975s: None
2024-03-21T00:35:05.019613719Z [2024-03-21 00:35:05,019: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[74a881e0-6eb9-4674-bb26-ae6feefe9eb1] succeeded in 4.400309874000413s: None
2024-03-21T00:35:05.152616373Z [2024-03-21 00:35:05,148: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:35:06.297667859Z [2024-03-21 00:35:06,297: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:35:06.301171699Z [2024-03-21 00:35:06,300: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:35:06.318798374Z [2024-03-21 00:35:06,318: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:35:06.320399620Z [2024-03-21 00:35:06,320: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:35:06.320512080Z [2024-03-21 00:35:06,320: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:35:06.320644405Z [2024-03-21 00:35:06,320: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:35:06.320711651Z [2024-03-21 00:35:06,320: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:35:06.320971906Z [2024-03-21 00:35:06,320: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:35:06.321049099Z [2024-03-21 00:35:06,320: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:35:06.400197783Z [2024-03-21 00:35:06,399: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T00:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:35:07.031821145Z [2024-03-21 00:35:07,031: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cc633291-c6ee-4620-a5d6-5587c0fc2129] succeeded in 2.2886342299998432s: None
2024-03-21T00:35:07.445408828Z [2024-03-21 00:35:07,445: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34ffd6dd-fa35-4726-babe-8bc6950f7cd2] received
2024-03-21T00:35:07.452472775Z [2024-03-21 00:35:07,452: INFO/ForkPoolWorker-15] [34ffd6dd-fa35-4726-babe-8bc6950f7cd2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T00:35:07.747778711Z [2024-03-21 00:35:07,744: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:35:08.902892713Z [2024-03-21 00:35:08,902: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:35:08.906445359Z [2024-03-21 00:35:08,905: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:35:08.922831966Z [2024-03-21 00:35:08,922: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:35:08.924265707Z [2024-03-21 00:35:08,923: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:35:08.924287919Z [2024-03-21 00:35:08,924: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:35:08.924488411Z [2024-03-21 00:35:08,924: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:35:08.924506438Z [2024-03-21 00:35:08,924: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:35:08.924833041Z [2024-03-21 00:35:08,924: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:35:08.924848964Z [2024-03-21 00:35:08,924: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:35:09.033517273Z [2024-03-21 00:35:09,033: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T00:30:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:35:09.667606758Z [2024-03-21 00:35:09,667: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a413b63-c245-471e-90e9-7cfc04e0a85a] received
2024-03-21T00:35:09.669224401Z [2024-03-21 00:35:09,668: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[34ffd6dd-fa35-4726-babe-8bc6950f7cd2] succeeded in 2.2217541150002944s: None
2024-03-21T00:35:09.677581523Z [2024-03-21 00:35:09,677: INFO/ForkPoolWorker-16] [3a413b63-c245-471e-90e9-7cfc04e0a85a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:35:10.013955084Z [2024-03-21 00:35:10,010: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:35:11.160049190Z [2024-03-21 00:35:11,159: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:35:11.163481825Z [2024-03-21 00:35:11,162: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:35:11.189348415Z [2024-03-21 00:35:11,189: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:35:11.190859246Z [2024-03-21 00:35:11,190: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:35:11.191096540Z [2024-03-21 00:35:11,190: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:35:11.191361416Z [2024-03-21 00:35:11,191: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:35:11.191412079Z [2024-03-21 00:35:11,191: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:35:11.191747774Z [2024-03-21 00:35:11,191: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:35:11.191782869Z [2024-03-21 00:35:11,191: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:35:11.301910976Z [2024-03-21 00:35:11,301: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T00:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:35:11.830542351Z [2024-03-21 00:35:11,829: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3a413b63-c245-471e-90e9-7cfc04e0a85a] succeeded in 2.1587536990000444s: None
2024-03-21T00:36:00.406087729Z [2024-03-21 00:36:00,405: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0fe7992-3233-44e2-956a-3bcd5a6030d7] received
2024-03-21T00:36:00.408857053Z [2024-03-21 00:36:00,408: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48505a85-49d7-4dd5-b731-18518d735f60] received
2024-03-21T00:36:00.410493168Z [2024-03-21 00:36:00,410: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c5fbdf2-ca28-48e5-984f-04debe86bd26] received
2024-03-21T00:36:00.411941504Z [2024-03-21 00:36:00,411: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37b9b954-6d89-44e5-949d-a665f09dfff6] received
2024-03-21T00:36:00.417259163Z [2024-03-21 00:36:00,416: INFO/ForkPoolWorker-15] [f0fe7992-3233-44e2-956a-3bcd5a6030d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:36:00.418163334Z [2024-03-21 00:36:00,417: INFO/ForkPoolWorker-2] [37b9b954-6d89-44e5-949d-a665f09dfff6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:36:00.421879821Z [2024-03-21 00:36:00,421: INFO/ForkPoolWorker-16] [48505a85-49d7-4dd5-b731-18518d735f60] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:36:00.423798657Z [2024-03-21 00:36:00,423: INFO/ForkPoolWorker-1] [2c5fbdf2-ca28-48e5-984f-04debe86bd26] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:36:00.751346510Z [2024-03-21 00:36:00,748: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:36:00.780998454Z [2024-03-21 00:36:00,777: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:36:00.843159992Z [2024-03-21 00:36:00,838: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:36:00.934797676Z [2024-03-21 00:36:00,931: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:36:01.027766520Z [2024-03-21 00:36:01,027: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:36:01.110385504Z [2024-03-21 00:36:01,108: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T00:36:01.115478730Z [2024-03-21 00:36:01,115: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:36:01.145632786Z [2024-03-21 00:36:01,145: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:36:01.150124953Z [2024-03-21 00:36:01,149: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:36:01.150320947Z [2024-03-21 00:36:01,150: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:36:01.150440921Z [2024-03-21 00:36:01,150: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T00:36:01.150727872Z [2024-03-21 00:36:01,150: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:36:01.248486726Z [2024-03-21 00:36:01,248: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:36:01.573774690Z [2024-03-21 00:36:01,573: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f0fe7992-3233-44e2-956a-3bcd5a6030d7] succeeded in 1.1637880569996923s: None
2024-03-21T00:36:01.818881878Z [2024-03-21 00:36:01,818: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[37b9b954-6d89-44e5-949d-a665f09dfff6] succeeded in 1.405541250999704s: None
2024-03-21T00:36:02.116345381Z [2024-03-21 00:36:02,115: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:36:02.120122886Z [2024-03-21 00:36:02,119: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:36:02.158463194Z [2024-03-21 00:36:02,158: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:36:02.160517257Z [2024-03-21 00:36:02,160: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:36:02.160713210Z [2024-03-21 00:36:02,160: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:36:02.161040684Z [2024-03-21 00:36:02,160: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:36:02.161173037Z [2024-03-21 00:36:02,160: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:36:02.161583515Z [2024-03-21 00:36:02,161: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:36:02.161726637Z [2024-03-21 00:36:02,161: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:36:02.236520839Z [2024-03-21 00:36:02,236: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:36:02.240872115Z [2024-03-21 00:36:02,240: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:36:02.274310626Z [2024-03-21 00:36:02,274: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:36:02.369831989Z [2024-03-21 00:36:02,369: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:36:02.372304383Z [2024-03-21 00:36:02,371: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:36:02.372733846Z [2024-03-21 00:36:02,372: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:36:02.373137353Z [2024-03-21 00:36:02,372: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:36:02.373480302Z [2024-03-21 00:36:02,373: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:36:02.374049123Z [2024-03-21 00:36:02,373: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:36:02.374987357Z [2024-03-21 00:36:02,374: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:36:02.502071984Z [2024-03-21 00:36:02,501: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:36:04.737152390Z [2024-03-21 00:36:04,736: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2c5fbdf2-ca28-48e5-984f-04debe86bd26] succeeded in 4.324064598999939s: None
2024-03-21T00:36:05.131030893Z [2024-03-21 00:36:05,130: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[48505a85-49d7-4dd5-b731-18518d735f60] succeeded in 4.718661467999482s: None
2024-03-21T00:37:00.372296116Z [2024-03-21 00:37:00,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc1a68e3-b83b-4010-9ddb-91a29fc1c60f] received
2024-03-21T00:37:00.377622761Z [2024-03-21 00:37:00,377: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbda24ac-9654-417f-bb19-3f60f1538e53] received
2024-03-21T00:37:00.388256956Z [2024-03-21 00:37:00,388: INFO/ForkPoolWorker-16] [dbda24ac-9654-417f-bb19-3f60f1538e53] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:37:00.389157504Z [2024-03-21 00:37:00,388: INFO/ForkPoolWorker-15] [dc1a68e3-b83b-4010-9ddb-91a29fc1c60f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:37:00.424158975Z [2024-03-21 00:37:00,423: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ac39576-5c59-41df-bdae-bc2d6d3ddf04] received
2024-03-21T00:37:00.447116801Z [2024-03-21 00:37:00,446: INFO/ForkPoolWorker-1] [0ac39576-5c59-41df-bdae-bc2d6d3ddf04] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:37:00.942308881Z [2024-03-21 00:37:00,938: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:37:01.146467527Z [2024-03-21 00:37:01,146: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T00:37:01.151384086Z [2024-03-21 00:37:01,150: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:37:01.208258136Z [2024-03-21 00:37:01,208: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:37:01.210638704Z [2024-03-21 00:37:01,210: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:37:01.211134036Z [2024-03-21 00:37:01,210: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:37:01.211368101Z [2024-03-21 00:37:01,211: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T00:37:01.212174894Z [2024-03-21 00:37:01,212: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:37:01.215086376Z [2024-03-21 00:37:01,211: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:37:01.286325778Z [2024-03-21 00:37:01,283: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:37:01.318588888Z [2024-03-21 00:37:01,318: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:37:02.186849057Z [2024-03-21 00:37:02,186: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dc1a68e3-b83b-4010-9ddb-91a29fc1c60f] succeeded in 1.8093318110004475s: None
2024-03-21T00:37:03.426205441Z [2024-03-21 00:37:03,425: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:37:03.436165823Z [2024-03-21 00:37:03,435: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:37:03.502250070Z [2024-03-21 00:37:03,499: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:37:03.519221827Z [2024-03-21 00:37:03,518: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:37:03.526627161Z [2024-03-21 00:37:03,519: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:37:03.528740247Z [2024-03-21 00:37:03,528: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:37:03.534699345Z [2024-03-21 00:37:03,534: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:37:03.535266837Z [2024-03-21 00:37:03,535: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:37:03.535477269Z [2024-03-21 00:37:03,535: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:37:03.540865567Z [2024-03-21 00:37:03,540: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:37:03.545652303Z [2024-03-21 00:37:03,545: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:37:03.597635768Z [2024-03-21 00:37:03,597: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:37:03.598793848Z [2024-03-21 00:37:03,598: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:37:03.598808073Z [2024-03-21 00:37:03,598: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:37:03.598934154Z [2024-03-21 00:37:03,598: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:37:03.598965514Z [2024-03-21 00:37:03,598: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:37:03.599330856Z [2024-03-21 00:37:03,599: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:37:03.599387155Z [2024-03-21 00:37:03,599: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:37:03.717315132Z [2024-03-21 00:37:03,716: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:37:03.739323153Z [2024-03-21 00:37:03,739: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:37:07.686248079Z [2024-03-21 00:37:07,685: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0ac39576-5c59-41df-bdae-bc2d6d3ddf04] succeeded in 7.255174109000109s: None
2024-03-21T00:37:08.110677968Z [2024-03-21 00:37:08,109: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dbda24ac-9654-417f-bb19-3f60f1538e53] succeeded in 7.726882605000355s: None
2024-03-21T00:38:00.473196484Z [2024-03-21 00:38:00,472: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[416c38fb-5bfe-49db-87cf-8a0ad0fc5687] received
2024-03-21T00:38:00.475395774Z [2024-03-21 00:38:00,475: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c373de26-c00d-42c5-b377-6f20a611448a] received
2024-03-21T00:38:00.477409556Z [2024-03-21 00:38:00,477: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12b7da06-2bf7-4146-b1fa-958415be5fd7] received
2024-03-21T00:38:00.479708343Z [2024-03-21 00:38:00,479: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11b58c1a-1a10-46dc-bc13-3eca6d3b103f] received
2024-03-21T00:38:00.483011047Z [2024-03-21 00:38:00,482: INFO/ForkPoolWorker-15] [416c38fb-5bfe-49db-87cf-8a0ad0fc5687] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:38:00.486987582Z [2024-03-21 00:38:00,486: INFO/ForkPoolWorker-16] [c373de26-c00d-42c5-b377-6f20a611448a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:38:00.492716690Z [2024-03-21 00:38:00,492: INFO/ForkPoolWorker-1] [12b7da06-2bf7-4146-b1fa-958415be5fd7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:38:00.494121936Z [2024-03-21 00:38:00,493: INFO/ForkPoolWorker-2] [11b58c1a-1a10-46dc-bc13-3eca6d3b103f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:38:00.863490271Z [2024-03-21 00:38:00,860: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:38:00.878901120Z [2024-03-21 00:38:00,868: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:38:00.914260218Z [2024-03-21 00:38:00,910: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:38:00.989525769Z [2024-03-21 00:38:00,985: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:38:01.032209437Z [2024-03-21 00:38:01,031: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T00:38:01.036102401Z [2024-03-21 00:38:01,035: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:38:01.069159738Z [2024-03-21 00:38:01,068: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:38:01.071069559Z [2024-03-21 00:38:01,070: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:38:01.071337595Z [2024-03-21 00:38:01,071: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:38:01.071408285Z [2024-03-21 00:38:01,071: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T00:38:01.071977129Z [2024-03-21 00:38:01,071: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:38:01.158081159Z [2024-03-21 00:38:01,157: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:38:01.284537767Z [2024-03-21 00:38:01,284: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:38:01.866153195Z [2024-03-21 00:38:01,865: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c373de26-c00d-42c5-b377-6f20a611448a] succeeded in 1.388999724000314s: None
2024-03-21T00:38:01.901609564Z [2024-03-21 00:38:01,901: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[416c38fb-5bfe-49db-87cf-8a0ad0fc5687] succeeded in 1.4250401810004405s: None
2024-03-21T00:38:02.535216317Z [2024-03-21 00:38:02,534: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T00:38:02.539238029Z [2024-03-21 00:38:02,538: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:38:02.560733649Z [2024-03-21 00:38:02,560: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:38:02.564494605Z [2024-03-21 00:38:02,563: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:38:02.580659767Z [2024-03-21 00:38:02,580: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:38:02.584157685Z [2024-03-21 00:38:02,583: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:38:02.584400992Z [2024-03-21 00:38:02,584: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:38:02.584683314Z [2024-03-21 00:38:02,584: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:38:02.584984717Z [2024-03-21 00:38:02,584: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T00:38:02.585453637Z [2024-03-21 00:38:02,585: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:38:02.585570680Z [2024-03-21 00:38:02,585: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:38:02.588826276Z [2024-03-21 00:38:02,588: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:38:02.590720357Z [2024-03-21 00:38:02,590: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:38:02.590738073Z [2024-03-21 00:38:02,590: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:38:02.590903574Z [2024-03-21 00:38:02,590: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:38:02.590958565Z [2024-03-21 00:38:02,590: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:38:02.591292034Z [2024-03-21 00:38:02,591: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:38:02.591351915Z [2024-03-21 00:38:02,591: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:38:02.708953053Z [2024-03-21 00:38:02,708: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:38:02.728451225Z [2024-03-21 00:38:02,728: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:38:04.512488245Z [2024-03-21 00:38:04,511: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[11b58c1a-1a10-46dc-bc13-3eca6d3b103f] succeeded in 4.030675610000799s: None
2024-03-21T00:38:04.917212675Z [2024-03-21 00:38:04,916: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[12b7da06-2bf7-4146-b1fa-958415be5fd7] succeeded in 4.4373532549998345s: None
2024-03-21T00:39:00.193095024Z [2024-03-21 00:39:00,192: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[328e3cd7-5911-4f4a-9b1a-bc12cb1c398b] received
2024-03-21T00:39:00.206275762Z [2024-03-21 00:39:00,205: INFO/ForkPoolWorker-15] [328e3cd7-5911-4f4a-9b1a-bc12cb1c398b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:39:00.211074511Z [2024-03-21 00:39:00,210: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79905ec9-e5bd-4544-a97b-fabd7613565c] received
2024-03-21T00:39:00.220389027Z [2024-03-21 00:39:00,220: INFO/ForkPoolWorker-16] [79905ec9-e5bd-4544-a97b-fabd7613565c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:39:00.242015368Z [2024-03-21 00:39:00,241: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5e3aa16-2ec2-4a8d-973d-e0ddff87f1dc] received
2024-03-21T00:39:00.257254359Z [2024-03-21 00:39:00,256: INFO/ForkPoolWorker-1] [e5e3aa16-2ec2-4a8d-973d-e0ddff87f1dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:39:00.542847943Z [2024-03-21 00:39:00,539: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:39:00.648459688Z [2024-03-21 00:39:00,645: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:39:00.729190778Z [2024-03-21 00:39:00,725: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:39:00.986549524Z [2024-03-21 00:39:00,986: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T00:39:00.990426140Z [2024-03-21 00:39:00,989: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:39:01.013763711Z [2024-03-21 00:39:01,013: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:39:01.014945974Z [2024-03-21 00:39:01,014: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:39:01.015102668Z [2024-03-21 00:39:01,014: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:39:01.015223779Z [2024-03-21 00:39:01,015: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T00:39:01.015675019Z [2024-03-21 00:39:01,015: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:39:01.170630767Z [2024-03-21 00:39:01,170: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:39:01.945678055Z [2024-03-21 00:39:01,945: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[79905ec9-e5bd-4544-a97b-fabd7613565c] succeeded in 1.731038902000364s: None
2024-03-21T00:39:02.555637304Z [2024-03-21 00:39:02,555: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:39:02.561687189Z [2024-03-21 00:39:02,560: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:39:02.594371816Z [2024-03-21 00:39:02,594: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:39:02.596840609Z [2024-03-21 00:39:02,596: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:39:02.597178571Z [2024-03-21 00:39:02,596: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:39:02.597507379Z [2024-03-21 00:39:02,597: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:39:02.597735239Z [2024-03-21 00:39:02,597: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:39:02.598231611Z [2024-03-21 00:39:02,597: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:39:02.598889168Z [2024-03-21 00:39:02,598: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:39:02.721885481Z [2024-03-21 00:39:02,721: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:39:02.737394700Z [2024-03-21 00:39:02,736: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:39:02.744416197Z [2024-03-21 00:39:02,743: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:39:02.788031890Z [2024-03-21 00:39:02,787: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:39:02.792746553Z [2024-03-21 00:39:02,792: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:39:02.792957386Z [2024-03-21 00:39:02,792: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:39:02.793268392Z [2024-03-21 00:39:02,792: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:39:02.793530863Z [2024-03-21 00:39:02,793: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:39:02.794007705Z [2024-03-21 00:39:02,793: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:39:02.794243702Z [2024-03-21 00:39:02,794: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:39:02.919566873Z [2024-03-21 00:39:02,919: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:39:04.690013685Z [2024-03-21 00:39:04,689: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e5e3aa16-2ec2-4a8d-973d-e0ddff87f1dc] succeeded in 4.440670193999722s: None
2024-03-21T00:39:05.157265692Z [2024-03-21 00:39:05,156: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[328e3cd7-5911-4f4a-9b1a-bc12cb1c398b] succeeded in 4.961709053999584s: None
2024-03-21T00:40:00.818325361Z [2024-03-21 00:40:00,817: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eccfeee1-19e6-4e9d-bc42-b53b05486a32] received
2024-03-21T00:40:00.819800403Z [2024-03-21 00:40:00,819: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[98ad8b7e-59b3-4410-ad88-3698f2d49551] received
2024-03-21T00:40:00.825268563Z [2024-03-21 00:40:00,825: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d522286-b6cf-46b8-b48b-e05d2447085d] received
2024-03-21T00:40:00.826660578Z [2024-03-21 00:40:00,826: INFO/ForkPoolWorker-15] [eccfeee1-19e6-4e9d-bc42-b53b05486a32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:40:00.835667244Z [2024-03-21 00:40:00,835: INFO/ForkPoolWorker-16] [98ad8b7e-59b3-4410-ad88-3698f2d49551] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:40:00.849881819Z [2024-03-21 00:40:00,847: INFO/ForkPoolWorker-1] [4d522286-b6cf-46b8-b48b-e05d2447085d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:40:00.860847809Z [2024-03-21 00:40:00,860: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0bdd128-b871-4c38-8d28-5ed7eacd2583] received
2024-03-21T00:40:00.870309115Z [2024-03-21 00:40:00,869: INFO/ForkPoolWorker-2] [a0bdd128-b871-4c38-8d28-5ed7eacd2583] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:40:00.884443195Z [2024-03-21 00:40:00,875: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36bc5606-100b-41de-8482-c659452a34ea] received
2024-03-21T00:40:00.943657245Z [2024-03-21 00:40:00,943: INFO/ForkPoolWorker-3] [36bc5606-100b-41de-8482-c659452a34ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:40:01.338336943Z [2024-03-21 00:40:01,332: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:40:01.394770818Z [2024-03-21 00:40:01,390: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:40:01.434506064Z [2024-03-21 00:40:01,430: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:40:01.479538977Z [2024-03-21 00:40:01,475: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:40:01.715391588Z [2024-03-21 00:40:01,708: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:40:01.765743364Z [2024-03-21 00:40:01,765: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T00:40:01.771963097Z [2024-03-21 00:40:01,771: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:40:01.828184168Z [2024-03-21 00:40:01,827: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:40:01.833634668Z [2024-03-21 00:40:01,833: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:40:01.833699423Z [2024-03-21 00:40:01,833: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:40:01.833723593Z [2024-03-21 00:40:01,833: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T00:40:01.834036908Z [2024-03-21 00:40:01,833: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:40:01.946932816Z [2024-03-21 00:40:01,946: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:40:02.404086700Z [2024-03-21 00:40:02,403: INFO/ForkPoolWorker-3] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:40:03.509404197Z [2024-03-21 00:40:03,508: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[36bc5606-100b-41de-8482-c659452a34ea] succeeded in 2.6131820589998824s: None
2024-03-21T00:40:03.542505672Z [2024-03-21 00:40:03,542: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[98ad8b7e-59b3-4410-ad88-3698f2d49551] succeeded in 2.721334360000583s: None
2024-03-21T00:40:03.804217953Z [2024-03-21 00:40:03,803: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T00:40:03.808301837Z [2024-03-21 00:40:03,807: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:40:03.837875178Z [2024-03-21 00:40:03,837: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:40:03.839275865Z [2024-03-21 00:40:03,838: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:40:03.839320351Z [2024-03-21 00:40:03,839: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:40:03.839357567Z [2024-03-21 00:40:03,839: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:40:03.839364541Z [2024-03-21 00:40:03,839: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T00:40:03.839624459Z [2024-03-21 00:40:03,839: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:40:03.839635038Z [2024-03-21 00:40:03,839: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:40:03.963790703Z [2024-03-21 00:40:03,963: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:40:04.299252413Z [2024-03-21 00:40:04,298: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:40:04.304482071Z [2024-03-21 00:40:04,303: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:40:04.317429762Z [2024-03-21 00:40:04,317: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:40:04.323582847Z [2024-03-21 00:40:04,323: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:40:04.344598628Z [2024-03-21 00:40:04,344: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:40:04.347254439Z [2024-03-21 00:40:04,346: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:40:04.347509392Z [2024-03-21 00:40:04,347: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:40:04.347736003Z [2024-03-21 00:40:04,347: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:40:04.347916350Z [2024-03-21 00:40:04,347: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:40:04.348284082Z [2024-03-21 00:40:04,348: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:40:04.348496421Z [2024-03-21 00:40:04,348: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:40:04.379755409Z [2024-03-21 00:40:04,379: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:40:04.381462112Z [2024-03-21 00:40:04,381: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:40:04.381589993Z [2024-03-21 00:40:04,381: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:40:04.381798862Z [2024-03-21 00:40:04,381: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:40:04.381952614Z [2024-03-21 00:40:04,381: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:40:04.382338889Z [2024-03-21 00:40:04,382: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:40:04.383000738Z [2024-03-21 00:40:04,382: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:40:04.518915846Z [2024-03-21 00:40:04,518: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T00:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:40:04.603783788Z [2024-03-21 00:40:04,603: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:40:05.533396547Z [2024-03-21 00:40:05,532: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4d522286-b6cf-46b8-b48b-e05d2447085d] succeeded in 4.7040956300006656s: None
2024-03-21T00:40:05.851822361Z [2024-03-21 00:40:05,851: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17d68eec-236a-4d96-a6b2-0411e05a4e38] received
2024-03-21T00:40:05.871006673Z [2024-03-21 00:40:05,870: INFO/ForkPoolWorker-16] [17d68eec-236a-4d96-a6b2-0411e05a4e38] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:40:06.519235345Z [2024-03-21 00:40:06,518: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a0bdd128-b871-4c38-8d28-5ed7eacd2583] succeeded in 5.656464486000004s: None
2024-03-21T00:40:06.609054667Z [2024-03-21 00:40:06,603: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:40:07.075603529Z [2024-03-21 00:40:07,074: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eccfeee1-19e6-4e9d-bc42-b53b05486a32] succeeded in 6.253763147999962s: None
2024-03-21T00:40:08.221131699Z [2024-03-21 00:40:08,220: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:40:08.226447589Z [2024-03-21 00:40:08,225: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:40:08.287270991Z [2024-03-21 00:40:08,286: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:40:08.290592213Z [2024-03-21 00:40:08,290: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:40:08.290626715Z [2024-03-21 00:40:08,290: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:40:08.290866290Z [2024-03-21 00:40:08,290: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:40:08.290942407Z [2024-03-21 00:40:08,290: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:40:08.291619690Z [2024-03-21 00:40:08,291: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:40:08.291629680Z [2024-03-21 00:40:08,291: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:40:08.415204923Z [2024-03-21 00:40:08,414: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T00:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:40:09.318529533Z [2024-03-21 00:40:09,317: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[17d68eec-236a-4d96-a6b2-0411e05a4e38] succeeded in 3.4601162830003886s: None
2024-03-21T00:40:09.642178885Z [2024-03-21 00:40:09,641: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15c5fcbc-96c7-4388-96b7-18a5f8c0a04e] received
2024-03-21T00:40:09.663318815Z [2024-03-21 00:40:09,663: INFO/ForkPoolWorker-15] [15c5fcbc-96c7-4388-96b7-18a5f8c0a04e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T00:40:10.186679767Z [2024-03-21 00:40:10,181: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:40:12.387949563Z [2024-03-21 00:40:12,387: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:40:12.399122607Z [2024-03-21 00:40:12,398: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:40:12.483999712Z [2024-03-21 00:40:12,483: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:40:12.489741438Z [2024-03-21 00:40:12,489: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:40:12.489913906Z [2024-03-21 00:40:12,489: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:40:12.490165906Z [2024-03-21 00:40:12,489: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:40:12.490379375Z [2024-03-21 00:40:12,490: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:40:12.490788214Z [2024-03-21 00:40:12,490: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:40:12.490965523Z [2024-03-21 00:40:12,490: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:40:12.650430422Z [2024-03-21 00:40:12,650: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T00:35:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:40:13.302511395Z [2024-03-21 00:40:13,302: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[15c5fcbc-96c7-4388-96b7-18a5f8c0a04e] succeeded in 3.6578760200000033s: None
2024-03-21T00:40:13.686834651Z [2024-03-21 00:40:13,686: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da53a4b4-2ae3-4a19-ade5-f70b1fe95d68] received
2024-03-21T00:40:13.703238422Z [2024-03-21 00:40:13,702: INFO/ForkPoolWorker-15] [da53a4b4-2ae3-4a19-ade5-f70b1fe95d68] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:40:14.038025665Z [2024-03-21 00:40:14,034: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:40:15.434366421Z [2024-03-21 00:40:15,434: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:40:15.437903625Z [2024-03-21 00:40:15,437: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:40:15.461678411Z [2024-03-21 00:40:15,461: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:40:15.465947219Z [2024-03-21 00:40:15,465: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:40:15.466142902Z [2024-03-21 00:40:15,465: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:40:15.466385417Z [2024-03-21 00:40:15,466: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:40:15.466577743Z [2024-03-21 00:40:15,466: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:40:15.466897913Z [2024-03-21 00:40:15,466: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:40:15.467058213Z [2024-03-21 00:40:15,466: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:40:15.548814860Z [2024-03-21 00:40:15,548: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T00:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:40:16.155344122Z [2024-03-21 00:40:16,154: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[da53a4b4-2ae3-4a19-ade5-f70b1fe95d68] succeeded in 2.4646813560002556s: None
2024-03-21T00:41:01.121330875Z [2024-03-21 00:41:01,118: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07f313ce-d29d-4a6e-9386-9f1f9e00e6ee] received
2024-03-21T00:41:01.135724866Z [2024-03-21 00:41:01,135: INFO/ForkPoolWorker-15] [07f313ce-d29d-4a6e-9386-9f1f9e00e6ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:41:01.151299341Z [2024-03-21 00:41:01,151: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7534fbd-9150-44da-83a8-56599045d7e2] received
2024-03-21T00:41:01.155799739Z [2024-03-21 00:41:01,155: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c62895ef-8648-448f-b97f-0c193ef28d8b] received
2024-03-21T00:41:01.165872254Z [2024-03-21 00:41:01,165: INFO/ForkPoolWorker-16] [b7534fbd-9150-44da-83a8-56599045d7e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:41:01.175275403Z [2024-03-21 00:41:01,174: INFO/ForkPoolWorker-1] [c62895ef-8648-448f-b97f-0c193ef28d8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:41:01.543690157Z [2024-03-21 00:41:01,538: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:41:01.667053365Z [2024-03-21 00:41:01,663: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:41:01.719412620Z [2024-03-21 00:41:01,716: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:41:01.925490376Z [2024-03-21 00:41:01,924: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T00:41:01.932787293Z [2024-03-21 00:41:01,932: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:41:01.958652078Z [2024-03-21 00:41:01,958: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:41:01.960616382Z [2024-03-21 00:41:01,960: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:41:01.960781437Z [2024-03-21 00:41:01,960: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:41:01.960897842Z [2024-03-21 00:41:01,960: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T00:41:01.961863557Z [2024-03-21 00:41:01,961: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:41:02.118956501Z [2024-03-21 00:41:02,118: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:41:02.899335256Z [2024-03-21 00:41:02,898: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[07f313ce-d29d-4a6e-9386-9f1f9e00e6ee] succeeded in 1.7735445520002031s: None
2024-03-21T00:41:03.543037112Z [2024-03-21 00:41:03,542: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:41:03.547429508Z [2024-03-21 00:41:03,546: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:41:03.570679700Z [2024-03-21 00:41:03,570: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:41:03.575377020Z [2024-03-21 00:41:03,574: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:41:03.580707346Z [2024-03-21 00:41:03,580: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:41:03.582318696Z [2024-03-21 00:41:03,582: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:41:03.582341418Z [2024-03-21 00:41:03,582: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:41:03.582505439Z [2024-03-21 00:41:03,582: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:41:03.582563205Z [2024-03-21 00:41:03,582: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:41:03.582913967Z [2024-03-21 00:41:03,582: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:41:03.582986983Z [2024-03-21 00:41:03,582: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:41:03.604003187Z [2024-03-21 00:41:03,603: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:41:03.606267639Z [2024-03-21 00:41:03,606: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:41:03.606334251Z [2024-03-21 00:41:03,606: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:41:03.606579932Z [2024-03-21 00:41:03,606: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:41:03.606663196Z [2024-03-21 00:41:03,606: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:41:03.606969813Z [2024-03-21 00:41:03,606: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:41:03.607062268Z [2024-03-21 00:41:03,606: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:41:03.686882707Z [2024-03-21 00:41:03,686: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:41:03.715626335Z [2024-03-21 00:41:03,715: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:41:06.916236680Z [2024-03-21 00:41:06,915: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c62895ef-8648-448f-b97f-0c193ef28d8b] succeeded in 5.75775403499938s: None
2024-03-21T00:41:07.268400945Z [2024-03-21 00:41:07,267: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b7534fbd-9150-44da-83a8-56599045d7e2] succeeded in 6.11117898700013s: None
2024-03-21T00:42:00.539563938Z [2024-03-21 00:42:00,539: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ddf06842-50bb-45df-a236-d42c89c5cab8] received
2024-03-21T00:42:00.543565392Z [2024-03-21 00:42:00,543: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[748bd834-7857-448b-8767-0723972c9514] received
2024-03-21T00:42:00.550367574Z [2024-03-21 00:42:00,550: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[98243c45-877b-4400-aa1d-fe24d12b3edc] received
2024-03-21T00:42:00.556371500Z [2024-03-21 00:42:00,556: INFO/ForkPoolWorker-15] [ddf06842-50bb-45df-a236-d42c89c5cab8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:42:00.557259716Z [2024-03-21 00:42:00,557: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bfb3b349-7405-4b92-8247-536b5877b638] received
2024-03-21T00:42:00.561679726Z [2024-03-21 00:42:00,561: INFO/ForkPoolWorker-16] [748bd834-7857-448b-8767-0723972c9514] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:42:00.573309395Z [2024-03-21 00:42:00,571: INFO/ForkPoolWorker-1] [98243c45-877b-4400-aa1d-fe24d12b3edc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:42:00.597146996Z [2024-03-21 00:42:00,596: INFO/ForkPoolWorker-2] [bfb3b349-7405-4b92-8247-536b5877b638] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:42:01.153549006Z [2024-03-21 00:42:01,140: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:42:01.297370410Z [2024-03-21 00:42:01,292: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:42:01.365287054Z [2024-03-21 00:42:01,360: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:42:01.488756892Z [2024-03-21 00:42:01,482: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:42:01.590202492Z [2024-03-21 00:42:01,589: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T00:42:01.596092464Z [2024-03-21 00:42:01,595: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:42:01.634810751Z [2024-03-21 00:42:01,634: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:42:01.638937028Z [2024-03-21 00:42:01,638: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:42:01.638966195Z [2024-03-21 00:42:01,638: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:42:01.639005977Z [2024-03-21 00:42:01,638: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T00:42:01.639225209Z [2024-03-21 00:42:01,639: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:42:01.924332970Z [2024-03-21 00:42:01,924: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:42:02.000173720Z [2024-03-21 00:42:01,999: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:42:03.211992109Z [2024-03-21 00:42:03,211: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ddf06842-50bb-45df-a236-d42c89c5cab8] succeeded in 2.6640906909997284s: None
2024-03-21T00:42:03.438072562Z [2024-03-21 00:42:03,437: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[98243c45-877b-4400-aa1d-fe24d12b3edc] succeeded in 2.881183348000377s: None
2024-03-21T00:42:03.748466099Z [2024-03-21 00:42:03,748: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T00:42:03.752502355Z [2024-03-21 00:42:03,751: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:42:03.784077332Z [2024-03-21 00:42:03,783: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:42:03.785682096Z [2024-03-21 00:42:03,785: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:42:03.785888693Z [2024-03-21 00:42:03,785: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:42:03.786074845Z [2024-03-21 00:42:03,785: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:42:03.786139489Z [2024-03-21 00:42:03,786: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T00:42:03.786392026Z [2024-03-21 00:42:03,786: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:42:03.786452286Z [2024-03-21 00:42:03,786: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:42:03.902766672Z [2024-03-21 00:42:03,902: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:42:04.179698007Z [2024-03-21 00:42:04,179: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:42:04.183431899Z [2024-03-21 00:42:04,182: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:42:04.211587083Z [2024-03-21 00:42:04,211: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:42:04.214476174Z [2024-03-21 00:42:04,213: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:42:04.214664130Z [2024-03-21 00:42:04,214: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:42:04.214849846Z [2024-03-21 00:42:04,214: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:42:04.214945909Z [2024-03-21 00:42:04,214: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:42:04.223202664Z [2024-03-21 00:42:04,222: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:42:04.223222795Z [2024-03-21 00:42:04,223: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:42:04.329826178Z [2024-03-21 00:42:04,329: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:42:08.368611724Z [2024-03-21 00:42:08,368: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[748bd834-7857-448b-8767-0723972c9514] succeeded in 7.819615124999473s: None
2024-03-21T00:42:09.738442873Z [2024-03-21 00:42:09,737: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bfb3b349-7405-4b92-8247-536b5877b638] succeeded in 9.171680852999998s: None
2024-03-21T00:43:00.481486552Z [2024-03-21 00:43:00,481: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16d62f69-682d-4911-9bb5-86d07a58a0ea] received
2024-03-21T00:43:00.492821586Z [2024-03-21 00:43:00,492: INFO/ForkPoolWorker-15] [16d62f69-682d-4911-9bb5-86d07a58a0ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:43:00.493771608Z [2024-03-21 00:43:00,493: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48080951-dbb3-4d25-9047-328580c29bc2] received
2024-03-21T00:43:00.497629633Z [2024-03-21 00:43:00,497: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[768b1bf6-5b34-4cb4-a35f-f3af59e6c1d1] received
2024-03-21T00:43:00.505766265Z [2024-03-21 00:43:00,504: INFO/ForkPoolWorker-1] [768b1bf6-5b34-4cb4-a35f-f3af59e6c1d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:43:00.516010694Z [2024-03-21 00:43:00,515: INFO/ForkPoolWorker-16] [48080951-dbb3-4d25-9047-328580c29bc2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:43:00.891268881Z [2024-03-21 00:43:00,887: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:43:00.908759662Z [2024-03-21 00:43:00,903: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:43:00.926303219Z [2024-03-21 00:43:00,921: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:43:01.141721614Z [2024-03-21 00:43:01,139: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T00:43:01.149310058Z [2024-03-21 00:43:01,145: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:43:01.205856975Z [2024-03-21 00:43:01,205: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:43:01.212792330Z [2024-03-21 00:43:01,207: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:43:01.212819889Z [2024-03-21 00:43:01,208: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:43:01.212823883Z [2024-03-21 00:43:01,208: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T00:43:01.212827012Z [2024-03-21 00:43:01,208: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:43:01.422231329Z [2024-03-21 00:43:01,422: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:43:02.142192921Z [2024-03-21 00:43:02,141: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[16d62f69-682d-4911-9bb5-86d07a58a0ea] succeeded in 1.6577540170001157s: None
2024-03-21T00:43:02.622417873Z [2024-03-21 00:43:02,620: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:43:02.632053657Z [2024-03-21 00:43:02,624: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:43:02.632101302Z [2024-03-21 00:43:02,624: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:43:02.632106585Z [2024-03-21 00:43:02,628: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:43:02.646414797Z [2024-03-21 00:43:02,646: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:43:02.646496568Z [2024-03-21 00:43:02,646: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:43:02.647790222Z [2024-03-21 00:43:02,647: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:43:02.647803144Z [2024-03-21 00:43:02,647: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:43:02.647978363Z [2024-03-21 00:43:02,647: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:43:02.647998300Z [2024-03-21 00:43:02,647: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:43:02.648150030Z [2024-03-21 00:43:02,647: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:43:02.648417460Z [2024-03-21 00:43:02,648: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:43:02.648436485Z [2024-03-21 00:43:02,648: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:43:02.648515795Z [2024-03-21 00:43:02,648: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:43:02.648522009Z [2024-03-21 00:43:02,648: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:43:02.648689352Z [2024-03-21 00:43:02,648: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:43:02.649051660Z [2024-03-21 00:43:02,648: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:43:02.649150876Z [2024-03-21 00:43:02,648: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:43:02.734349582Z [2024-03-21 00:43:02,734: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:43:02.734685307Z [2024-03-21 00:43:02,734: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:43:05.026364206Z [2024-03-21 00:43:05,025: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[768b1bf6-5b34-4cb4-a35f-f3af59e6c1d1] succeeded in 4.527601903000686s: None
2024-03-21T00:43:05.998010199Z [2024-03-21 00:43:05,997: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[48080951-dbb3-4d25-9047-328580c29bc2] succeeded in 5.501152382000328s: None
2024-03-21T00:44:00.251899506Z [2024-03-21 00:44:00,251: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6793ac27-c17a-4596-b25f-b277fa89759a] received
2024-03-21T00:44:00.265213404Z [2024-03-21 00:44:00,264: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[645ba5dc-75cd-4fb2-88f2-d395a4909511] received
2024-03-21T00:44:00.265980685Z [2024-03-21 00:44:00,265: INFO/ForkPoolWorker-15] [6793ac27-c17a-4596-b25f-b277fa89759a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:44:00.276277182Z [2024-03-21 00:44:00,276: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc1924c8-0969-4ad9-a84b-3a35f3999eb3] received
2024-03-21T00:44:00.286302843Z [2024-03-21 00:44:00,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e81ceaf-1219-4fb4-8f4e-1574d626277a] received
2024-03-21T00:44:00.286788152Z [2024-03-21 00:44:00,286: INFO/ForkPoolWorker-16] [645ba5dc-75cd-4fb2-88f2-d395a4909511] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:44:00.287446026Z [2024-03-21 00:44:00,287: INFO/ForkPoolWorker-1] [dc1924c8-0969-4ad9-a84b-3a35f3999eb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:44:00.300448901Z [2024-03-21 00:44:00,300: INFO/ForkPoolWorker-2] [4e81ceaf-1219-4fb4-8f4e-1574d626277a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:44:00.621165142Z [2024-03-21 00:44:00,617: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:44:00.636172519Z [2024-03-21 00:44:00,632: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:44:00.677912150Z [2024-03-21 00:44:00,674: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:44:00.681801763Z [2024-03-21 00:44:00,673: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:44:01.005825697Z [2024-03-21 00:44:01,005: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T00:44:01.010586410Z [2024-03-21 00:44:01,010: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:44:01.070039278Z [2024-03-21 00:44:01,069: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:44:01.074646508Z [2024-03-21 00:44:01,074: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:44:01.074977474Z [2024-03-21 00:44:01,074: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:44:01.075005048Z [2024-03-21 00:44:01,074: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T00:44:01.075285267Z [2024-03-21 00:44:01,075: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:44:01.130579053Z [2024-03-21 00:44:01,130: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:44:01.181398190Z [2024-03-21 00:44:01,180: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:44:01.878703408Z [2024-03-21 00:44:01,877: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[645ba5dc-75cd-4fb2-88f2-d395a4909511] succeeded in 1.6040566230003606s: None
2024-03-21T00:44:01.913496843Z [2024-03-21 00:44:01,912: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6793ac27-c17a-4596-b25f-b277fa89759a] succeeded in 1.6594474379999156s: None
2024-03-21T00:44:02.092140462Z [2024-03-21 00:44:02,091: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T00:44:02.096050952Z [2024-03-21 00:44:02,095: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:44:02.125170372Z [2024-03-21 00:44:02,124: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:44:02.127441269Z [2024-03-21 00:44:02,127: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:44:02.127458934Z [2024-03-21 00:44:02,127: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:44:02.127893427Z [2024-03-21 00:44:02,127: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:44:02.128095154Z [2024-03-21 00:44:02,127: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T00:44:02.129024620Z [2024-03-21 00:44:02,128: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:44:02.129045623Z [2024-03-21 00:44:02,128: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:44:02.210632347Z [2024-03-21 00:44:02,210: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:44:02.214740604Z [2024-03-21 00:44:02,214: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:44:02.259805085Z [2024-03-21 00:44:02,259: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:44:02.274321183Z [2024-03-21 00:44:02,264: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:44:02.274375244Z [2024-03-21 00:44:02,266: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:44:02.274381446Z [2024-03-21 00:44:02,266: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:44:02.274388537Z [2024-03-21 00:44:02,266: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:44:02.274394665Z [2024-03-21 00:44:02,267: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:44:02.274399756Z [2024-03-21 00:44:02,267: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:44:02.274404483Z [2024-03-21 00:44:02,267: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:44:02.537057860Z [2024-03-21 00:44:02,536: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:44:04.266303401Z [2024-03-21 00:44:04,265: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4e81ceaf-1219-4fb4-8f4e-1574d626277a] succeeded in 3.9722851159995116s: None
2024-03-21T00:44:05.243741844Z [2024-03-21 00:44:05,242: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dc1924c8-0969-4ad9-a84b-3a35f3999eb3] succeeded in 4.9655143959998895s: None
2024-03-21T00:45:01.294375444Z [2024-03-21 00:45:01,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f6b5762-5518-4818-aab6-84ed982352df] received
2024-03-21T00:45:01.298176509Z [2024-03-21 00:45:01,297: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[022b5e71-0186-403a-af74-669a86588be7] received
2024-03-21T00:45:01.301975200Z [2024-03-21 00:45:01,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0a13095-6707-496f-b57c-135f4070f8aa] received
2024-03-21T00:45:01.303899485Z [2024-03-21 00:45:01,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b514969-7096-4787-b4c0-23e241f6f22b] received
2024-03-21T00:45:01.312534191Z [2024-03-21 00:45:01,312: INFO/ForkPoolWorker-1] [f0a13095-6707-496f-b57c-135f4070f8aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:45:01.313790041Z [2024-03-21 00:45:01,312: INFO/ForkPoolWorker-16] [022b5e71-0186-403a-af74-669a86588be7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:45:01.314746347Z [2024-03-21 00:45:01,314: INFO/ForkPoolWorker-15] [0f6b5762-5518-4818-aab6-84ed982352df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:45:01.319959262Z [2024-03-21 00:45:01,319: INFO/ForkPoolWorker-2] [7b514969-7096-4787-b4c0-23e241f6f22b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:45:01.687484035Z [2024-03-21 00:45:01,684: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:45:01.696903163Z [2024-03-21 00:45:01,691: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:45:01.866151756Z [2024-03-21 00:45:01,857: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:45:01.923507485Z [2024-03-21 00:45:01,920: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:45:01.995599680Z [2024-03-21 00:45:01,995: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T00:45:02.000064052Z [2024-03-21 00:45:01,999: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:45:02.039071886Z [2024-03-21 00:45:02,038: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:45:02.040296429Z [2024-03-21 00:45:02,040: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:45:02.040371200Z [2024-03-21 00:45:02,040: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:45:02.040460818Z [2024-03-21 00:45:02,040: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T00:45:02.040645049Z [2024-03-21 00:45:02,040: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:45:02.140604437Z [2024-03-21 00:45:02,140: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:45:02.967132489Z [2024-03-21 00:45:02,966: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7b514969-7096-4787-b4c0-23e241f6f22b] succeeded in 1.6605623499999638s: None
2024-03-21T00:45:03.286940359Z [2024-03-21 00:45:03,286: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:45:03.291116194Z [2024-03-21 00:45:03,290: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:45:03.339595473Z [2024-03-21 00:45:03,337: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:45:03.339961320Z [2024-03-21 00:45:03,339: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:45:03.340428575Z [2024-03-21 00:45:03,340: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:45:03.340792182Z [2024-03-21 00:45:03,340: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:45:03.340933678Z [2024-03-21 00:45:03,340: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:45:03.341496156Z [2024-03-21 00:45:03,341: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:45:03.341707183Z [2024-03-21 00:45:03,341: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:45:03.486104498Z [2024-03-21 00:45:03,485: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:45:03.489736800Z [2024-03-21 00:45:03,489: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:45:03.511908894Z [2024-03-21 00:45:03,511: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:45:03.519170587Z [2024-03-21 00:45:03,518: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:45:03.527400882Z [2024-03-21 00:45:03,527: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:45:03.527664939Z [2024-03-21 00:45:03,527: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:45:03.527974489Z [2024-03-21 00:45:03,527: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:45:03.528278859Z [2024-03-21 00:45:03,527: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:45:03.529205233Z [2024-03-21 00:45:03,528: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:45:03.529619578Z [2024-03-21 00:45:03,529: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:45:03.599083528Z [2024-03-21 00:45:03,598: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:45:03.603024952Z [2024-03-21 00:45:03,602: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:45:03.637012050Z [2024-03-21 00:45:03,636: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:45:03.638746045Z [2024-03-21 00:45:03,638: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:45:03.640158920Z [2024-03-21 00:45:03,639: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:45:03.640361983Z [2024-03-21 00:45:03,640: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:45:03.640616222Z [2024-03-21 00:45:03,640: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:45:03.640746034Z [2024-03-21 00:45:03,640: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:45:03.641083246Z [2024-03-21 00:45:03,640: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:45:03.641230289Z [2024-03-21 00:45:03,641: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:45:03.766574968Z [2024-03-21 00:45:03,766: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T00:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:45:04.467580678Z [2024-03-21 00:45:04,467: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0f6b5762-5518-4818-aab6-84ed982352df] succeeded in 3.1697536089995992s: None
2024-03-21T00:45:05.346998791Z [2024-03-21 00:45:05,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5198b79b-1ad3-4e6e-92ec-43613c6ae04c] received
2024-03-21T00:45:05.354740563Z [2024-03-21 00:45:05,354: INFO/ForkPoolWorker-15] [5198b79b-1ad3-4e6e-92ec-43613c6ae04c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:45:05.655558358Z [2024-03-21 00:45:05,652: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:45:05.821995172Z [2024-03-21 00:45:05,821: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f0a13095-6707-496f-b57c-135f4070f8aa] succeeded in 4.518337060000704s: None
2024-03-21T00:45:06.169005771Z [2024-03-21 00:45:06,168: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[022b5e71-0186-403a-af74-669a86588be7] succeeded in 4.866679359000045s: None
2024-03-21T00:45:06.808549616Z [2024-03-21 00:45:06,808: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:45:06.812144919Z [2024-03-21 00:45:06,811: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:45:06.833984089Z [2024-03-21 00:45:06,833: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:45:06.835252219Z [2024-03-21 00:45:06,834: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:45:06.835308373Z [2024-03-21 00:45:06,835: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:45:06.835518198Z [2024-03-21 00:45:06,835: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:45:06.835652916Z [2024-03-21 00:45:06,835: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:45:06.835978335Z [2024-03-21 00:45:06,835: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:45:06.836105445Z [2024-03-21 00:45:06,835: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:45:06.916012344Z [2024-03-21 00:45:06,915: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T00:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:45:07.535849277Z [2024-03-21 00:45:07,535: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5198b79b-1ad3-4e6e-92ec-43613c6ae04c] succeeded in 2.185897291999936s: None
2024-03-21T00:45:07.746943426Z [2024-03-21 00:45:07,746: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7f5120b-563a-4dbd-a772-522f0fdb2879] received
2024-03-21T00:45:07.754060196Z [2024-03-21 00:45:07,753: INFO/ForkPoolWorker-15] [f7f5120b-563a-4dbd-a772-522f0fdb2879] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T00:45:08.050173106Z [2024-03-21 00:45:08,046: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:45:09.264787423Z [2024-03-21 00:45:09,264: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:45:09.268830722Z [2024-03-21 00:45:09,268: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:45:09.295051535Z [2024-03-21 00:45:09,294: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:45:09.298039171Z [2024-03-21 00:45:09,297: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:45:09.298112776Z [2024-03-21 00:45:09,297: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:45:09.298353512Z [2024-03-21 00:45:09,298: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:45:09.298416303Z [2024-03-21 00:45:09,298: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:45:09.298930357Z [2024-03-21 00:45:09,298: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:45:09.299051364Z [2024-03-21 00:45:09,298: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:45:09.456083869Z [2024-03-21 00:45:09,455: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T00:40:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:45:10.117140769Z [2024-03-21 00:45:10,116: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f7f5120b-563a-4dbd-a772-522f0fdb2879] succeeded in 2.36870162500054s: None
2024-03-21T00:45:10.342989138Z [2024-03-21 00:45:10,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66f3e78a-4237-4563-91b0-1d064ecdca0d] received
2024-03-21T00:45:10.349525304Z [2024-03-21 00:45:10,349: INFO/ForkPoolWorker-15] [66f3e78a-4237-4563-91b0-1d064ecdca0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:45:10.748663817Z [2024-03-21 00:45:10,745: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:45:12.013696689Z [2024-03-21 00:45:12,013: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:45:12.017266844Z [2024-03-21 00:45:12,016: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:45:12.038409779Z [2024-03-21 00:45:12,038: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:45:12.039966903Z [2024-03-21 00:45:12,039: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:45:12.039979333Z [2024-03-21 00:45:12,039: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:45:12.040129186Z [2024-03-21 00:45:12,039: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:45:12.040203472Z [2024-03-21 00:45:12,040: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:45:12.040523708Z [2024-03-21 00:45:12,040: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:45:12.040699847Z [2024-03-21 00:45:12,040: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:45:12.142035916Z [2024-03-21 00:45:12,141: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T00:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:45:12.790587027Z [2024-03-21 00:45:12,789: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[66f3e78a-4237-4563-91b0-1d064ecdca0d] succeeded in 2.445687444000214s: None
2024-03-21T00:46:01.148794922Z [2024-03-21 00:46:01,148: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[681f9caf-683c-4a4d-b41b-2d9ed94a7b3c] received
2024-03-21T00:46:01.157613565Z [2024-03-21 00:46:01,157: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3bc9c09b-079e-402a-8c6b-30e74ce83230] received
2024-03-21T00:46:01.170642958Z [2024-03-21 00:46:01,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bef36202-98d8-4e64-b082-29dccc677667] received
2024-03-21T00:46:01.170676362Z [2024-03-21 00:46:01,170: INFO/ForkPoolWorker-15] [681f9caf-683c-4a4d-b41b-2d9ed94a7b3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:46:01.172435032Z [2024-03-21 00:46:01,172: INFO/ForkPoolWorker-16] [3bc9c09b-079e-402a-8c6b-30e74ce83230] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:46:01.187891615Z [2024-03-21 00:46:01,187: INFO/ForkPoolWorker-1] [bef36202-98d8-4e64-b082-29dccc677667] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:46:01.193228404Z [2024-03-21 00:46:01,192: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c45c4897-92f0-47d7-9f85-6215543160d5] received
2024-03-21T00:46:01.201684157Z [2024-03-21 00:46:01,201: INFO/ForkPoolWorker-2] [c45c4897-92f0-47d7-9f85-6215543160d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:46:01.703768472Z [2024-03-21 00:46:01,698: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:46:01.713984091Z [2024-03-21 00:46:01,710: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:46:01.715409525Z [2024-03-21 00:46:01,709: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:46:01.763968189Z [2024-03-21 00:46:01,758: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:46:02.000844752Z [2024-03-21 00:46:02,000: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T00:46:02.006234206Z [2024-03-21 00:46:02,005: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:46:02.055074948Z [2024-03-21 00:46:02,054: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:46:02.066064892Z [2024-03-21 00:46:02,065: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:46:02.066422706Z [2024-03-21 00:46:02,065: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:46:02.066653414Z [2024-03-21 00:46:02,066: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T00:46:02.067343770Z [2024-03-21 00:46:02,066: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:46:02.203698157Z [2024-03-21 00:46:02,203: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:46:02.537480804Z [2024-03-21 00:46:02,537: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:46:03.474023933Z [2024-03-21 00:46:03,473: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3bc9c09b-079e-402a-8c6b-30e74ce83230] succeeded in 2.313248489000216s: None
2024-03-21T00:46:03.581757501Z [2024-03-21 00:46:03,581: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bef36202-98d8-4e64-b082-29dccc677667] succeeded in 2.4090555699995093s: None
2024-03-21T00:46:03.729288267Z [2024-03-21 00:46:03,728: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T00:46:03.732880543Z [2024-03-21 00:46:03,732: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:46:03.762704614Z [2024-03-21 00:46:03,762: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:46:03.765550487Z [2024-03-21 00:46:03,765: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:46:03.767076348Z [2024-03-21 00:46:03,766: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:46:03.767824503Z [2024-03-21 00:46:03,767: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:46:03.768407109Z [2024-03-21 00:46:03,767: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T00:46:03.769341194Z [2024-03-21 00:46:03,769: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:46:03.769680328Z [2024-03-21 00:46:03,769: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:46:03.819430308Z [2024-03-21 00:46:03,819: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:46:03.823061969Z [2024-03-21 00:46:03,822: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:46:03.846232701Z [2024-03-21 00:46:03,846: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:46:03.850075800Z [2024-03-21 00:46:03,849: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:46:03.850273033Z [2024-03-21 00:46:03,850: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:46:03.850606383Z [2024-03-21 00:46:03,850: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:46:03.850806269Z [2024-03-21 00:46:03,850: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:46:03.851786324Z [2024-03-21 00:46:03,851: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:46:03.851961377Z [2024-03-21 00:46:03,851: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:46:03.882381197Z [2024-03-21 00:46:03,882: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:46:03.947881084Z [2024-03-21 00:46:03,947: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:46:07.801658851Z [2024-03-21 00:46:07,801: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[681f9caf-683c-4a4d-b41b-2d9ed94a7b3c] succeeded in 6.64146213100048s: None
2024-03-21T00:46:08.261308710Z [2024-03-21 00:46:08,260: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c45c4897-92f0-47d7-9f85-6215543160d5] succeeded in 7.065464504000374s: None
2024-03-21T00:47:01.290321433Z [2024-03-21 00:47:01,289: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[734c3776-6142-4cc6-9836-fe9ac76610f0] received
2024-03-21T00:47:01.317041797Z [2024-03-21 00:47:01,316: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0decffe3-1723-496c-b5c8-7deb9c02a2e2] received
2024-03-21T00:47:01.353712715Z [2024-03-21 00:47:01,353: INFO/ForkPoolWorker-16] [0decffe3-1723-496c-b5c8-7deb9c02a2e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:47:01.362152303Z [2024-03-21 00:47:01,361: INFO/ForkPoolWorker-15] [734c3776-6142-4cc6-9836-fe9ac76610f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:47:01.381045116Z [2024-03-21 00:47:01,380: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90f8ce4d-ecba-47a9-b8f9-221c122df489] received
2024-03-21T00:47:01.433826101Z [2024-03-21 00:47:01,433: INFO/ForkPoolWorker-1] [90f8ce4d-ecba-47a9-b8f9-221c122df489] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:47:02.318988198Z [2024-03-21 00:47:02,307: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:47:02.584242977Z [2024-03-21 00:47:02,578: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:47:03.119705773Z [2024-03-21 00:47:03,102: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:47:03.625769576Z [2024-03-21 00:47:03,625: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T00:47:03.630382742Z [2024-03-21 00:47:03,629: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:47:03.664194811Z [2024-03-21 00:47:03,664: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:47:03.665381623Z [2024-03-21 00:47:03,665: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:47:03.665600687Z [2024-03-21 00:47:03,665: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:47:03.665728031Z [2024-03-21 00:47:03,665: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T00:47:03.665984271Z [2024-03-21 00:47:03,665: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:47:03.827503469Z [2024-03-21 00:47:03,827: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:47:04.726235544Z [2024-03-21 00:47:04,725: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[734c3776-6142-4cc6-9836-fe9ac76610f0] succeeded in 3.42039313999976s: None
2024-03-21T00:47:05.287489342Z [2024-03-21 00:47:05,287: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:47:05.290941475Z [2024-03-21 00:47:05,290: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:47:05.329441897Z [2024-03-21 00:47:05,329: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:47:05.335227426Z [2024-03-21 00:47:05,334: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:47:05.341196695Z [2024-03-21 00:47:05,340: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:47:05.342572459Z [2024-03-21 00:47:05,342: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:47:05.342991050Z [2024-03-21 00:47:05,342: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:47:05.343413944Z [2024-03-21 00:47:05,343: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:47:05.343783525Z [2024-03-21 00:47:05,343: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:47:05.344174867Z [2024-03-21 00:47:05,344: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:47:05.344378763Z [2024-03-21 00:47:05,344: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:47:05.425097621Z [2024-03-21 00:47:05,424: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:47:05.426733820Z [2024-03-21 00:47:05,426: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:47:05.426849645Z [2024-03-21 00:47:05,426: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:47:05.427186300Z [2024-03-21 00:47:05,426: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:47:05.427362646Z [2024-03-21 00:47:05,427: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:47:05.427786484Z [2024-03-21 00:47:05,427: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:47:05.428008512Z [2024-03-21 00:47:05,427: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:47:05.497276547Z [2024-03-21 00:47:05,497: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:47:05.573340660Z [2024-03-21 00:47:05,573: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:47:08.975086444Z [2024-03-21 00:47:08,974: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[90f8ce4d-ecba-47a9-b8f9-221c122df489] succeeded in 7.586584333000246s: None
2024-03-21T00:47:10.039064052Z [2024-03-21 00:47:10,038: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0decffe3-1723-496c-b5c8-7deb9c02a2e2] succeeded in 8.718790632999116s: None
2024-03-21T00:48:00.466407479Z [2024-03-21 00:48:00,465: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a39f7cce-5602-42ba-bd58-e255df8b5709] received
2024-03-21T00:48:00.469816607Z [2024-03-21 00:48:00,469: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aafee33a-2366-4b0f-8315-90339ad508c5] received
2024-03-21T00:48:00.477848984Z [2024-03-21 00:48:00,477: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd6908e9-8cfa-43d9-a090-c6abfbfc8f7f] received
2024-03-21T00:48:00.480740780Z [2024-03-21 00:48:00,480: INFO/ForkPoolWorker-16] [aafee33a-2366-4b0f-8315-90339ad508c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:48:00.481630474Z [2024-03-21 00:48:00,481: INFO/ForkPoolWorker-15] [a39f7cce-5602-42ba-bd58-e255df8b5709] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:48:00.483087454Z [2024-03-21 00:48:00,482: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6308cc40-a118-450d-81b8-2a1c304e8fdc] received
2024-03-21T00:48:00.488983490Z [2024-03-21 00:48:00,488: INFO/ForkPoolWorker-1] [cd6908e9-8cfa-43d9-a090-c6abfbfc8f7f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:48:00.493042376Z [2024-03-21 00:48:00,492: INFO/ForkPoolWorker-2] [6308cc40-a118-450d-81b8-2a1c304e8fdc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:48:00.789377253Z [2024-03-21 00:48:00,785: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:48:00.830331681Z [2024-03-21 00:48:00,826: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:48:00.897332760Z [2024-03-21 00:48:00,888: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:48:00.948367488Z [2024-03-21 00:48:00,942: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:48:01.046410346Z [2024-03-21 00:48:01,045: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T00:48:01.051698283Z [2024-03-21 00:48:01,051: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:48:01.075707339Z [2024-03-21 00:48:01,075: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:48:01.098218782Z [2024-03-21 00:48:01,097: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:48:01.102054961Z [2024-03-21 00:48:01,101: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:48:01.102151162Z [2024-03-21 00:48:01,101: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:48:01.102223351Z [2024-03-21 00:48:01,102: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T00:48:01.102456420Z [2024-03-21 00:48:01,102: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:48:01.232419970Z [2024-03-21 00:48:01,232: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:48:01.893656232Z [2024-03-21 00:48:01,893: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a39f7cce-5602-42ba-bd58-e255df8b5709] succeeded in 1.4221451690000322s: None
2024-03-21T00:48:02.004607263Z [2024-03-21 00:48:02,004: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aafee33a-2366-4b0f-8315-90339ad508c5] succeeded in 1.5312232850001237s: None
2024-03-21T00:48:02.887288160Z [2024-03-21 00:48:02,886: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:48:02.899587569Z [2024-03-21 00:48:02,898: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:48:02.928041366Z [2024-03-21 00:48:02,927: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:48:02.930308530Z [2024-03-21 00:48:02,929: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:48:02.930673655Z [2024-03-21 00:48:02,930: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:48:02.931050261Z [2024-03-21 00:48:02,930: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:48:02.931243610Z [2024-03-21 00:48:02,931: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:48:02.931774647Z [2024-03-21 00:48:02,931: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:48:02.932053253Z [2024-03-21 00:48:02,931: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:48:02.962888064Z [2024-03-21 00:48:02,962: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T00:48:02.967358794Z [2024-03-21 00:48:02,966: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:48:02.990600503Z [2024-03-21 00:48:02,990: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:48:02.993294861Z [2024-03-21 00:48:02,992: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:48:02.993313526Z [2024-03-21 00:48:02,993: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:48:02.993483569Z [2024-03-21 00:48:02,993: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:48:02.993513406Z [2024-03-21 00:48:02,993: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T00:48:02.993768348Z [2024-03-21 00:48:02,993: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:48:02.993792263Z [2024-03-21 00:48:02,993: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:48:03.044442069Z [2024-03-21 00:48:03,044: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:48:03.156016761Z [2024-03-21 00:48:03,155: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:48:04.715532634Z [2024-03-21 00:48:04,712: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6308cc40-a118-450d-81b8-2a1c304e8fdc] succeeded in 4.227475312999559s: None
2024-03-21T00:48:04.866778975Z [2024-03-21 00:48:04,866: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cd6908e9-8cfa-43d9-a090-c6abfbfc8f7f] succeeded in 4.385044497999843s: None
2024-03-21T00:49:00.727300214Z [2024-03-21 00:49:00,726: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7540853-4d0e-437f-a192-0897003623fa] received
2024-03-21T00:49:00.730815822Z [2024-03-21 00:49:00,730: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ac4daa1-6d47-43f3-a5c0-a7731788ad5a] received
2024-03-21T00:49:00.734442383Z [2024-03-21 00:49:00,734: INFO/ForkPoolWorker-15] [c7540853-4d0e-437f-a192-0897003623fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:49:00.744104966Z [2024-03-21 00:49:00,743: INFO/ForkPoolWorker-16] [0ac4daa1-6d47-43f3-a5c0-a7731788ad5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:49:00.755642109Z [2024-03-21 00:49:00,755: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91490b78-8584-4c7a-aed3-71654de8fe1d] received
2024-03-21T00:49:00.779393924Z [2024-03-21 00:49:00,779: INFO/ForkPoolWorker-1] [91490b78-8584-4c7a-aed3-71654de8fe1d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:49:01.051740638Z [2024-03-21 00:49:01,048: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:49:01.120737202Z [2024-03-21 00:49:01,117: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:49:01.121599427Z [2024-03-21 00:49:01,117: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:49:01.224379719Z [2024-03-21 00:49:01,223: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T00:49:01.228398564Z [2024-03-21 00:49:01,227: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:49:01.252365162Z [2024-03-21 00:49:01,252: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:49:01.254335774Z [2024-03-21 00:49:01,254: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:49:01.254750414Z [2024-03-21 00:49:01,254: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:49:01.254991873Z [2024-03-21 00:49:01,254: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T00:49:01.255572735Z [2024-03-21 00:49:01,255: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:49:01.368425256Z [2024-03-21 00:49:01,368: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:49:02.064508431Z [2024-03-21 00:49:02,063: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0ac4daa1-6d47-43f3-a5c0-a7731788ad5a] succeeded in 1.3318046039994442s: None
2024-03-21T00:49:02.695637957Z [2024-03-21 00:49:02,695: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:49:02.699342892Z [2024-03-21 00:49:02,698: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:49:02.726225439Z [2024-03-21 00:49:02,725: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:49:02.728295387Z [2024-03-21 00:49:02,727: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:49:02.728557974Z [2024-03-21 00:49:02,728: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:49:02.728683578Z [2024-03-21 00:49:02,728: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:49:02.728724343Z [2024-03-21 00:49:02,728: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:49:02.729065662Z [2024-03-21 00:49:02,728: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:49:02.729085417Z [2024-03-21 00:49:02,728: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:49:02.733349264Z [2024-03-21 00:49:02,732: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:49:02.738301271Z [2024-03-21 00:49:02,737: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:49:02.769026497Z [2024-03-21 00:49:02,768: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:49:02.770851459Z [2024-03-21 00:49:02,770: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:49:02.770902617Z [2024-03-21 00:49:02,770: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:49:02.771175075Z [2024-03-21 00:49:02,770: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:49:02.771193507Z [2024-03-21 00:49:02,771: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:49:02.771892355Z [2024-03-21 00:49:02,771: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:49:02.772080101Z [2024-03-21 00:49:02,771: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:49:02.854122076Z [2024-03-21 00:49:02,853: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:49:02.912012119Z [2024-03-21 00:49:02,911: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:49:04.484009156Z [2024-03-21 00:49:04,483: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[91490b78-8584-4c7a-aed3-71654de8fe1d] succeeded in 3.72359383300045s: None
2024-03-21T00:49:04.722550486Z [2024-03-21 00:49:04,721: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c7540853-4d0e-437f-a192-0897003623fa] succeeded in 3.9930268930002057s: None
2024-03-21T00:50:01.309192765Z [2024-03-21 00:50:01,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c829866-45ef-4cf2-ba37-27c559267ff5] received
2024-03-21T00:50:01.317841221Z [2024-03-21 00:50:01,317: INFO/ForkPoolWorker-15] [0c829866-45ef-4cf2-ba37-27c559267ff5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:50:01.323414137Z [2024-03-21 00:50:01,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c590db9-edff-497b-b1c3-7e56bcf7f7fb] received
2024-03-21T00:50:01.326055823Z [2024-03-21 00:50:01,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b8a6561-b077-425d-8352-0ea13348ebdd] received
2024-03-21T00:50:01.329500692Z [2024-03-21 00:50:01,329: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e18d0ccc-c2cd-4845-83de-49cba4671120] received
2024-03-21T00:50:01.332740055Z [2024-03-21 00:50:01,332: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[087c476f-182f-4775-9020-31cbe71273a9] received
2024-03-21T00:50:01.340853315Z [2024-03-21 00:50:01,340: INFO/ForkPoolWorker-16] [6c590db9-edff-497b-b1c3-7e56bcf7f7fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:50:01.360667718Z [2024-03-21 00:50:01,357: INFO/ForkPoolWorker-2] [e18d0ccc-c2cd-4845-83de-49cba4671120] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:50:01.367087802Z [2024-03-21 00:50:01,366: INFO/ForkPoolWorker-1] [4b8a6561-b077-425d-8352-0ea13348ebdd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:50:01.387710586Z [2024-03-21 00:50:01,387: INFO/ForkPoolWorker-3] [087c476f-182f-4775-9020-31cbe71273a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:50:01.716419966Z [2024-03-21 00:50:01,712: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:50:01.815910065Z [2024-03-21 00:50:01,812: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:50:02.059361533Z [2024-03-21 00:50:02,049: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:50:02.098804615Z [2024-03-21 00:50:02,095: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:50:02.106703815Z [2024-03-21 00:50:02,101: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:50:02.139238217Z [2024-03-21 00:50:02,138: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:50:02.485140904Z [2024-03-21 00:50:02,479: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T00:50:02.499682055Z [2024-03-21 00:50:02,499: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:50:02.548779135Z [2024-03-21 00:50:02,548: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:50:02.549952728Z [2024-03-21 00:50:02,549: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:50:02.550037759Z [2024-03-21 00:50:02,549: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:50:02.550064296Z [2024-03-21 00:50:02,549: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T00:50:02.550665763Z [2024-03-21 00:50:02,550: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:50:02.685091311Z [2024-03-21 00:50:02,684: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:50:03.252647764Z [2024-03-21 00:50:03,252: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6c590db9-edff-497b-b1c3-7e56bcf7f7fb] succeeded in 1.9273016110000754s: None
2024-03-21T00:50:03.525993663Z [2024-03-21 00:50:03,525: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e18d0ccc-c2cd-4845-83de-49cba4671120] succeeded in 2.1921330349996424s: None
2024-03-21T00:50:03.854718386Z [2024-03-21 00:50:03,854: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:50:03.858464972Z [2024-03-21 00:50:03,857: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:50:03.870435290Z [2024-03-21 00:50:03,869: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:50:03.874391970Z [2024-03-21 00:50:03,873: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:50:03.884247636Z [2024-03-21 00:50:03,883: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:50:03.886528741Z [2024-03-21 00:50:03,886: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:50:03.886569344Z [2024-03-21 00:50:03,886: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:50:03.886791035Z [2024-03-21 00:50:03,886: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:50:03.886838725Z [2024-03-21 00:50:03,886: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:50:03.887200914Z [2024-03-21 00:50:03,887: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:50:03.887220059Z [2024-03-21 00:50:03,887: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:50:03.895357768Z [2024-03-21 00:50:03,895: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:50:03.896872553Z [2024-03-21 00:50:03,896: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:50:03.896887404Z [2024-03-21 00:50:03,896: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:50:03.897013990Z [2024-03-21 00:50:03,896: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:50:03.897044543Z [2024-03-21 00:50:03,896: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:50:03.897269780Z [2024-03-21 00:50:03,897: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:50:03.897300149Z [2024-03-21 00:50:03,897: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:50:03.973588573Z [2024-03-21 00:50:03,973: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T00:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:50:03.979065317Z [2024-03-21 00:50:03,978: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:50:04.242319561Z [2024-03-21 00:50:04,241: INFO/ForkPoolWorker-3] Getting VIM list
2024-03-21T00:50:04.246119522Z [2024-03-21 00:50:04,245: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:50:04.272784323Z [2024-03-21 00:50:04,272: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-21T00:50:04.274591299Z [2024-03-21 00:50:04,274: INFO/ForkPoolWorker-3] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:50:04.275266211Z [2024-03-21 00:50:04,275: INFO/ForkPoolWorker-3] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:50:04.275463602Z [2024-03-21 00:50:04,275: INFO/ForkPoolWorker-3] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:50:04.275552480Z [2024-03-21 00:50:04,275: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-03-21T00:50:04.275958815Z [2024-03-21 00:50:04,275: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:50:04.276086462Z [2024-03-21 00:50:04,275: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:50:04.411235328Z [2024-03-21 00:50:04,409: INFO/ForkPoolWorker-3] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:50:04.534156370Z [2024-03-21 00:50:04,533: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8df2c619-4979-47c6-b8a2-db1f95436373] received
2024-03-21T00:50:04.561903649Z [2024-03-21 00:50:04,561: INFO/ForkPoolWorker-16] [8df2c619-4979-47c6-b8a2-db1f95436373] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:50:04.596280604Z [2024-03-21 00:50:04,595: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0c829866-45ef-4cf2-ba37-27c559267ff5] succeeded in 3.2854679420006505s: None
2024-03-21T00:50:04.944769775Z [2024-03-21 00:50:04,939: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:50:05.649110535Z [2024-03-21 00:50:05,648: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4b8a6561-b077-425d-8352-0ea13348ebdd] succeeded in 4.3202921520005475s: None
2024-03-21T00:50:06.292524142Z [2024-03-21 00:50:06,292: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:50:06.296617079Z [2024-03-21 00:50:06,296: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:50:06.318570544Z [2024-03-21 00:50:06,318: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:50:06.320206899Z [2024-03-21 00:50:06,319: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:50:06.320298076Z [2024-03-21 00:50:06,320: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:50:06.320524512Z [2024-03-21 00:50:06,320: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:50:06.320601869Z [2024-03-21 00:50:06,320: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:50:06.320931364Z [2024-03-21 00:50:06,320: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:50:06.321052907Z [2024-03-21 00:50:06,320: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:50:06.412024346Z [2024-03-21 00:50:06,411: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T00:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:50:06.813773893Z [2024-03-21 00:50:06,813: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[087c476f-182f-4775-9020-31cbe71273a9] succeeded in 5.473773734999668s: None
2024-03-21T00:50:07.148142781Z [2024-03-21 00:50:07,147: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8df2c619-4979-47c6-b8a2-db1f95436373] succeeded in 2.6120238050007174s: None
2024-03-21T00:50:08.150204899Z [2024-03-21 00:50:08,148: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1949fd3e-fc66-44a6-b116-2dfdb73dcc06] received
2024-03-21T00:50:08.170198728Z [2024-03-21 00:50:08,159: INFO/ForkPoolWorker-15] [1949fd3e-fc66-44a6-b116-2dfdb73dcc06] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T00:50:08.639796827Z [2024-03-21 00:50:08,632: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:50:10.138966543Z [2024-03-21 00:50:10,138: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:50:10.142584202Z [2024-03-21 00:50:10,142: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:50:10.165245003Z [2024-03-21 00:50:10,164: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:50:10.169490336Z [2024-03-21 00:50:10,169: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:50:10.169515205Z [2024-03-21 00:50:10,169: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:50:10.169747846Z [2024-03-21 00:50:10,169: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:50:10.169797166Z [2024-03-21 00:50:10,169: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:50:10.170132533Z [2024-03-21 00:50:10,169: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:50:10.170196659Z [2024-03-21 00:50:10,170: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:50:10.271590119Z [2024-03-21 00:50:10,271: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T00:45:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:50:10.837136550Z [2024-03-21 00:50:10,836: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1949fd3e-fc66-44a6-b116-2dfdb73dcc06] succeeded in 2.6840250019995437s: None
2024-03-21T00:50:11.716216882Z [2024-03-21 00:50:11,715: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[992f6491-469c-49cb-87b8-7bf5e4f6190f] received
2024-03-21T00:50:11.723300197Z [2024-03-21 00:50:11,723: INFO/ForkPoolWorker-15] [992f6491-469c-49cb-87b8-7bf5e4f6190f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:50:12.038335813Z [2024-03-21 00:50:12,034: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:50:13.470059497Z [2024-03-21 00:50:13,469: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:50:13.473625973Z [2024-03-21 00:50:13,473: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:50:13.503082088Z [2024-03-21 00:50:13,502: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:50:13.504626445Z [2024-03-21 00:50:13,504: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:50:13.504718233Z [2024-03-21 00:50:13,504: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:50:13.504935599Z [2024-03-21 00:50:13,504: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:50:13.505109333Z [2024-03-21 00:50:13,504: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:50:13.505404973Z [2024-03-21 00:50:13,505: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:50:13.505528419Z [2024-03-21 00:50:13,505: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:50:13.592227746Z [2024-03-21 00:50:13,591: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T00:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:50:14.218702517Z [2024-03-21 00:50:14,218: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[992f6491-469c-49cb-87b8-7bf5e4f6190f] succeeded in 2.499928228000499s: None
2024-03-21T00:51:01.199611027Z [2024-03-21 00:51:01,198: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67df2f55-0808-46af-8a6f-ff83b38b7f77] received
2024-03-21T00:51:01.202071018Z [2024-03-21 00:51:01,201: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27e8928b-7c1c-484b-b395-ddccae888eb2] received
2024-03-21T00:51:01.204754864Z [2024-03-21 00:51:01,204: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[229f89e6-9bcc-48f3-8229-45199a9a4263] received
2024-03-21T00:51:01.213392738Z [2024-03-21 00:51:01,213: INFO/ForkPoolWorker-16] [27e8928b-7c1c-484b-b395-ddccae888eb2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:51:01.221150261Z [2024-03-21 00:51:01,220: INFO/ForkPoolWorker-1] [229f89e6-9bcc-48f3-8229-45199a9a4263] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:51:01.231071043Z [2024-03-21 00:51:01,230: INFO/ForkPoolWorker-15] [67df2f55-0808-46af-8a6f-ff83b38b7f77] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:51:01.597137473Z [2024-03-21 00:51:01,593: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:51:01.654573395Z [2024-03-21 00:51:01,651: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:51:01.657367759Z [2024-03-21 00:51:01,653: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:51:01.784646776Z [2024-03-21 00:51:01,783: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T00:51:01.788694691Z [2024-03-21 00:51:01,788: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:51:01.814663427Z [2024-03-21 00:51:01,813: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:51:01.816525506Z [2024-03-21 00:51:01,816: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:51:01.816769792Z [2024-03-21 00:51:01,816: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:51:01.817016929Z [2024-03-21 00:51:01,816: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T00:51:01.817623637Z [2024-03-21 00:51:01,817: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:51:01.944205227Z [2024-03-21 00:51:01,943: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:51:02.738291159Z [2024-03-21 00:51:02,737: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[27e8928b-7c1c-484b-b395-ddccae888eb2] succeeded in 1.532299408999279s: None
2024-03-21T00:51:03.120079022Z [2024-03-21 00:51:03,119: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:51:03.123614756Z [2024-03-21 00:51:03,123: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:51:03.158148138Z [2024-03-21 00:51:03,157: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:51:03.159594768Z [2024-03-21 00:51:03,159: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:51:03.159722958Z [2024-03-21 00:51:03,159: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:51:03.159919147Z [2024-03-21 00:51:03,159: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:51:03.160047692Z [2024-03-21 00:51:03,159: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:51:03.160412459Z [2024-03-21 00:51:03,160: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:51:03.160594891Z [2024-03-21 00:51:03,160: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:51:03.190045304Z [2024-03-21 00:51:03,189: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:51:03.196479070Z [2024-03-21 00:51:03,195: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:51:03.234077011Z [2024-03-21 00:51:03,233: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:51:03.236135482Z [2024-03-21 00:51:03,235: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:51:03.236266768Z [2024-03-21 00:51:03,236: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:51:03.236631598Z [2024-03-21 00:51:03,236: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:51:03.236809598Z [2024-03-21 00:51:03,236: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:51:03.237222221Z [2024-03-21 00:51:03,237: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:51:03.237369433Z [2024-03-21 00:51:03,237: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:51:03.267289458Z [2024-03-21 00:51:03,267: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:51:03.340761095Z [2024-03-21 00:51:03,340: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:51:05.126251628Z [2024-03-21 00:51:05,125: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[229f89e6-9bcc-48f3-8229-45199a9a4263] succeeded in 3.9196844009993583s: None
2024-03-21T00:51:05.488246103Z [2024-03-21 00:51:05,487: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[67df2f55-0808-46af-8a6f-ff83b38b7f77] succeeded in 4.280664016000628s: None
2024-03-21T00:52:01.031443902Z [2024-03-21 00:52:01,031: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d2ba5d7-dc9d-467b-88b3-354be1318c0e] received
2024-03-21T00:52:01.038202877Z [2024-03-21 00:52:01,037: INFO/ForkPoolWorker-15] [5d2ba5d7-dc9d-467b-88b3-354be1318c0e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:52:01.044802937Z [2024-03-21 00:52:01,044: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94d35a80-33af-4ade-88f9-5f56154bae2d] received
2024-03-21T00:52:01.047922219Z [2024-03-21 00:52:01,047: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5bd52d8c-9dc9-4eb3-9a80-f6810b420849] received
2024-03-21T00:52:01.055549920Z [2024-03-21 00:52:01,055: INFO/ForkPoolWorker-1] [5bd52d8c-9dc9-4eb3-9a80-f6810b420849] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:52:01.056157775Z [2024-03-21 00:52:01,055: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e393542-0c5c-449e-a4bd-d35395198755] received
2024-03-21T00:52:01.062057346Z [2024-03-21 00:52:01,061: INFO/ForkPoolWorker-16] [94d35a80-33af-4ade-88f9-5f56154bae2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:52:01.063175710Z [2024-03-21 00:52:01,062: INFO/ForkPoolWorker-2] [2e393542-0c5c-449e-a4bd-d35395198755] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:52:01.374345136Z [2024-03-21 00:52:01,370: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:52:01.413854310Z [2024-03-21 00:52:01,405: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:52:01.424102688Z [2024-03-21 00:52:01,420: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:52:01.470068529Z [2024-03-21 00:52:01,467: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:52:01.595893662Z [2024-03-21 00:52:01,595: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T00:52:01.609090391Z [2024-03-21 00:52:01,608: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:52:01.642175487Z [2024-03-21 00:52:01,641: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:52:01.644046648Z [2024-03-21 00:52:01,643: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:52:01.644274570Z [2024-03-21 00:52:01,643: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:52:01.644485867Z [2024-03-21 00:52:01,644: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T00:52:01.644811737Z [2024-03-21 00:52:01,644: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:52:01.745088218Z [2024-03-21 00:52:01,744: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:52:01.793286661Z [2024-03-21 00:52:01,792: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:52:02.722565460Z [2024-03-21 00:52:02,721: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[94d35a80-33af-4ade-88f9-5f56154bae2d] succeeded in 1.6736673710001924s: None
2024-03-21T00:52:02.739731342Z [2024-03-21 00:52:02,739: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5d2ba5d7-dc9d-467b-88b3-354be1318c0e] succeeded in 1.706401864000327s: None
2024-03-21T00:52:03.131766094Z [2024-03-21 00:52:03,131: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:52:03.132987774Z [2024-03-21 00:52:03,132: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T00:52:03.135516834Z [2024-03-21 00:52:03,134: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:52:03.136465719Z [2024-03-21 00:52:03,136: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:52:03.157445969Z [2024-03-21 00:52:03,157: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:52:03.159300901Z [2024-03-21 00:52:03,159: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:52:03.159373283Z [2024-03-21 00:52:03,159: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:52:03.159562462Z [2024-03-21 00:52:03,159: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:52:03.159622859Z [2024-03-21 00:52:03,159: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:52:03.159932781Z [2024-03-21 00:52:03,159: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:52:03.159990824Z [2024-03-21 00:52:03,159: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:52:03.160807439Z [2024-03-21 00:52:03,160: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:52:03.162572147Z [2024-03-21 00:52:03,162: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:52:03.162662012Z [2024-03-21 00:52:03,162: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:52:03.162896844Z [2024-03-21 00:52:03,162: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:52:03.163005661Z [2024-03-21 00:52:03,162: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T00:52:03.163452382Z [2024-03-21 00:52:03,163: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:52:03.163535133Z [2024-03-21 00:52:03,163: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:52:03.240983954Z [2024-03-21 00:52:03,240: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:52:03.285145837Z [2024-03-21 00:52:03,284: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:52:05.675491167Z [2024-03-21 00:52:05,675: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2e393542-0c5c-449e-a4bd-d35395198755] succeeded in 4.617544049999196s: None
2024-03-21T00:52:05.984544040Z [2024-03-21 00:52:05,983: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5bd52d8c-9dc9-4eb3-9a80-f6810b420849] succeeded in 4.934843869999895s: None
2024-03-21T00:53:00.541924871Z [2024-03-21 00:53:00,541: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f8b7273-5405-45ee-8a6f-055784188ee2] received
2024-03-21T00:53:00.543843927Z [2024-03-21 00:53:00,543: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c728ac6f-abb0-4ece-9019-dc8cdd7fce01] received
2024-03-21T00:53:00.551847487Z [2024-03-21 00:53:00,551: INFO/ForkPoolWorker-15] [6f8b7273-5405-45ee-8a6f-055784188ee2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:53:00.552117609Z [2024-03-21 00:53:00,551: INFO/ForkPoolWorker-16] [c728ac6f-abb0-4ece-9019-dc8cdd7fce01] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:53:00.553408414Z [2024-03-21 00:53:00,553: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6e8625e-b582-41ac-a958-1dbcaeed8b86] received
2024-03-21T00:53:00.561523901Z [2024-03-21 00:53:00,561: INFO/ForkPoolWorker-1] [d6e8625e-b582-41ac-a958-1dbcaeed8b86] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:53:00.833003631Z [2024-03-21 00:53:00,829: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:53:00.858275179Z [2024-03-21 00:53:00,854: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:53:00.905179192Z [2024-03-21 00:53:00,901: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:53:00.990235729Z [2024-03-21 00:53:00,989: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T00:53:00.994194101Z [2024-03-21 00:53:00,993: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:53:01.027129926Z [2024-03-21 00:53:01,026: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:53:01.028377391Z [2024-03-21 00:53:01,028: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:53:01.028567127Z [2024-03-21 00:53:01,028: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:53:01.028676854Z [2024-03-21 00:53:01,028: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T00:53:01.028964156Z [2024-03-21 00:53:01,028: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:53:01.129500624Z [2024-03-21 00:53:01,129: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:53:01.902784713Z [2024-03-21 00:53:01,902: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6f8b7273-5405-45ee-8a6f-055784188ee2] succeeded in 1.3591069249996508s: None
2024-03-21T00:53:02.146359060Z [2024-03-21 00:53:02,145: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:53:02.151420178Z [2024-03-21 00:53:02,150: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:53:02.182557736Z [2024-03-21 00:53:02,182: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:53:02.184794936Z [2024-03-21 00:53:02,184: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:53:02.184935382Z [2024-03-21 00:53:02,184: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:53:02.185208321Z [2024-03-21 00:53:02,184: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:53:02.185309449Z [2024-03-21 00:53:02,185: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:53:02.185773601Z [2024-03-21 00:53:02,185: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:53:02.185974975Z [2024-03-21 00:53:02,185: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:53:02.198449707Z [2024-03-21 00:53:02,198: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:53:02.202234878Z [2024-03-21 00:53:02,201: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:53:02.232151169Z [2024-03-21 00:53:02,231: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:53:02.234817555Z [2024-03-21 00:53:02,234: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:53:02.234838072Z [2024-03-21 00:53:02,234: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:53:02.240488096Z [2024-03-21 00:53:02,234: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:53:02.240522865Z [2024-03-21 00:53:02,235: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:53:02.240529531Z [2024-03-21 00:53:02,236: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:53:02.240534271Z [2024-03-21 00:53:02,236: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:53:02.349011694Z [2024-03-21 00:53:02,348: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:53:02.460715977Z [2024-03-21 00:53:02,460: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:53:04.017289745Z [2024-03-21 00:53:04,016: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c728ac6f-abb0-4ece-9019-dc8cdd7fce01] succeeded in 3.4709365019998586s: None
2024-03-21T00:53:04.450085968Z [2024-03-21 00:53:04,449: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d6e8625e-b582-41ac-a958-1dbcaeed8b86] succeeded in 3.8949985749995903s: None
2024-03-21T00:54:00.819211304Z [2024-03-21 00:54:00,818: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16c97a76-37be-45d3-8b12-dd22828b3b6a] received
2024-03-21T00:54:00.822736141Z [2024-03-21 00:54:00,822: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b39869c4-0e7e-4f6f-8814-cb7f5a250096] received
2024-03-21T00:54:00.826367727Z [2024-03-21 00:54:00,826: INFO/ForkPoolWorker-15] [16c97a76-37be-45d3-8b12-dd22828b3b6a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:54:00.829855003Z [2024-03-21 00:54:00,829: INFO/ForkPoolWorker-16] [b39869c4-0e7e-4f6f-8814-cb7f5a250096] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:54:00.838255601Z [2024-03-21 00:54:00,838: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05d7fc62-759a-450c-a9ea-a13ce931c1af] received
2024-03-21T00:54:00.842074706Z [2024-03-21 00:54:00,841: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e3fbb18-56fc-4535-81b6-5a2b097f3a42] received
2024-03-21T00:54:00.865022638Z [2024-03-21 00:54:00,864: INFO/ForkPoolWorker-2] [2e3fbb18-56fc-4535-81b6-5a2b097f3a42] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:54:00.865300329Z [2024-03-21 00:54:00,865: INFO/ForkPoolWorker-1] [05d7fc62-759a-450c-a9ea-a13ce931c1af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:54:01.159981699Z [2024-03-21 00:54:01,156: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:54:01.238558883Z [2024-03-21 00:54:01,234: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:54:01.304584690Z [2024-03-21 00:54:01,301: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:54:01.341957749Z [2024-03-21 00:54:01,337: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:54:01.461151278Z [2024-03-21 00:54:01,460: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T00:54:01.469719977Z [2024-03-21 00:54:01,469: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:54:01.523725360Z [2024-03-21 00:54:01,523: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:54:01.528019537Z [2024-03-21 00:54:01,527: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:54:01.528450962Z [2024-03-21 00:54:01,528: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:54:01.528726401Z [2024-03-21 00:54:01,528: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T00:54:01.529138822Z [2024-03-21 00:54:01,528: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:54:01.695001291Z [2024-03-21 00:54:01,694: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:54:02.039672608Z [2024-03-21 00:54:02,039: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:54:02.937330507Z [2024-03-21 00:54:02,936: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b39869c4-0e7e-4f6f-8814-cb7f5a250096] succeeded in 2.1129314159998103s: None
2024-03-21T00:54:03.087194587Z [2024-03-21 00:54:03,086: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:54:03.091121141Z [2024-03-21 00:54:03,090: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:54:03.122775546Z [2024-03-21 00:54:03,122: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:54:03.124421496Z [2024-03-21 00:54:03,124: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:54:03.124559936Z [2024-03-21 00:54:03,124: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:54:03.124861060Z [2024-03-21 00:54:03,124: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:54:03.125053386Z [2024-03-21 00:54:03,124: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:54:03.125448576Z [2024-03-21 00:54:03,125: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:54:03.125675679Z [2024-03-21 00:54:03,125: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:54:03.219385661Z [2024-03-21 00:54:03,219: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:54:03.332449846Z [2024-03-21 00:54:03,331: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[16c97a76-37be-45d3-8b12-dd22828b3b6a] succeeded in 2.511338651999722s: None
2024-03-21T00:54:03.721858392Z [2024-03-21 00:54:03,721: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T00:54:03.726257215Z [2024-03-21 00:54:03,725: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:54:03.759727671Z [2024-03-21 00:54:03,759: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:54:03.760947631Z [2024-03-21 00:54:03,760: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:54:03.760980135Z [2024-03-21 00:54:03,760: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:54:03.761180326Z [2024-03-21 00:54:03,760: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:54:03.761214717Z [2024-03-21 00:54:03,761: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T00:54:03.761521071Z [2024-03-21 00:54:03,761: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:54:03.761690236Z [2024-03-21 00:54:03,761: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:54:03.863181643Z [2024-03-21 00:54:03,862: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:54:05.358901902Z [2024-03-21 00:54:05,358: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[05d7fc62-759a-450c-a9ea-a13ce931c1af] succeeded in 4.515589137000461s: None
2024-03-21T00:54:05.890739715Z [2024-03-21 00:54:05,890: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2e3fbb18-56fc-4535-81b6-5a2b097f3a42] succeeded in 5.045168356999966s: None
2024-03-21T00:55:01.096190634Z [2024-03-21 00:55:01,095: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edd034f8-14b5-4ec5-9976-bc27abee4b29] received
2024-03-21T00:55:01.102570800Z [2024-03-21 00:55:01,102: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[40347898-0b7e-42e5-8901-04af7c766c50] received
2024-03-21T00:55:01.104574956Z [2024-03-21 00:55:01,104: INFO/ForkPoolWorker-15] [edd034f8-14b5-4ec5-9976-bc27abee4b29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:55:01.106371943Z [2024-03-21 00:55:01,106: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2369d917-cf45-4ec3-b956-d850e814263d] received
2024-03-21T00:55:01.114640059Z [2024-03-21 00:55:01,114: INFO/ForkPoolWorker-16] [40347898-0b7e-42e5-8901-04af7c766c50] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:55:01.118351924Z [2024-03-21 00:55:01,118: INFO/ForkPoolWorker-1] [2369d917-cf45-4ec3-b956-d850e814263d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:55:01.128877034Z [2024-03-21 00:55:01,128: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c663f84-1cbf-423c-9951-ff56e80dec9d] received
2024-03-21T00:55:01.137266395Z [2024-03-21 00:55:01,136: INFO/ForkPoolWorker-2] [8c663f84-1cbf-423c-9951-ff56e80dec9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:55:01.510603718Z [2024-03-21 00:55:01,502: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:55:01.645635614Z [2024-03-21 00:55:01,642: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:55:01.679148753Z [2024-03-21 00:55:01,675: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:55:01.711469739Z [2024-03-21 00:55:01,683: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:55:01.877314659Z [2024-03-21 00:55:01,876: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T00:55:01.883107225Z [2024-03-21 00:55:01,882: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:55:01.919307580Z [2024-03-21 00:55:01,919: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:55:01.925988129Z [2024-03-21 00:55:01,925: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:55:01.926104230Z [2024-03-21 00:55:01,925: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:55:01.926170821Z [2024-03-21 00:55:01,926: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T00:55:01.926528212Z [2024-03-21 00:55:01,926: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:55:02.083921994Z [2024-03-21 00:55:02,083: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:55:03.019765711Z [2024-03-21 00:55:03,019: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8c663f84-1cbf-423c-9951-ff56e80dec9d] succeeded in 1.8888881489992855s: None
2024-03-21T00:55:03.321877167Z [2024-03-21 00:55:03,321: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:55:03.325759678Z [2024-03-21 00:55:03,325: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:55:03.353577735Z [2024-03-21 00:55:03,353: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:55:03.356175230Z [2024-03-21 00:55:03,355: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:55:03.356550053Z [2024-03-21 00:55:03,356: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:55:03.356835511Z [2024-03-21 00:55:03,356: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:55:03.357049088Z [2024-03-21 00:55:03,356: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:55:03.357633903Z [2024-03-21 00:55:03,357: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:55:03.357916213Z [2024-03-21 00:55:03,357: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:55:03.446682503Z [2024-03-21 00:55:03,446: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T00:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:55:03.644099718Z [2024-03-21 00:55:03,643: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:55:03.648501337Z [2024-03-21 00:55:03,647: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:55:03.685421381Z [2024-03-21 00:55:03,685: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:55:03.692410206Z [2024-03-21 00:55:03,688: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:55:03.692469706Z [2024-03-21 00:55:03,688: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:55:03.692474327Z [2024-03-21 00:55:03,688: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:55:03.692478778Z [2024-03-21 00:55:03,688: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:55:03.692482000Z [2024-03-21 00:55:03,688: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:55:03.692485295Z [2024-03-21 00:55:03,688: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:55:03.771318290Z [2024-03-21 00:55:03,771: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:55:04.033407450Z [2024-03-21 00:55:04,032: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:55:04.039283954Z [2024-03-21 00:55:04,038: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:55:04.079860681Z [2024-03-21 00:55:04,079: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:55:04.081447522Z [2024-03-21 00:55:04,081: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:55:04.081687266Z [2024-03-21 00:55:04,081: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:55:04.082026746Z [2024-03-21 00:55:04,081: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:55:04.082313870Z [2024-03-21 00:55:04,082: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:55:04.082871570Z [2024-03-21 00:55:04,082: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:55:04.083080957Z [2024-03-21 00:55:04,082: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:55:04.148656197Z [2024-03-21 00:55:04,148: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2369d917-cf45-4ec3-b956-d850e814263d] succeeded in 3.0388683299997865s: None
2024-03-21T00:55:04.185135702Z [2024-03-21 00:55:04,184: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:55:05.181041334Z [2024-03-21 00:55:05,180: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd5d6da6-4beb-40e7-a0e9-0162bcdf8a23] received
2024-03-21T00:55:05.192265838Z [2024-03-21 00:55:05,191: INFO/ForkPoolWorker-1] [fd5d6da6-4beb-40e7-a0e9-0162bcdf8a23] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:55:05.475098894Z [2024-03-21 00:55:05,474: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[edd034f8-14b5-4ec5-9976-bc27abee4b29] succeeded in 4.375575144999857s: None
2024-03-21T00:55:05.518394759Z [2024-03-21 00:55:05,514: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:55:05.979701325Z [2024-03-21 00:55:05,979: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[40347898-0b7e-42e5-8901-04af7c766c50] succeeded in 4.873817530999986s: None
2024-03-21T00:55:06.739852027Z [2024-03-21 00:55:06,739: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:55:06.743311650Z [2024-03-21 00:55:06,742: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:55:06.769148010Z [2024-03-21 00:55:06,768: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:55:06.770615655Z [2024-03-21 00:55:06,770: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:55:06.770627984Z [2024-03-21 00:55:06,770: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:55:06.770952191Z [2024-03-21 00:55:06,770: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:55:06.771103621Z [2024-03-21 00:55:06,770: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:55:06.771455169Z [2024-03-21 00:55:06,771: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:55:06.771655210Z [2024-03-21 00:55:06,771: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:55:06.889953591Z [2024-03-21 00:55:06,889: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T00:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:55:07.472732663Z [2024-03-21 00:55:07,472: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fd5d6da6-4beb-40e7-a0e9-0162bcdf8a23] succeeded in 2.289966940999875s: None
2024-03-21T00:55:07.813190086Z [2024-03-21 00:55:07,812: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec3c8c17-62b1-497a-9506-b5b230afe6df] received
2024-03-21T00:55:07.820135511Z [2024-03-21 00:55:07,819: INFO/ForkPoolWorker-15] [ec3c8c17-62b1-497a-9506-b5b230afe6df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T00:55:08.131385005Z [2024-03-21 00:55:08,128: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:55:09.287593240Z [2024-03-21 00:55:09,287: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:55:09.291127929Z [2024-03-21 00:55:09,290: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:55:09.325197105Z [2024-03-21 00:55:09,324: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:55:09.326577307Z [2024-03-21 00:55:09,326: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:55:09.326592844Z [2024-03-21 00:55:09,326: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:55:09.326672789Z [2024-03-21 00:55:09,326: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:55:09.326712722Z [2024-03-21 00:55:09,326: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:55:09.326940316Z [2024-03-21 00:55:09,326: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:55:09.326980050Z [2024-03-21 00:55:09,326: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:55:09.457000490Z [2024-03-21 00:55:09,456: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T00:50:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:55:10.085477780Z [2024-03-21 00:55:10,084: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ec3c8c17-62b1-497a-9506-b5b230afe6df] succeeded in 2.2701757279992307s: None
2024-03-21T00:55:10.142420487Z [2024-03-21 00:55:10,142: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a8e8a75c-0074-49a6-8f30-22e1cb463a5a] received
2024-03-21T00:55:10.154946690Z [2024-03-21 00:55:10,154: INFO/ForkPoolWorker-15] [a8e8a75c-0074-49a6-8f30-22e1cb463a5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T00:55:10.466422336Z [2024-03-21 00:55:10,463: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T00:55:11.649211489Z [2024-03-21 00:55:11,648: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:55:11.652973414Z [2024-03-21 00:55:11,652: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:55:11.673973404Z [2024-03-21 00:55:11,673: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:55:11.676083073Z [2024-03-21 00:55:11,675: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:55:11.676171098Z [2024-03-21 00:55:11,676: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:55:11.676397617Z [2024-03-21 00:55:11,676: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:55:11.676536422Z [2024-03-21 00:55:11,676: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:55:11.676918797Z [2024-03-21 00:55:11,676: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T00:55:11.677039800Z [2024-03-21 00:55:11,676: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:55:11.760290054Z [2024-03-21 00:55:11,759: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T00:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:55:12.440966728Z [2024-03-21 00:55:12,440: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a8e8a75c-0074-49a6-8f30-22e1cb463a5a] succeeded in 2.2947540570003184s: None
2024-03-21T00:56:01.249647087Z [2024-03-21 00:56:01,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48ad73d7-ded5-4ea6-a198-30aab4a23072] received
2024-03-21T00:56:01.252475668Z [2024-03-21 00:56:01,252: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad925fe5-3d7f-465d-b979-db72fb102ee8] received
2024-03-21T00:56:01.269142243Z [2024-03-21 00:56:01,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e70d8cff-d4dc-4333-8d85-e755de7a8eda] received
2024-03-21T00:56:01.273059924Z [2024-03-21 00:56:01,272: INFO/ForkPoolWorker-16] [ad925fe5-3d7f-465d-b979-db72fb102ee8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:56:01.273969366Z [2024-03-21 00:56:01,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70c549b6-d3e7-4bcd-bb60-ba1050b64eef] received
2024-03-21T00:56:01.276439782Z [2024-03-21 00:56:01,276: INFO/ForkPoolWorker-15] [48ad73d7-ded5-4ea6-a198-30aab4a23072] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:56:01.286557857Z [2024-03-21 00:56:01,286: INFO/ForkPoolWorker-1] [e70d8cff-d4dc-4333-8d85-e755de7a8eda] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:56:01.292461769Z [2024-03-21 00:56:01,292: INFO/ForkPoolWorker-2] [70c549b6-d3e7-4bcd-bb60-ba1050b64eef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:56:01.612737098Z [2024-03-21 00:56:01,608: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:56:01.674567287Z [2024-03-21 00:56:01,670: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:56:01.853224155Z [2024-03-21 00:56:01,845: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:56:01.860007700Z [2024-03-21 00:56:01,859: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T00:56:01.864221712Z [2024-03-21 00:56:01,863: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:56:01.890889367Z [2024-03-21 00:56:01,890: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:56:01.894773089Z [2024-03-21 00:56:01,894: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:56:01.895413514Z [2024-03-21 00:56:01,895: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:56:01.895816118Z [2024-03-21 00:56:01,895: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T00:56:01.896533517Z [2024-03-21 00:56:01,896: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:56:01.938097899Z [2024-03-21 00:56:01,934: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:56:02.035230316Z [2024-03-21 00:56:02,034: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:56:02.307260660Z [2024-03-21 00:56:02,302: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:56:02.982947487Z [2024-03-21 00:56:02,982: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ad925fe5-3d7f-465d-b979-db72fb102ee8] succeeded in 1.7251608860005945s: None
2024-03-21T00:56:03.240807510Z [2024-03-21 00:56:03,240: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[48ad73d7-ded5-4ea6-a198-30aab4a23072] succeeded in 1.9811571469999762s: None
2024-03-21T00:56:03.551349553Z [2024-03-21 00:56:03,550: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:56:03.556415987Z [2024-03-21 00:56:03,555: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:56:03.661830224Z [2024-03-21 00:56:03,661: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:56:03.665491049Z [2024-03-21 00:56:03,665: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:56:03.665514902Z [2024-03-21 00:56:03,665: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:56:03.665726134Z [2024-03-21 00:56:03,665: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:56:03.665737539Z [2024-03-21 00:56:03,665: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:56:03.666269677Z [2024-03-21 00:56:03,665: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:56:03.666400441Z [2024-03-21 00:56:03,666: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:56:03.794574390Z [2024-03-21 00:56:03,794: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:56:03.797998702Z [2024-03-21 00:56:03,797: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T00:56:03.801629555Z [2024-03-21 00:56:03,801: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:56:03.854965359Z [2024-03-21 00:56:03,854: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:56:03.867733620Z [2024-03-21 00:56:03,867: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:56:03.867758444Z [2024-03-21 00:56:03,867: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:56:03.873450872Z [2024-03-21 00:56:03,869: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:56:03.875100019Z [2024-03-21 00:56:03,873: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T00:56:03.878444826Z [2024-03-21 00:56:03,878: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:56:03.878544604Z [2024-03-21 00:56:03,878: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:56:04.038609336Z [2024-03-21 00:56:04,038: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:56:07.822668484Z [2024-03-21 00:56:07,822: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e70d8cff-d4dc-4333-8d85-e755de7a8eda] succeeded in 6.549816343999737s: None
2024-03-21T00:56:09.494358684Z [2024-03-21 00:56:09,493: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[70c549b6-d3e7-4bcd-bb60-ba1050b64eef] succeeded in 8.21778183600054s: None
2024-03-21T00:57:00.945803602Z [2024-03-21 00:57:00,945: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cdeee4c1-e821-47a4-a439-575662960646] received
2024-03-21T00:57:00.950751046Z [2024-03-21 00:57:00,950: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac6217af-4eec-49b7-a142-36a3896eb274] received
2024-03-21T00:57:00.952623765Z [2024-03-21 00:57:00,952: INFO/ForkPoolWorker-15] [cdeee4c1-e821-47a4-a439-575662960646] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:57:00.953156282Z [2024-03-21 00:57:00,953: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ced65b4-0a50-44d5-9e04-1678c1032ec5] received
2024-03-21T00:57:00.961956939Z [2024-03-21 00:57:00,961: INFO/ForkPoolWorker-1] [2ced65b4-0a50-44d5-9e04-1678c1032ec5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:57:00.964760731Z [2024-03-21 00:57:00,964: INFO/ForkPoolWorker-16] [ac6217af-4eec-49b7-a142-36a3896eb274] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:57:01.275702448Z [2024-03-21 00:57:01,272: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:57:01.310244380Z [2024-03-21 00:57:01,306: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:57:01.318246030Z [2024-03-21 00:57:01,315: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:57:01.477159758Z [2024-03-21 00:57:01,476: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T00:57:01.481281783Z [2024-03-21 00:57:01,480: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:57:01.509455203Z [2024-03-21 00:57:01,509: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:57:01.513326402Z [2024-03-21 00:57:01,512: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:57:01.513498213Z [2024-03-21 00:57:01,513: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:57:01.513637810Z [2024-03-21 00:57:01,513: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T00:57:01.513936527Z [2024-03-21 00:57:01,513: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:57:01.612977749Z [2024-03-21 00:57:01,612: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:57:02.399264618Z [2024-03-21 00:57:02,398: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ac6217af-4eec-49b7-a142-36a3896eb274] succeeded in 1.446641002999968s: None
2024-03-21T00:57:02.975970441Z [2024-03-21 00:57:02,975: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:57:02.979219560Z [2024-03-21 00:57:02,978: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:57:02.979639377Z [2024-03-21 00:57:02,979: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:57:02.983337272Z [2024-03-21 00:57:02,982: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:57:03.007472336Z [2024-03-21 00:57:03,007: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:57:03.009441750Z [2024-03-21 00:57:03,009: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:57:03.009632062Z [2024-03-21 00:57:03,009: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:57:03.010041979Z [2024-03-21 00:57:03,009: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:57:03.010493333Z [2024-03-21 00:57:03,010: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:57:03.011204060Z [2024-03-21 00:57:03,011: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:57:03.011770620Z [2024-03-21 00:57:03,011: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:57:03.017638736Z [2024-03-21 00:57:03,017: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:57:03.019554958Z [2024-03-21 00:57:03,019: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:57:03.019827642Z [2024-03-21 00:57:03,019: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:57:03.020040219Z [2024-03-21 00:57:03,019: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:57:03.020130344Z [2024-03-21 00:57:03,019: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:57:03.020572921Z [2024-03-21 00:57:03,020: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:57:03.020723300Z [2024-03-21 00:57:03,020: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:57:03.120133722Z [2024-03-21 00:57:03,119: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:57:03.131025243Z [2024-03-21 00:57:03,130: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:57:04.761578105Z [2024-03-21 00:57:04,761: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2ced65b4-0a50-44d5-9e04-1678c1032ec5] succeeded in 3.8066576179999174s: None
2024-03-21T00:57:05.466872836Z [2024-03-21 00:57:05,466: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cdeee4c1-e821-47a4-a439-575662960646] succeeded in 4.519317577000038s: None
2024-03-21T00:58:00.789015567Z [2024-03-21 00:58:00,788: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11d54f8d-1628-4772-b4f0-7b16287ec4bd] received
2024-03-21T00:58:00.799126604Z [2024-03-21 00:58:00,798: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b55e3b2-2050-41be-83c7-ba285ec6d77a] received
2024-03-21T00:58:00.799329424Z [2024-03-21 00:58:00,798: INFO/ForkPoolWorker-15] [11d54f8d-1628-4772-b4f0-7b16287ec4bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T00:58:00.805690740Z [2024-03-21 00:58:00,805: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6e5fbe6-4365-4a61-9c88-66e775df7231] received
2024-03-21T00:58:00.811094213Z [2024-03-21 00:58:00,810: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8df2a33d-88cd-4c7d-b39d-37f8f12cd01d] received
2024-03-21T00:58:00.814879248Z [2024-03-21 00:58:00,814: INFO/ForkPoolWorker-16] [2b55e3b2-2050-41be-83c7-ba285ec6d77a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:58:00.821341274Z [2024-03-21 00:58:00,821: INFO/ForkPoolWorker-1] [d6e5fbe6-4365-4a61-9c88-66e775df7231] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:58:00.821740046Z [2024-03-21 00:58:00,821: INFO/ForkPoolWorker-2] [8df2a33d-88cd-4c7d-b39d-37f8f12cd01d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:58:01.104423383Z [2024-03-21 00:58:01,100: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:58:01.175843405Z [2024-03-21 00:58:01,172: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T00:58:01.236872345Z [2024-03-21 00:58:01,233: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:58:01.262464610Z [2024-03-21 00:58:01,259: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:58:01.269836656Z [2024-03-21 00:58:01,269: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T00:58:01.274408654Z [2024-03-21 00:58:01,273: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:58:01.307198753Z [2024-03-21 00:58:01,306: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T00:58:01.309412425Z [2024-03-21 00:58:01,309: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:58:01.309690841Z [2024-03-21 00:58:01,309: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:58:01.309803520Z [2024-03-21 00:58:01,309: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T00:58:01.310058248Z [2024-03-21 00:58:01,309: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:58:01.431831389Z [2024-03-21 00:58:01,431: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:58:01.522637347Z [2024-03-21 00:58:01,522: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:58:02.168499590Z [2024-03-21 00:58:02,166: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[11d54f8d-1628-4772-b4f0-7b16287ec4bd] succeeded in 1.3756064859999242s: None
2024-03-21T00:58:02.175217259Z [2024-03-21 00:58:02,174: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8df2a33d-88cd-4c7d-b39d-37f8f12cd01d] succeeded in 1.3604096899998694s: None
2024-03-21T00:58:02.663111209Z [2024-03-21 00:58:02,662: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:58:02.666811871Z [2024-03-21 00:58:02,666: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:58:02.689304869Z [2024-03-21 00:58:02,689: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:58:02.690777788Z [2024-03-21 00:58:02,690: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:58:02.690821290Z [2024-03-21 00:58:02,690: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:58:02.691055836Z [2024-03-21 00:58:02,690: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:58:02.691101042Z [2024-03-21 00:58:02,690: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:58:02.691417558Z [2024-03-21 00:58:02,691: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:58:02.691482719Z [2024-03-21 00:58:02,691: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:58:02.708187309Z [2024-03-21 00:58:02,707: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T00:58:02.712145997Z [2024-03-21 00:58:02,711: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:58:02.735003071Z [2024-03-21 00:58:02,734: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:58:02.737542337Z [2024-03-21 00:58:02,737: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:58:02.737688140Z [2024-03-21 00:58:02,737: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:58:02.737850407Z [2024-03-21 00:58:02,737: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:58:02.737927055Z [2024-03-21 00:58:02,737: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T00:58:02.738209349Z [2024-03-21 00:58:02,738: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:58:02.738322268Z [2024-03-21 00:58:02,738: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:58:02.777742489Z [2024-03-21 00:58:02,777: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:58:02.823480459Z [2024-03-21 00:58:02,823: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:58:04.736271392Z [2024-03-21 00:58:04,735: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d6e5fbe6-4365-4a61-9c88-66e775df7231] succeeded in 3.925528316999589s: None
2024-03-21T00:58:05.242378701Z [2024-03-21 00:58:05,241: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2b55e3b2-2050-41be-83c7-ba285ec6d77a] succeeded in 4.440745331000471s: None
2024-03-21T00:59:01.037515424Z [2024-03-21 00:59:01,037: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[822b8636-aca4-4ef1-93b0-8bd3676e22fe] received
2024-03-21T00:59:01.041987528Z [2024-03-21 00:59:01,041: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a392984-97ea-4667-ad32-466c2cb04bb6] received
2024-03-21T00:59:01.044933676Z [2024-03-21 00:59:01,044: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[641c8c18-5517-427c-a8a2-5cb2a411b57d] received
2024-03-21T00:59:01.051596362Z [2024-03-21 00:59:01,051: INFO/ForkPoolWorker-1] [641c8c18-5517-427c-a8a2-5cb2a411b57d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T00:59:01.052243502Z [2024-03-21 00:59:01,052: INFO/ForkPoolWorker-15] [822b8636-aca4-4ef1-93b0-8bd3676e22fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T00:59:01.055487900Z [2024-03-21 00:59:01,055: INFO/ForkPoolWorker-16] [9a392984-97ea-4667-ad32-466c2cb04bb6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T00:59:01.355240010Z [2024-03-21 00:59:01,352: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T00:59:01.376970670Z [2024-03-21 00:59:01,373: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T00:59:01.406293003Z [2024-03-21 00:59:01,403: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T00:59:01.527996425Z [2024-03-21 00:59:01,527: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T00:59:01.532361269Z [2024-03-21 00:59:01,531: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:59:01.557288048Z [2024-03-21 00:59:01,557: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T00:59:01.558322694Z [2024-03-21 00:59:01,558: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T00:59:01.558444513Z [2024-03-21 00:59:01,558: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T00:59:01.558542631Z [2024-03-21 00:59:01,558: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T00:59:01.558895635Z [2024-03-21 00:59:01,558: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T00:59:01.659497494Z [2024-03-21 00:59:01,659: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:59:02.396282048Z [2024-03-21 00:59:02,395: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[641c8c18-5517-427c-a8a2-5cb2a411b57d] succeeded in 1.349900219999654s: None
2024-03-21T00:59:02.727699779Z [2024-03-21 00:59:02,727: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T00:59:02.731778491Z [2024-03-21 00:59:02,731: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:59:02.756099877Z [2024-03-21 00:59:02,755: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T00:59:02.760067881Z [2024-03-21 00:59:02,759: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T00:59:02.770224194Z [2024-03-21 00:59:02,769: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T00:59:02.772254193Z [2024-03-21 00:59:02,771: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:59:02.772304482Z [2024-03-21 00:59:02,772: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:59:02.772586918Z [2024-03-21 00:59:02,772: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:59:02.772739596Z [2024-03-21 00:59:02,772: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T00:59:02.773074279Z [2024-03-21 00:59:02,772: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T00:59:02.773358354Z [2024-03-21 00:59:02,773: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:59:02.784683811Z [2024-03-21 00:59:02,784: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T00:59:02.786124876Z [2024-03-21 00:59:02,785: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T00:59:02.786233628Z [2024-03-21 00:59:02,786: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T00:59:02.786437738Z [2024-03-21 00:59:02,786: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T00:59:02.786503911Z [2024-03-21 00:59:02,786: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T00:59:02.786877561Z [2024-03-21 00:59:02,786: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T00:59:02.786972563Z [2024-03-21 00:59:02,786: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T00:59:02.885033620Z [2024-03-21 00:59:02,884: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:59:02.897439541Z [2024-03-21 00:59:02,897: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T00:59:04.851024973Z [2024-03-21 00:59:04,850: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9a392984-97ea-4667-ad32-466c2cb04bb6] succeeded in 3.80458620599984s: None
2024-03-21T00:59:05.523989783Z [2024-03-21 00:59:05,523: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[822b8636-aca4-4ef1-93b0-8bd3676e22fe] succeeded in 4.48478160599916s: None
2024-03-21T01:00:01.295789307Z [2024-03-21 01:00:01,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b41560a-1a5c-4465-aaab-1f2269808c86] received
2024-03-21T01:00:01.300822089Z [2024-03-21 01:00:01,300: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b0d4aaa-a5ef-4bd5-9e8d-d29ca68407ac] received
2024-03-21T01:00:01.304848636Z [2024-03-21 01:00:01,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eed66e75-11c1-4710-9f8e-b0ac64291fd7] received
2024-03-21T01:00:01.306352804Z [2024-03-21 01:00:01,306: INFO/ForkPoolWorker-15] [5b41560a-1a5c-4465-aaab-1f2269808c86] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:00:01.310541910Z [2024-03-21 01:00:01,310: INFO/ForkPoolWorker-1] [eed66e75-11c1-4710-9f8e-b0ac64291fd7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:00:01.311494272Z [2024-03-21 01:00:01,311: INFO/ForkPoolWorker-16] [5b0d4aaa-a5ef-4bd5-9e8d-d29ca68407ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:00:01.316993235Z [2024-03-21 01:00:01,316: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[150bc4d4-2abe-4a6a-af32-d03fff4e8c15] received
2024-03-21T01:00:01.322299534Z [2024-03-21 01:00:01,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7943efe2-eb08-4556-9d62-c2cd5c7e666a] received
2024-03-21T01:00:01.348013819Z [2024-03-21 01:00:01,347: INFO/ForkPoolWorker-2] [150bc4d4-2abe-4a6a-af32-d03fff4e8c15] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:00:01.357360144Z [2024-03-21 01:00:01,356: INFO/ForkPoolWorker-3] [7943efe2-eb08-4556-9d62-c2cd5c7e666a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:00:01.795094941Z [2024-03-21 01:00:01,791: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:00:01.844519751Z [2024-03-21 01:00:01,840: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:00:01.896979225Z [2024-03-21 01:00:01,893: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:00:02.074368377Z [2024-03-21 01:00:02,070: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:00:02.302353457Z [2024-03-21 01:00:02,291: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:00:02.361678316Z [2024-03-21 01:00:02,361: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T01:00:02.387510415Z [2024-03-21 01:00:02,386: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:00:02.455236914Z [2024-03-21 01:00:02,454: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:00:02.461565333Z [2024-03-21 01:00:02,461: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:00:02.462073882Z [2024-03-21 01:00:02,461: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:00:02.462285667Z [2024-03-21 01:00:02,462: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T01:00:02.462696207Z [2024-03-21 01:00:02,462: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:00:02.578259605Z [2024-03-21 01:00:02,577: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T00:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:00:02.796555293Z [2024-03-21 01:00:02,796: INFO/ForkPoolWorker-3] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T00:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:00:03.397991886Z [2024-03-21 01:00:03,397: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eed66e75-11c1-4710-9f8e-b0ac64291fd7] succeeded in 2.091566877999867s: None
2024-03-21T01:00:03.576032309Z [2024-03-21 01:00:03,575: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[7943efe2-eb08-4556-9d62-c2cd5c7e666a] succeeded in 2.244834944000104s: None
2024-03-21T01:00:03.634608052Z [2024-03-21 01:00:03,634: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:00:03.638196692Z [2024-03-21 01:00:03,637: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:00:03.661183978Z [2024-03-21 01:00:03,660: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:00:03.665840993Z [2024-03-21 01:00:03,665: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:00:03.665875883Z [2024-03-21 01:00:03,665: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:00:03.665983516Z [2024-03-21 01:00:03,665: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:00:03.666008723Z [2024-03-21 01:00:03,665: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:00:03.666301224Z [2024-03-21 01:00:03,666: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:00:03.666315563Z [2024-03-21 01:00:03,666: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:00:03.760424918Z [2024-03-21 01:00:03,760: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T00:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:00:03.835282355Z [2024-03-21 01:00:03,834: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T01:00:03.839276928Z [2024-03-21 01:00:03,838: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:00:03.851719254Z [2024-03-21 01:00:03,850: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:00:03.856206700Z [2024-03-21 01:00:03,855: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:00:03.865726109Z [2024-03-21 01:00:03,865: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:00:03.868022687Z [2024-03-21 01:00:03,867: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:00:03.868033508Z [2024-03-21 01:00:03,867: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:00:03.868167138Z [2024-03-21 01:00:03,867: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:00:03.868250445Z [2024-03-21 01:00:03,868: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T01:00:03.868690501Z [2024-03-21 01:00:03,868: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:00:03.868791534Z [2024-03-21 01:00:03,868: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:00:03.875854360Z [2024-03-21 01:00:03,875: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:00:03.877348992Z [2024-03-21 01:00:03,877: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:00:03.877522357Z [2024-03-21 01:00:03,877: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:00:03.877797070Z [2024-03-21 01:00:03,877: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:00:03.877975193Z [2024-03-21 01:00:03,877: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:00:03.878483912Z [2024-03-21 01:00:03,878: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:00:03.878662038Z [2024-03-21 01:00:03,878: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:00:03.963918073Z [2024-03-21 01:00:03,963: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T00:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:00:03.965380662Z [2024-03-21 01:00:03,965: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T00:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:00:04.603258440Z [2024-03-21 01:00:04,602: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5b41560a-1a5c-4465-aaab-1f2269808c86] succeeded in 3.3046465480001643s: None
2024-03-21T01:00:04.689368380Z [2024-03-21 01:00:04,689: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d46a55e3-3bdd-4d1f-972c-d8182af6511d] received
2024-03-21T01:00:04.707764098Z [2024-03-21 01:00:04,707: INFO/ForkPoolWorker-15] [d46a55e3-3bdd-4d1f-972c-d8182af6511d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:00:05.028091159Z [2024-03-21 01:00:05,025: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:00:05.648178228Z [2024-03-21 01:00:05,647: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[150bc4d4-2abe-4a6a-af32-d03fff4e8c15] succeeded in 4.324519201999465s: None
2024-03-21T01:00:05.797742248Z [2024-03-21 01:00:05,797: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5b0d4aaa-a5ef-4bd5-9e8d-d29ca68407ac] succeeded in 4.4930595119994905s: None
2024-03-21T01:00:06.299000844Z [2024-03-21 01:00:06,298: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:00:06.302633606Z [2024-03-21 01:00:06,302: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:00:06.325919052Z [2024-03-21 01:00:06,325: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:00:06.327447910Z [2024-03-21 01:00:06,327: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:00:06.327565224Z [2024-03-21 01:00:06,327: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:00:06.327743956Z [2024-03-21 01:00:06,327: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:00:06.327837042Z [2024-03-21 01:00:06,327: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:00:06.328161672Z [2024-03-21 01:00:06,327: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:00:06.328273635Z [2024-03-21 01:00:06,328: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:00:06.412353909Z [2024-03-21 01:00:06,412: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T00:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:00:07.063314588Z [2024-03-21 01:00:07,062: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d46a55e3-3bdd-4d1f-972c-d8182af6511d] succeeded in 2.369515694999791s: None
2024-03-21T01:00:07.194460436Z [2024-03-21 01:00:07,194: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1632743b-d502-4f83-993d-f5d9787f8694] received
2024-03-21T01:00:07.204434096Z [2024-03-21 01:00:07,204: INFO/ForkPoolWorker-15] [1632743b-d502-4f83-993d-f5d9787f8694] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T01:00:07.524859472Z [2024-03-21 01:00:07,521: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:00:08.706878085Z [2024-03-21 01:00:08,706: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:00:08.712288457Z [2024-03-21 01:00:08,709: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:00:08.740201205Z [2024-03-21 01:00:08,738: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:00:08.742372747Z [2024-03-21 01:00:08,741: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:00:08.742390691Z [2024-03-21 01:00:08,742: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:00:08.742431809Z [2024-03-21 01:00:08,742: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:00:08.742537521Z [2024-03-21 01:00:08,742: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:00:08.744042595Z [2024-03-21 01:00:08,743: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:00:08.744055885Z [2024-03-21 01:00:08,743: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:00:08.860370929Z [2024-03-21 01:00:08,860: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T00:55:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:00:09.453992400Z [2024-03-21 01:00:09,453: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1632743b-d502-4f83-993d-f5d9787f8694] succeeded in 2.2572154819999923s: None
2024-03-21T01:00:09.930967892Z [2024-03-21 01:00:09,930: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[020c56ed-f333-4d2a-820d-b4d2e336f6e5] received
2024-03-21T01:00:09.940708462Z [2024-03-21 01:00:09,940: INFO/ForkPoolWorker-15] [020c56ed-f333-4d2a-820d-b4d2e336f6e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:00:10.279429840Z [2024-03-21 01:00:10,276: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:00:11.632191066Z [2024-03-21 01:00:11,631: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:00:11.635953754Z [2024-03-21 01:00:11,635: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:00:11.654478529Z [2024-03-21 01:00:11,654: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:00:11.655835670Z [2024-03-21 01:00:11,655: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:00:11.655866094Z [2024-03-21 01:00:11,655: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:00:11.656065627Z [2024-03-21 01:00:11,655: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:00:11.656118423Z [2024-03-21 01:00:11,656: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:00:11.656478312Z [2024-03-21 01:00:11,656: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:00:11.656504640Z [2024-03-21 01:00:11,656: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:00:11.757382049Z [2024-03-21 01:00:11,756: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T00:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:00:12.325566926Z [2024-03-21 01:00:12,325: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[020c56ed-f333-4d2a-820d-b4d2e336f6e5] succeeded in 2.3917956079994838s: None
2024-03-21T01:01:00.422142262Z [2024-03-21 01:01:00,421: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0aeb0bf-0a11-42c8-9c46-9eac12afab34] received
2024-03-21T01:01:00.430642946Z [2024-03-21 01:01:00,429: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9ee969b-d0e2-4029-98db-e347b546ee9a] received
2024-03-21T01:01:00.434695921Z [2024-03-21 01:01:00,434: INFO/ForkPoolWorker-15] [f0aeb0bf-0a11-42c8-9c46-9eac12afab34] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:01:00.438261695Z [2024-03-21 01:01:00,438: INFO/ForkPoolWorker-16] [c9ee969b-d0e2-4029-98db-e347b546ee9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:01:00.441452421Z [2024-03-21 01:01:00,441: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ddeaa23-3387-46c9-a368-efc699600294] received
2024-03-21T01:01:00.461351886Z [2024-03-21 01:01:00,461: INFO/ForkPoolWorker-1] [1ddeaa23-3387-46c9-a368-efc699600294] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:01:00.735036838Z [2024-03-21 01:01:00,731: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:01:00.790000620Z [2024-03-21 01:01:00,785: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:01:00.814062575Z [2024-03-21 01:01:00,810: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:01:00.894994854Z [2024-03-21 01:01:00,894: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T01:01:00.899116467Z [2024-03-21 01:01:00,898: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:01:00.928851099Z [2024-03-21 01:01:00,928: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:01:00.930131993Z [2024-03-21 01:01:00,929: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:01:00.930317518Z [2024-03-21 01:01:00,930: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:01:00.930535488Z [2024-03-21 01:01:00,930: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T01:01:00.931026561Z [2024-03-21 01:01:00,930: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:01:01.048723244Z [2024-03-21 01:01:01,048: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:01:01.644898693Z [2024-03-21 01:01:01,644: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1ddeaa23-3387-46c9-a368-efc699600294] succeeded in 1.2010926979992291s: None
2024-03-21T01:01:02.104620219Z [2024-03-21 01:01:02,104: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:01:02.108577534Z [2024-03-21 01:01:02,108: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:01:02.119503345Z [2024-03-21 01:01:02,118: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:01:02.124718307Z [2024-03-21 01:01:02,124: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:01:02.131154960Z [2024-03-21 01:01:02,130: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:01:02.132698488Z [2024-03-21 01:01:02,132: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:01:02.132742203Z [2024-03-21 01:01:02,132: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:01:02.133023497Z [2024-03-21 01:01:02,132: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:01:02.133047059Z [2024-03-21 01:01:02,132: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:01:02.133413492Z [2024-03-21 01:01:02,133: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:01:02.133445983Z [2024-03-21 01:01:02,133: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:01:02.152875774Z [2024-03-21 01:01:02,152: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:01:02.154916266Z [2024-03-21 01:01:02,154: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:01:02.155013064Z [2024-03-21 01:01:02,154: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:01:02.155354859Z [2024-03-21 01:01:02,155: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:01:02.155534784Z [2024-03-21 01:01:02,155: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:01:02.156006618Z [2024-03-21 01:01:02,155: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:01:02.156200526Z [2024-03-21 01:01:02,155: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:01:02.275590413Z [2024-03-21 01:01:02,273: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:01:02.323801922Z [2024-03-21 01:01:02,323: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:01:03.758045307Z [2024-03-21 01:01:03,757: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c9ee969b-d0e2-4029-98db-e347b546ee9a] succeeded in 3.324719547999848s: None
2024-03-21T01:01:04.147091319Z [2024-03-21 01:01:04,146: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f0aeb0bf-0a11-42c8-9c46-9eac12afab34] succeeded in 3.719731636999313s: None
2024-03-21T01:02:00.229774649Z [2024-03-21 01:02:00,229: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7e37218-ce42-4a04-9b53-48e6ea4159fc] received
2024-03-21T01:02:00.231735972Z [2024-03-21 01:02:00,231: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ceb569cf-e417-4173-abb0-62f94af63d22] received
2024-03-21T01:02:00.237783925Z [2024-03-21 01:02:00,237: INFO/ForkPoolWorker-15] [c7e37218-ce42-4a04-9b53-48e6ea4159fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:02:00.241879769Z [2024-03-21 01:02:00,241: INFO/ForkPoolWorker-16] [ceb569cf-e417-4173-abb0-62f94af63d22] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:02:00.244585155Z [2024-03-21 01:02:00,244: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d1d719a-8e70-4712-aa14-dfb1bb927cab] received
2024-03-21T01:02:00.248100362Z [2024-03-21 01:02:00,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0360603e-67bf-429b-b621-55fdfbc71bf5] received
2024-03-21T01:02:00.253650965Z [2024-03-21 01:02:00,253: INFO/ForkPoolWorker-1] [0d1d719a-8e70-4712-aa14-dfb1bb927cab] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:02:00.256379921Z [2024-03-21 01:02:00,256: INFO/ForkPoolWorker-2] [0360603e-67bf-429b-b621-55fdfbc71bf5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:02:00.595811709Z [2024-03-21 01:02:00,588: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:02:00.627782797Z [2024-03-21 01:02:00,624: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:02:00.704154237Z [2024-03-21 01:02:00,696: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:02:00.800114174Z [2024-03-21 01:02:00,797: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:02:00.832130269Z [2024-03-21 01:02:00,831: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T01:02:00.836446274Z [2024-03-21 01:02:00,835: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:02:00.881866885Z [2024-03-21 01:02:00,879: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:02:00.890268263Z [2024-03-21 01:02:00,890: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:02:00.893696708Z [2024-03-21 01:02:00,890: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:02:00.896183399Z [2024-03-21 01:02:00,893: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T01:02:00.898765941Z [2024-03-21 01:02:00,898: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:02:01.055755098Z [2024-03-21 01:02:01,055: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:02:01.070864649Z [2024-03-21 01:02:01,070: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:02:01.560229604Z [2024-03-21 01:02:01,559: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0d1d719a-8e70-4712-aa14-dfb1bb927cab] succeeded in 1.314060206999784s: None
2024-03-21T01:02:01.673465023Z [2024-03-21 01:02:01,672: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c7e37218-ce42-4a04-9b53-48e6ea4159fc] succeeded in 1.4420149930001571s: None
2024-03-21T01:02:01.993569792Z [2024-03-21 01:02:01,993: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:02:01.997293853Z [2024-03-21 01:02:01,996: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:02:02.022550918Z [2024-03-21 01:02:02,022: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:02:02.024599232Z [2024-03-21 01:02:02,024: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:02:02.024752388Z [2024-03-21 01:02:02,024: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:02:02.025047479Z [2024-03-21 01:02:02,024: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:02:02.025175195Z [2024-03-21 01:02:02,025: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:02:02.025518569Z [2024-03-21 01:02:02,025: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:02:02.025768983Z [2024-03-21 01:02:02,025: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:02:02.049501365Z [2024-03-21 01:02:02,049: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T01:02:02.053218837Z [2024-03-21 01:02:02,052: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:02:02.077709322Z [2024-03-21 01:02:02,077: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:02:02.079204240Z [2024-03-21 01:02:02,078: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:02:02.079369458Z [2024-03-21 01:02:02,079: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:02:02.079617704Z [2024-03-21 01:02:02,079: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:02:02.079781205Z [2024-03-21 01:02:02,079: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T01:02:02.080190456Z [2024-03-21 01:02:02,079: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:02:02.080437606Z [2024-03-21 01:02:02,080: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:02:02.125674667Z [2024-03-21 01:02:02,125: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:02:02.187452147Z [2024-03-21 01:02:02,187: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:02:03.808921327Z [2024-03-21 01:02:03,808: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0360603e-67bf-429b-b621-55fdfbc71bf5] succeeded in 3.5582265299999563s: None
2024-03-21T01:02:04.116389661Z [2024-03-21 01:02:04,115: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ceb569cf-e417-4173-abb0-62f94af63d22] succeeded in 3.882936559999507s: None
2024-03-21T01:03:01.105480778Z [2024-03-21 01:03:01,105: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c982bcb7-62dc-484e-8fe6-05314d50780a] received
2024-03-21T01:03:01.108980798Z [2024-03-21 01:03:01,108: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[633d40b5-9035-4234-816b-cacb329cbf0f] received
2024-03-21T01:03:01.114559035Z [2024-03-21 01:03:01,113: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[591053e6-4860-4765-8479-52cd0c906c70] received
2024-03-21T01:03:01.117186035Z [2024-03-21 01:03:01,116: INFO/ForkPoolWorker-15] [c982bcb7-62dc-484e-8fe6-05314d50780a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:03:01.119946681Z [2024-03-21 01:03:01,119: INFO/ForkPoolWorker-16] [633d40b5-9035-4234-816b-cacb329cbf0f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:03:01.127818202Z [2024-03-21 01:03:01,127: INFO/ForkPoolWorker-1] [591053e6-4860-4765-8479-52cd0c906c70] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:03:01.493337394Z [2024-03-21 01:03:01,490: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:03:01.502155520Z [2024-03-21 01:03:01,498: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:03:01.708527663Z [2024-03-21 01:03:01,690: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:03:01.781693017Z [2024-03-21 01:03:01,781: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T01:03:01.786799156Z [2024-03-21 01:03:01,786: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:03:01.809541723Z [2024-03-21 01:03:01,809: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:03:01.810747601Z [2024-03-21 01:03:01,810: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:03:01.810857574Z [2024-03-21 01:03:01,810: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:03:01.810957526Z [2024-03-21 01:03:01,810: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T01:03:01.811397713Z [2024-03-21 01:03:01,811: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:03:01.941013354Z [2024-03-21 01:03:01,940: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:03:02.793908725Z [2024-03-21 01:03:02,793: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[591053e6-4860-4765-8479-52cd0c906c70] succeeded in 1.6766317579995302s: None
2024-03-21T01:03:03.093692296Z [2024-03-21 01:03:03,092: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:03:03.100555615Z [2024-03-21 01:03:03,099: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:03:03.121802924Z [2024-03-21 01:03:03,121: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:03:03.123214951Z [2024-03-21 01:03:03,122: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:03:03.123233780Z [2024-03-21 01:03:03,123: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:03:03.123392982Z [2024-03-21 01:03:03,123: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:03:03.123455058Z [2024-03-21 01:03:03,123: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:03:03.123736142Z [2024-03-21 01:03:03,123: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:03:03.123807671Z [2024-03-21 01:03:03,123: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:03:03.240889041Z [2024-03-21 01:03:03,240: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:03:03.282129001Z [2024-03-21 01:03:03,281: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:03:03.286044674Z [2024-03-21 01:03:03,285: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:03:03.311188411Z [2024-03-21 01:03:03,310: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:03:03.314582150Z [2024-03-21 01:03:03,312: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:03:03.314631444Z [2024-03-21 01:03:03,312: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:03:03.314643876Z [2024-03-21 01:03:03,312: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:03:03.314649467Z [2024-03-21 01:03:03,313: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:03:03.314653836Z [2024-03-21 01:03:03,313: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:03:03.314658363Z [2024-03-21 01:03:03,313: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:03:03.422998587Z [2024-03-21 01:03:03,422: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:03:05.415333976Z [2024-03-21 01:03:05,414: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c982bcb7-62dc-484e-8fe6-05314d50780a] succeeded in 4.306716017999861s: None
2024-03-21T01:03:05.673312450Z [2024-03-21 01:03:05,672: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[633d40b5-9035-4234-816b-cacb329cbf0f] succeeded in 4.5618277330004275s: None
2024-03-21T01:04:00.367635903Z [2024-03-21 01:04:00,367: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5c480b4-5663-4306-b7ef-97b1ed0eeab3] received
2024-03-21T01:04:00.372489666Z [2024-03-21 01:04:00,372: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84319fd1-94a7-4869-af49-32cdc5c63c2f] received
2024-03-21T01:04:00.380898660Z [2024-03-21 01:04:00,380: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6d5d558-cc71-489a-b2d2-3a9e2405cc43] received
2024-03-21T01:04:00.382913141Z [2024-03-21 01:04:00,382: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc023991-99b9-418d-92fa-0c9a7832dfed] received
2024-03-21T01:04:00.385975043Z [2024-03-21 01:04:00,385: INFO/ForkPoolWorker-15] [f5c480b4-5663-4306-b7ef-97b1ed0eeab3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:04:00.393158813Z [2024-03-21 01:04:00,392: INFO/ForkPoolWorker-1] [f6d5d558-cc71-489a-b2d2-3a9e2405cc43] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:04:00.393579107Z [2024-03-21 01:04:00,393: INFO/ForkPoolWorker-16] [84319fd1-94a7-4869-af49-32cdc5c63c2f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:04:00.401253923Z [2024-03-21 01:04:00,400: INFO/ForkPoolWorker-2] [bc023991-99b9-418d-92fa-0c9a7832dfed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:04:00.718429232Z [2024-03-21 01:04:00,714: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:04:00.780621553Z [2024-03-21 01:04:00,777: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:04:00.796282603Z [2024-03-21 01:04:00,790: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:04:00.862563817Z [2024-03-21 01:04:00,858: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:04:01.064789555Z [2024-03-21 01:04:01,064: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:04:01.068632799Z [2024-03-21 01:04:01,068: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T01:04:01.073916145Z [2024-03-21 01:04:01,073: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:04:01.117097666Z [2024-03-21 01:04:01,116: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:04:01.121387120Z [2024-03-21 01:04:01,121: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:04:01.121645027Z [2024-03-21 01:04:01,121: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:04:01.121794878Z [2024-03-21 01:04:01,121: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T01:04:01.122150606Z [2024-03-21 01:04:01,122: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:04:01.265828153Z [2024-03-21 01:04:01,265: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:04:01.798681406Z [2024-03-21 01:04:01,798: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f5c480b4-5663-4306-b7ef-97b1ed0eeab3] succeeded in 1.4289621080006327s: None
2024-03-21T01:04:02.077705998Z [2024-03-21 01:04:02,077: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[84319fd1-94a7-4869-af49-32cdc5c63c2f] succeeded in 1.7035031940004046s: None
2024-03-21T01:04:02.448162910Z [2024-03-21 01:04:02,443: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T01:04:02.450588255Z [2024-03-21 01:04:02,450: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:04:02.474733475Z [2024-03-21 01:04:02,474: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:04:02.476269008Z [2024-03-21 01:04:02,476: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:04:02.476376090Z [2024-03-21 01:04:02,476: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:04:02.476476660Z [2024-03-21 01:04:02,476: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:04:02.476514693Z [2024-03-21 01:04:02,476: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T01:04:02.476814351Z [2024-03-21 01:04:02,476: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:04:02.476848838Z [2024-03-21 01:04:02,476: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:04:02.633470915Z [2024-03-21 01:04:02,631: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:04:02.847860545Z [2024-03-21 01:04:02,847: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:04:02.851738558Z [2024-03-21 01:04:02,851: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:04:02.885394787Z [2024-03-21 01:04:02,885: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:04:02.890215939Z [2024-03-21 01:04:02,889: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:04:02.890320619Z [2024-03-21 01:04:02,890: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:04:02.890569622Z [2024-03-21 01:04:02,890: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:04:02.890683643Z [2024-03-21 01:04:02,890: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:04:02.891032253Z [2024-03-21 01:04:02,890: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:04:02.891164139Z [2024-03-21 01:04:02,890: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:04:02.992636745Z [2024-03-21 01:04:02,992: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:04:04.349451745Z [2024-03-21 01:04:04,349: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bc023991-99b9-418d-92fa-0c9a7832dfed] succeeded in 3.964099570000144s: None
2024-03-21T01:04:05.438787205Z [2024-03-21 01:04:05,438: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f6d5d558-cc71-489a-b2d2-3a9e2405cc43] succeeded in 5.056292526000107s: None
2024-03-21T01:05:00.315664710Z [2024-03-21 01:05:00,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b06998e-a8f8-4297-804a-a29f45af478c] received
2024-03-21T01:05:00.319101125Z [2024-03-21 01:05:00,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e5535b2-e216-48e0-91aa-43153cc078c6] received
2024-03-21T01:05:00.327201802Z [2024-03-21 01:05:00,326: INFO/ForkPoolWorker-15] [0b06998e-a8f8-4297-804a-a29f45af478c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:05:00.328885384Z [2024-03-21 01:05:00,328: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af042a8b-7eec-4914-9c26-6fd1bdca6684] received
2024-03-21T01:05:00.332922229Z [2024-03-21 01:05:00,332: INFO/ForkPoolWorker-16] [2e5535b2-e216-48e0-91aa-43153cc078c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:05:00.337119308Z [2024-03-21 01:05:00,336: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8b7a8b9-2927-4de8-91ce-a1e78efb17a3] received
2024-03-21T01:05:00.340810088Z [2024-03-21 01:05:00,340: INFO/ForkPoolWorker-1] [af042a8b-7eec-4914-9c26-6fd1bdca6684] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:05:00.343730878Z [2024-03-21 01:05:00,343: INFO/ForkPoolWorker-2] [c8b7a8b9-2927-4de8-91ce-a1e78efb17a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:05:00.632530174Z [2024-03-21 01:05:00,629: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:05:00.688781196Z [2024-03-21 01:05:00,671: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:05:00.694059178Z [2024-03-21 01:05:00,690: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:05:00.722918571Z [2024-03-21 01:05:00,719: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:05:00.857531434Z [2024-03-21 01:05:00,857: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T01:05:00.861840597Z [2024-03-21 01:05:00,861: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:05:00.895130648Z [2024-03-21 01:05:00,894: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:05:00.896752737Z [2024-03-21 01:05:00,896: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:05:00.896806887Z [2024-03-21 01:05:00,896: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:05:00.896866993Z [2024-03-21 01:05:00,896: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T01:05:00.897047775Z [2024-03-21 01:05:00,896: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:05:01.020097645Z [2024-03-21 01:05:01,019: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:05:01.569099053Z [2024-03-21 01:05:01,568: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2e5535b2-e216-48e0-91aa-43153cc078c6] succeeded in 1.2478713390000848s: None
2024-03-21T01:05:02.100441042Z [2024-03-21 01:05:02,099: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T01:05:02.104432543Z [2024-03-21 01:05:02,103: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:05:02.145022040Z [2024-03-21 01:05:02,144: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:05:02.157309167Z [2024-03-21 01:05:02,157: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:05:02.157348505Z [2024-03-21 01:05:02,157: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:05:02.157448337Z [2024-03-21 01:05:02,157: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:05:02.157458195Z [2024-03-21 01:05:02,157: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T01:05:02.157807414Z [2024-03-21 01:05:02,157: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:05:02.157816072Z [2024-03-21 01:05:02,157: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:05:02.215989811Z [2024-03-21 01:05:02,215: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:05:02.222916117Z [2024-03-21 01:05:02,222: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:05:02.330207525Z [2024-03-21 01:05:02,325: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:05:02.336722147Z [2024-03-21 01:05:02,332: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:05:02.336832310Z [2024-03-21 01:05:02,336: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:05:02.336947056Z [2024-03-21 01:05:02,336: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:05:02.336989977Z [2024-03-21 01:05:02,336: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:05:02.337285907Z [2024-03-21 01:05:02,337: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:05:02.337323584Z [2024-03-21 01:05:02,337: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:05:02.403590945Z [2024-03-21 01:05:02,403: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:05:02.427930076Z [2024-03-21 01:05:02,427: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:05:02.436912614Z [2024-03-21 01:05:02,434: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:05:02.488749731Z [2024-03-21 01:05:02,488: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:05:02.492890649Z [2024-03-21 01:05:02,492: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:05:02.493280159Z [2024-03-21 01:05:02,492: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:05:02.493647715Z [2024-03-21 01:05:02,493: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:05:02.493998425Z [2024-03-21 01:05:02,493: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:05:02.494497739Z [2024-03-21 01:05:02,494: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:05:02.494696850Z [2024-03-21 01:05:02,494: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:05:02.627983176Z [2024-03-21 01:05:02,627: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T01:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:05:02.632092078Z [2024-03-21 01:05:02,631: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:05:03.493377653Z [2024-03-21 01:05:03,492: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0b06998e-a8f8-4297-804a-a29f45af478c] succeeded in 3.1720539059997463s: None
2024-03-21T01:05:04.472886475Z [2024-03-21 01:05:04,472: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac8929cb-af15-48f1-9296-20070a0cfd65] received
2024-03-21T01:05:04.480105608Z [2024-03-21 01:05:04,479: INFO/ForkPoolWorker-15] [ac8929cb-af15-48f1-9296-20070a0cfd65] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:05:04.585232685Z [2024-03-21 01:05:04,584: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[af042a8b-7eec-4914-9c26-6fd1bdca6684] succeeded in 4.254203038000014s: None
2024-03-21T01:05:04.840260709Z [2024-03-21 01:05:04,835: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:05:05.128696145Z [2024-03-21 01:05:05,127: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c8b7a8b9-2927-4de8-91ce-a1e78efb17a3] succeeded in 4.789551740000206s: None
2024-03-21T01:05:06.236356436Z [2024-03-21 01:05:06,235: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:05:06.240099307Z [2024-03-21 01:05:06,239: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:05:06.275013980Z [2024-03-21 01:05:06,274: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:05:06.277700070Z [2024-03-21 01:05:06,277: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:05:06.277735502Z [2024-03-21 01:05:06,277: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:05:06.277934809Z [2024-03-21 01:05:06,277: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:05:06.278022758Z [2024-03-21 01:05:06,277: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:05:06.278468943Z [2024-03-21 01:05:06,278: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:05:06.278489625Z [2024-03-21 01:05:06,278: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:05:06.364590355Z [2024-03-21 01:05:06,364: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T01:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:05:07.026597221Z [2024-03-21 01:05:07,026: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[218e9578-fb20-4461-8e99-d7dabc65532d] received
2024-03-21T01:05:07.045630565Z [2024-03-21 01:05:07,045: INFO/ForkPoolWorker-16] [218e9578-fb20-4461-8e99-d7dabc65532d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T01:05:07.099740056Z [2024-03-21 01:05:07,099: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ac8929cb-af15-48f1-9296-20070a0cfd65] succeeded in 2.6246433679998518s: None
2024-03-21T01:05:07.348604344Z [2024-03-21 01:05:07,338: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:05:08.667972831Z [2024-03-21 01:05:08,667: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:05:08.671729873Z [2024-03-21 01:05:08,671: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:05:08.695689976Z [2024-03-21 01:05:08,695: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:05:08.697984881Z [2024-03-21 01:05:08,697: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:05:08.698222734Z [2024-03-21 01:05:08,697: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:05:08.698591899Z [2024-03-21 01:05:08,698: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:05:08.698816678Z [2024-03-21 01:05:08,698: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:05:08.699344642Z [2024-03-21 01:05:08,699: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:05:08.700194259Z [2024-03-21 01:05:08,699: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:05:08.794187433Z [2024-03-21 01:05:08,793: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T01:00:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:05:09.449909615Z [2024-03-21 01:05:09,449: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[218e9578-fb20-4461-8e99-d7dabc65532d] succeeded in 2.421402267999838s: None
2024-03-21T01:05:09.653688632Z [2024-03-21 01:05:09,653: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48d0e014-8826-43e1-9b09-070b910828b0] received
2024-03-21T01:05:09.667818112Z [2024-03-21 01:05:09,667: INFO/ForkPoolWorker-15] [48d0e014-8826-43e1-9b09-070b910828b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:05:10.078055940Z [2024-03-21 01:05:10,075: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:05:11.373393847Z [2024-03-21 01:05:11,372: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:05:11.377072063Z [2024-03-21 01:05:11,376: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:05:11.397332443Z [2024-03-21 01:05:11,397: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:05:11.398775092Z [2024-03-21 01:05:11,398: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:05:11.398815013Z [2024-03-21 01:05:11,398: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:05:11.399080255Z [2024-03-21 01:05:11,398: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:05:11.399235432Z [2024-03-21 01:05:11,399: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:05:11.399647752Z [2024-03-21 01:05:11,399: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:05:11.399751365Z [2024-03-21 01:05:11,399: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:05:11.476044677Z [2024-03-21 01:05:11,475: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T01:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:05:12.063587734Z [2024-03-21 01:05:12,063: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[48d0e014-8826-43e1-9b09-070b910828b0] succeeded in 2.4080771280005138s: None
2024-03-21T01:06:00.412608923Z [2024-03-21 01:06:00,411: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a023b7f5-ccd6-4211-ae9b-7c7e44b54fd0] received
2024-03-21T01:06:00.415794173Z [2024-03-21 01:06:00,415: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28a8d72f-8d6d-4592-8320-098ade5db756] received
2024-03-21T01:06:00.422374147Z [2024-03-21 01:06:00,422: INFO/ForkPoolWorker-15] [a023b7f5-ccd6-4211-ae9b-7c7e44b54fd0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:06:00.428053059Z [2024-03-21 01:06:00,427: INFO/ForkPoolWorker-16] [28a8d72f-8d6d-4592-8320-098ade5db756] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:06:00.430642545Z [2024-03-21 01:06:00,430: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa241e74-28e1-482a-91f2-85b32ab60d02] received
2024-03-21T01:06:00.439756086Z [2024-03-21 01:06:00,439: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92f3b637-22c2-4759-91d0-44557b6b691e] received
2024-03-21T01:06:00.441139825Z [2024-03-21 01:06:00,440: INFO/ForkPoolWorker-1] [aa241e74-28e1-482a-91f2-85b32ab60d02] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:06:00.458642108Z [2024-03-21 01:06:00,458: INFO/ForkPoolWorker-2] [92f3b637-22c2-4759-91d0-44557b6b691e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:06:00.752805216Z [2024-03-21 01:06:00,741: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:06:00.757573228Z [2024-03-21 01:06:00,754: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:06:00.832398756Z [2024-03-21 01:06:00,829: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:06:00.875015336Z [2024-03-21 01:06:00,871: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:06:00.944482825Z [2024-03-21 01:06:00,944: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T01:06:00.948768467Z [2024-03-21 01:06:00,948: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:06:00.982194909Z [2024-03-21 01:06:00,981: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:06:00.983571208Z [2024-03-21 01:06:00,983: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:06:00.983715046Z [2024-03-21 01:06:00,983: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:06:00.983805775Z [2024-03-21 01:06:00,983: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T01:06:00.984153832Z [2024-03-21 01:06:00,984: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:06:01.058439364Z [2024-03-21 01:06:01,058: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:06:01.092970307Z [2024-03-21 01:06:01,092: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:06:01.664145834Z [2024-03-21 01:06:01,663: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[28a8d72f-8d6d-4592-8320-098ade5db756] succeeded in 1.2460228419995474s: None
2024-03-21T01:06:01.727698693Z [2024-03-21 01:06:01,727: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a023b7f5-ccd6-4211-ae9b-7c7e44b54fd0] succeeded in 1.3138248859995656s: None
2024-03-21T01:06:02.284521119Z [2024-03-21 01:06:02,282: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T01:06:02.289135671Z [2024-03-21 01:06:02,288: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:06:02.291968556Z [2024-03-21 01:06:02,287: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:06:02.296473043Z [2024-03-21 01:06:02,293: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:06:02.329473980Z [2024-03-21 01:06:02,329: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:06:02.330975292Z [2024-03-21 01:06:02,330: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:06:02.331136790Z [2024-03-21 01:06:02,330: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:06:02.331345242Z [2024-03-21 01:06:02,331: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:06:02.331490805Z [2024-03-21 01:06:02,331: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T01:06:02.331821589Z [2024-03-21 01:06:02,331: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:06:02.331995424Z [2024-03-21 01:06:02,331: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:06:02.363097924Z [2024-03-21 01:06:02,362: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:06:02.434583909Z [2024-03-21 01:06:02,434: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:06:02.439777889Z [2024-03-21 01:06:02,434: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:06:02.441280452Z [2024-03-21 01:06:02,439: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:06:02.442216864Z [2024-03-21 01:06:02,441: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:06:02.444546129Z [2024-03-21 01:06:02,444: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:06:02.446287051Z [2024-03-21 01:06:02,444: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:06:02.521144897Z [2024-03-21 01:06:02,520: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:06:02.589253040Z [2024-03-21 01:06:02,588: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:06:04.141879202Z [2024-03-21 01:06:04,141: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aa241e74-28e1-482a-91f2-85b32ab60d02] succeeded in 3.708489456999814s: None
2024-03-21T01:06:04.405192761Z [2024-03-21 01:06:04,404: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[92f3b637-22c2-4759-91d0-44557b6b691e] succeeded in 3.9570949740000287s: None
2024-03-21T01:07:00.232072947Z [2024-03-21 01:07:00,231: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e792ead-39ea-431b-9e4c-2edcbd59fbd2] received
2024-03-21T01:07:00.238645489Z [2024-03-21 01:07:00,238: INFO/ForkPoolWorker-15] [6e792ead-39ea-431b-9e4c-2edcbd59fbd2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:07:00.245825276Z [2024-03-21 01:07:00,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17f6d4d7-0530-4a9f-a600-12e36e1f8c92] received
2024-03-21T01:07:00.253685873Z [2024-03-21 01:07:00,253: INFO/ForkPoolWorker-16] [17f6d4d7-0530-4a9f-a600-12e36e1f8c92] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:07:00.260833447Z [2024-03-21 01:07:00,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe03f6e3-b3ac-45f7-a851-1e172da78de0] received
2024-03-21T01:07:00.269417160Z [2024-03-21 01:07:00,269: INFO/ForkPoolWorker-1] [fe03f6e3-b3ac-45f7-a851-1e172da78de0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:07:00.547554278Z [2024-03-21 01:07:00,544: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:07:00.596213560Z [2024-03-21 01:07:00,593: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:07:00.639027626Z [2024-03-21 01:07:00,635: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:07:00.824789709Z [2024-03-21 01:07:00,824: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T01:07:00.829122330Z [2024-03-21 01:07:00,828: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:07:00.858615550Z [2024-03-21 01:07:00,858: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:07:00.859929199Z [2024-03-21 01:07:00,859: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:07:00.860348892Z [2024-03-21 01:07:00,860: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:07:00.860590269Z [2024-03-21 01:07:00,860: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T01:07:00.861387184Z [2024-03-21 01:07:00,861: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:07:00.956466484Z [2024-03-21 01:07:00,956: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:07:01.513413212Z [2024-03-21 01:07:01,513: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6e792ead-39ea-431b-9e4c-2edcbd59fbd2] succeeded in 1.279950151999401s: None
2024-03-21T01:07:01.720437607Z [2024-03-21 01:07:01,719: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:07:01.724471036Z [2024-03-21 01:07:01,723: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:07:01.745489602Z [2024-03-21 01:07:01,745: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:07:01.747227865Z [2024-03-21 01:07:01,746: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:07:01.747376848Z [2024-03-21 01:07:01,747: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:07:01.747822504Z [2024-03-21 01:07:01,747: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:07:01.748282399Z [2024-03-21 01:07:01,748: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:07:01.748662966Z [2024-03-21 01:07:01,748: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:07:01.748796801Z [2024-03-21 01:07:01,748: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:07:01.785371282Z [2024-03-21 01:07:01,784: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:07:01.789177490Z [2024-03-21 01:07:01,788: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:07:01.812944250Z [2024-03-21 01:07:01,812: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:07:01.815085487Z [2024-03-21 01:07:01,814: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:07:01.815104376Z [2024-03-21 01:07:01,814: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:07:01.815442550Z [2024-03-21 01:07:01,815: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:07:01.815557089Z [2024-03-21 01:07:01,815: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:07:01.816131746Z [2024-03-21 01:07:01,815: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:07:01.816267836Z [2024-03-21 01:07:01,816: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:07:01.841721337Z [2024-03-21 01:07:01,841: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:07:01.943798210Z [2024-03-21 01:07:01,943: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:07:03.604219743Z [2024-03-21 01:07:03,603: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[17f6d4d7-0530-4a9f-a600-12e36e1f8c92] succeeded in 3.355938237999908s: None
2024-03-21T01:07:03.908712935Z [2024-03-21 01:07:03,908: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fe03f6e3-b3ac-45f7-a851-1e172da78de0] succeeded in 3.64542440599962s: None
2024-03-21T01:08:00.633145813Z [2024-03-21 01:08:00,632: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[118cf9a7-13ab-40e4-beb1-8825ef8efc1a] received
2024-03-21T01:08:00.643016386Z [2024-03-21 01:08:00,642: INFO/ForkPoolWorker-15] [118cf9a7-13ab-40e4-beb1-8825ef8efc1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:08:00.644135812Z [2024-03-21 01:08:00,643: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbf2ee18-632a-43cd-9e13-9e426ca5baec] received
2024-03-21T01:08:00.646788139Z [2024-03-21 01:08:00,646: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7a63ec9-6282-44fb-904d-9e8721a30dd4] received
2024-03-21T01:08:00.652448872Z [2024-03-21 01:08:00,652: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[895fac33-db31-4d3c-ae99-7f846ca90723] received
2024-03-21T01:08:00.653040646Z [2024-03-21 01:08:00,652: INFO/ForkPoolWorker-16] [cbf2ee18-632a-43cd-9e13-9e426ca5baec] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:08:00.661411179Z [2024-03-21 01:08:00,661: INFO/ForkPoolWorker-1] [e7a63ec9-6282-44fb-904d-9e8721a30dd4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:08:00.673903903Z [2024-03-21 01:08:00,673: INFO/ForkPoolWorker-2] [895fac33-db31-4d3c-ae99-7f846ca90723] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:08:01.033444905Z [2024-03-21 01:08:01,030: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:08:01.042762216Z [2024-03-21 01:08:01,039: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:08:01.095304803Z [2024-03-21 01:08:01,092: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:08:01.183979898Z [2024-03-21 01:08:01,179: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:08:01.477184085Z [2024-03-21 01:08:01,476: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T01:08:01.482582332Z [2024-03-21 01:08:01,482: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:08:01.494501379Z [2024-03-21 01:08:01,494: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:08:01.518309163Z [2024-03-21 01:08:01,518: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:08:01.520749832Z [2024-03-21 01:08:01,520: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:08:01.520847364Z [2024-03-21 01:08:01,520: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:08:01.520892266Z [2024-03-21 01:08:01,520: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T01:08:01.521455261Z [2024-03-21 01:08:01,521: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:08:01.649962783Z [2024-03-21 01:08:01,649: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:08:02.117206983Z [2024-03-21 01:08:02,116: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cbf2ee18-632a-43cd-9e13-9e426ca5baec] succeeded in 1.4693388679997952s: None
2024-03-21T01:08:02.346574500Z [2024-03-21 01:08:02,346: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:08:02.366659160Z [2024-03-21 01:08:02,366: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:08:02.449410199Z [2024-03-21 01:08:02,449: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:08:02.454249557Z [2024-03-21 01:08:02,453: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:08:02.454340246Z [2024-03-21 01:08:02,454: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:08:02.454598624Z [2024-03-21 01:08:02,454: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:08:02.454743781Z [2024-03-21 01:08:02,454: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:08:02.455244541Z [2024-03-21 01:08:02,454: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:08:02.455261558Z [2024-03-21 01:08:02,455: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:08:02.556450495Z [2024-03-21 01:08:02,555: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[895fac33-db31-4d3c-ae99-7f846ca90723] succeeded in 1.8946472509996966s: None
2024-03-21T01:08:02.562190302Z [2024-03-21 01:08:02,561: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:08:02.574383513Z [2024-03-21 01:08:02,573: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:08:02.578072177Z [2024-03-21 01:08:02,577: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:08:02.604628281Z [2024-03-21 01:08:02,604: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:08:02.606021275Z [2024-03-21 01:08:02,605: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:08:02.606041835Z [2024-03-21 01:08:02,605: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:08:02.606209975Z [2024-03-21 01:08:02,605: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:08:02.606232638Z [2024-03-21 01:08:02,606: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:08:02.606446609Z [2024-03-21 01:08:02,606: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:08:02.606532664Z [2024-03-21 01:08:02,606: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:08:02.701811460Z [2024-03-21 01:08:02,700: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:08:04.856753805Z [2024-03-21 01:08:04,856: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[118cf9a7-13ab-40e4-beb1-8825ef8efc1a] succeeded in 4.221086341000046s: None
2024-03-21T01:08:05.159953199Z [2024-03-21 01:08:05,159: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e7a63ec9-6282-44fb-904d-9e8721a30dd4] succeeded in 4.508460029000162s: None
2024-03-21T01:09:00.511516575Z [2024-03-21 01:09:00,511: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6f0bc57-c07d-4426-9d34-b7c4ef20c6bd] received
2024-03-21T01:09:00.519511238Z [2024-03-21 01:09:00,519: INFO/ForkPoolWorker-15] [b6f0bc57-c07d-4426-9d34-b7c4ef20c6bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:09:00.521896383Z [2024-03-21 01:09:00,521: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9b55a14-d3f1-46ad-bbf7-ef5fe041d298] received
2024-03-21T01:09:00.524908302Z [2024-03-21 01:09:00,524: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e09a0aae-189f-4fdf-a53c-f1b3ed621220] received
2024-03-21T01:09:00.530402674Z [2024-03-21 01:09:00,530: INFO/ForkPoolWorker-16] [a9b55a14-d3f1-46ad-bbf7-ef5fe041d298] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:09:00.532143940Z [2024-03-21 01:09:00,531: INFO/ForkPoolWorker-1] [e09a0aae-189f-4fdf-a53c-f1b3ed621220] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:09:00.823245056Z [2024-03-21 01:09:00,820: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:09:00.863104188Z [2024-03-21 01:09:00,855: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:09:00.899559266Z [2024-03-21 01:09:00,896: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:09:01.084799695Z [2024-03-21 01:09:01,083: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T01:09:01.088500864Z [2024-03-21 01:09:01,088: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:09:01.109849364Z [2024-03-21 01:09:01,109: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:09:01.111715324Z [2024-03-21 01:09:01,111: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:09:01.111881293Z [2024-03-21 01:09:01,111: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:09:01.112009644Z [2024-03-21 01:09:01,111: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T01:09:01.112626377Z [2024-03-21 01:09:01,112: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:09:01.215401629Z [2024-03-21 01:09:01,215: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:09:01.781543534Z [2024-03-21 01:09:01,781: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a9b55a14-d3f1-46ad-bbf7-ef5fe041d298] succeeded in 1.2575056309997308s: None
2024-03-21T01:09:02.037346433Z [2024-03-21 01:09:02,036: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:09:02.042330689Z [2024-03-21 01:09:02,041: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:09:02.058222047Z [2024-03-21 01:09:02,057: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:09:02.062493979Z [2024-03-21 01:09:02,062: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:09:02.064257619Z [2024-03-21 01:09:02,063: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:09:02.064504628Z [2024-03-21 01:09:02,064: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:09:02.064785898Z [2024-03-21 01:09:02,064: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:09:02.064885752Z [2024-03-21 01:09:02,064: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:09:02.065357038Z [2024-03-21 01:09:02,065: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:09:02.065572867Z [2024-03-21 01:09:02,065: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:09:02.067379867Z [2024-03-21 01:09:02,066: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:09:02.094204488Z [2024-03-21 01:09:02,093: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:09:02.096249985Z [2024-03-21 01:09:02,095: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:09:02.096266215Z [2024-03-21 01:09:02,096: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:09:02.096592291Z [2024-03-21 01:09:02,096: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:09:02.096717682Z [2024-03-21 01:09:02,096: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:09:02.097205563Z [2024-03-21 01:09:02,096: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:09:02.097327156Z [2024-03-21 01:09:02,097: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:09:02.170626331Z [2024-03-21 01:09:02,170: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:09:02.220385977Z [2024-03-21 01:09:02,219: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:09:03.919072289Z [2024-03-21 01:09:03,918: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e09a0aae-189f-4fdf-a53c-f1b3ed621220] succeeded in 3.392494679000265s: None
2024-03-21T01:09:04.299287331Z [2024-03-21 01:09:04,298: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b6f0bc57-c07d-4426-9d34-b7c4ef20c6bd] succeeded in 3.785173386000679s: None
2024-03-21T01:10:00.447177423Z [2024-03-21 01:10:00,446: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b10733a-4d8f-4d23-bd36-0965b071a80f] received
2024-03-21T01:10:00.450257232Z [2024-03-21 01:10:00,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c318b8fd-642b-4275-a690-05ba618417ab] received
2024-03-21T01:10:00.453761028Z [2024-03-21 01:10:00,453: INFO/ForkPoolWorker-15] [4b10733a-4d8f-4d23-bd36-0965b071a80f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:10:00.457965345Z [2024-03-21 01:10:00,457: INFO/ForkPoolWorker-16] [c318b8fd-642b-4275-a690-05ba618417ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:10:00.459999104Z [2024-03-21 01:10:00,459: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3aa65b6-f11d-4ebf-bd8f-c3c9587c72fe] received
2024-03-21T01:10:00.462185739Z [2024-03-21 01:10:00,462: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1a61d21-d912-4b2e-ad76-3a0b9904af16] received
2024-03-21T01:10:00.467666104Z [2024-03-21 01:10:00,467: INFO/ForkPoolWorker-2] [c1a61d21-d912-4b2e-ad76-3a0b9904af16] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:10:00.468253171Z [2024-03-21 01:10:00,468: INFO/ForkPoolWorker-1] [e3aa65b6-f11d-4ebf-bd8f-c3c9587c72fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:10:00.475885866Z [2024-03-21 01:10:00,475: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[634c38b6-495a-4fe0-94af-fa52899ab7c2] received
2024-03-21T01:10:00.505502605Z [2024-03-21 01:10:00,505: INFO/ForkPoolWorker-3] [634c38b6-495a-4fe0-94af-fa52899ab7c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:10:00.792908329Z [2024-03-21 01:10:00,777: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:10:00.812204381Z [2024-03-21 01:10:00,805: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:10:00.930131547Z [2024-03-21 01:10:00,926: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:10:00.954649230Z [2024-03-21 01:10:00,950: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:10:01.278160655Z [2024-03-21 01:10:01,265: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:10:01.332366733Z [2024-03-21 01:10:01,332: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:10:01.656531860Z [2024-03-21 01:10:01,655: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T01:10:01.662493724Z [2024-03-21 01:10:01,661: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:10:01.706549725Z [2024-03-21 01:10:01,706: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:10:01.708039185Z [2024-03-21 01:10:01,707: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:10:01.708176435Z [2024-03-21 01:10:01,707: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:10:01.708272434Z [2024-03-21 01:10:01,708: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T01:10:01.711445419Z [2024-03-21 01:10:01,711: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:10:01.834920678Z [2024-03-21 01:10:01,834: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:10:02.001479486Z [2024-03-21 01:10:02,001: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c318b8fd-642b-4275-a690-05ba618417ab] succeeded in 1.549051936000069s: None
2024-03-21T01:10:02.514599315Z [2024-03-21 01:10:02,514: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T01:10:02.520024959Z [2024-03-21 01:10:02,519: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:10:02.547388827Z [2024-03-21 01:10:02,547: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:10:02.550282267Z [2024-03-21 01:10:02,550: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:10:02.550392510Z [2024-03-21 01:10:02,550: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:10:02.550653862Z [2024-03-21 01:10:02,550: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:10:02.550718750Z [2024-03-21 01:10:02,550: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T01:10:02.551273354Z [2024-03-21 01:10:02,551: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:10:02.551451975Z [2024-03-21 01:10:02,551: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:10:02.635652036Z [2024-03-21 01:10:02,635: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:10:02.639281684Z [2024-03-21 01:10:02,638: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:10:02.641095443Z [2024-03-21 01:10:02,640: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e3aa65b6-f11d-4ebf-bd8f-c3c9587c72fe] succeeded in 2.1778432010005417s: None
2024-03-21T01:10:02.643887425Z [2024-03-21 01:10:02,643: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:10:02.665772770Z [2024-03-21 01:10:02,665: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:10:02.668000486Z [2024-03-21 01:10:02,667: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:10:02.668239336Z [2024-03-21 01:10:02,667: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:10:02.668492242Z [2024-03-21 01:10:02,668: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:10:02.668630198Z [2024-03-21 01:10:02,668: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:10:02.669139907Z [2024-03-21 01:10:02,668: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:10:02.669264271Z [2024-03-21 01:10:02,669: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:10:02.791468212Z [2024-03-21 01:10:02,790: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T01:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:10:02.926261357Z [2024-03-21 01:10:02,925: INFO/ForkPoolWorker-3] Getting VIM list
2024-03-21T01:10:02.930104878Z [2024-03-21 01:10:02,929: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:10:02.963618749Z [2024-03-21 01:10:02,963: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-21T01:10:02.965139996Z [2024-03-21 01:10:02,964: INFO/ForkPoolWorker-3] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:10:02.965351253Z [2024-03-21 01:10:02,965: INFO/ForkPoolWorker-3] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:10:02.965500071Z [2024-03-21 01:10:02,965: INFO/ForkPoolWorker-3] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:10:02.965562446Z [2024-03-21 01:10:02,965: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-03-21T01:10:02.965911727Z [2024-03-21 01:10:02,965: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:10:02.966004355Z [2024-03-21 01:10:02,965: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:10:03.075842680Z [2024-03-21 01:10:03,075: INFO/ForkPoolWorker-3] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:10:03.592242353Z [2024-03-21 01:10:03,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03de00b3-de20-4ddc-88eb-7742154246a3] received
2024-03-21T01:10:03.605395513Z [2024-03-21 01:10:03,605: INFO/ForkPoolWorker-16] [03de00b3-de20-4ddc-88eb-7742154246a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:10:03.650888804Z [2024-03-21 01:10:03,650: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4b10733a-4d8f-4d23-bd36-0965b071a80f] succeeded in 3.1995255689998885s: None
2024-03-21T01:10:03.897710766Z [2024-03-21 01:10:03,894: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:10:04.461651565Z [2024-03-21 01:10:04,461: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c1a61d21-d912-4b2e-ad76-3a0b9904af16] succeeded in 3.9982975679995434s: None
2024-03-21T01:10:05.031791987Z [2024-03-21 01:10:05,031: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[634c38b6-495a-4fe0-94af-fa52899ab7c2] succeeded in 4.5532053619999715s: None
2024-03-21T01:10:05.126612762Z [2024-03-21 01:10:05,126: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:10:05.130140301Z [2024-03-21 01:10:05,129: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:10:05.156625815Z [2024-03-21 01:10:05,156: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:10:05.158348071Z [2024-03-21 01:10:05,158: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:10:05.158427454Z [2024-03-21 01:10:05,158: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:10:05.158663490Z [2024-03-21 01:10:05,158: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:10:05.158782968Z [2024-03-21 01:10:05,158: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:10:05.159179992Z [2024-03-21 01:10:05,158: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:10:05.159260118Z [2024-03-21 01:10:05,159: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:10:05.249971529Z [2024-03-21 01:10:05,249: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T01:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:10:05.889466173Z [2024-03-21 01:10:05,888: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[03de00b3-de20-4ddc-88eb-7742154246a3] succeeded in 2.295132203999856s: None
2024-03-21T01:10:06.096944701Z [2024-03-21 01:10:06,096: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[248c2489-fd0c-4d76-8485-4d8af38d65d3] received
2024-03-21T01:10:06.105499831Z [2024-03-21 01:10:06,105: INFO/ForkPoolWorker-15] [248c2489-fd0c-4d76-8485-4d8af38d65d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T01:10:06.439522676Z [2024-03-21 01:10:06,436: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:10:07.568760579Z [2024-03-21 01:10:07,568: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:10:07.572442827Z [2024-03-21 01:10:07,571: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:10:07.589318250Z [2024-03-21 01:10:07,589: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:10:07.590634129Z [2024-03-21 01:10:07,590: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:10:07.590768393Z [2024-03-21 01:10:07,590: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:10:07.590947490Z [2024-03-21 01:10:07,590: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:10:07.591075991Z [2024-03-21 01:10:07,590: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:10:07.591391548Z [2024-03-21 01:10:07,591: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:10:07.591596176Z [2024-03-21 01:10:07,591: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:10:07.680971479Z [2024-03-21 01:10:07,680: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T01:05:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:10:08.194182918Z [2024-03-21 01:10:08,193: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[248c2489-fd0c-4d76-8485-4d8af38d65d3] succeeded in 2.0950145619999603s: None
2024-03-21T01:10:08.442401564Z [2024-03-21 01:10:08,441: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee24e776-c181-4439-9d84-fba365bb8b62] received
2024-03-21T01:10:08.451003786Z [2024-03-21 01:10:08,450: INFO/ForkPoolWorker-15] [ee24e776-c181-4439-9d84-fba365bb8b62] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:10:08.850753534Z [2024-03-21 01:10:08,847: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:10:09.997670997Z [2024-03-21 01:10:09,997: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:10:10.004518898Z [2024-03-21 01:10:10,003: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:10:10.021996627Z [2024-03-21 01:10:10,021: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:10:10.023083550Z [2024-03-21 01:10:10,022: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:10:10.023101208Z [2024-03-21 01:10:10,023: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:10:10.023217610Z [2024-03-21 01:10:10,023: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:10:10.023232795Z [2024-03-21 01:10:10,023: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:10:10.023574491Z [2024-03-21 01:10:10,023: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:10:10.023582468Z [2024-03-21 01:10:10,023: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:10:10.113034306Z [2024-03-21 01:10:10,112: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T01:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:10:10.702800983Z [2024-03-21 01:10:10,702: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ee24e776-c181-4439-9d84-fba365bb8b62] succeeded in 2.2576481000005515s: None
2024-03-21T01:11:00.514114055Z [2024-03-21 01:11:00,513: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd1cdf65-100f-4f15-9b01-b6b6105cc900] received
2024-03-21T01:11:00.517159755Z [2024-03-21 01:11:00,516: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e5bf836-5cf6-451e-8ffd-b08d82fa3869] received
2024-03-21T01:11:00.523787862Z [2024-03-21 01:11:00,523: INFO/ForkPoolWorker-15] [cd1cdf65-100f-4f15-9b01-b6b6105cc900] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:11:00.526287158Z [2024-03-21 01:11:00,526: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1324fd8-0583-4c15-acc2-9dde0a808460] received
2024-03-21T01:11:00.533622001Z [2024-03-21 01:11:00,533: INFO/ForkPoolWorker-1] [c1324fd8-0583-4c15-acc2-9dde0a808460] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:11:00.540825976Z [2024-03-21 01:11:00,540: INFO/ForkPoolWorker-16] [9e5bf836-5cf6-451e-8ffd-b08d82fa3869] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:11:00.867553871Z [2024-03-21 01:11:00,864: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:11:00.895959642Z [2024-03-21 01:11:00,892: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:11:00.916813261Z [2024-03-21 01:11:00,913: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:11:01.080224070Z [2024-03-21 01:11:01,079: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T01:11:01.084017318Z [2024-03-21 01:11:01,083: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:11:01.117373721Z [2024-03-21 01:11:01,117: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:11:01.119395661Z [2024-03-21 01:11:01,119: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:11:01.119465434Z [2024-03-21 01:11:01,119: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:11:01.119606124Z [2024-03-21 01:11:01,119: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T01:11:01.119868099Z [2024-03-21 01:11:01,119: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:11:01.239014058Z [2024-03-21 01:11:01,238: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:11:02.015738279Z [2024-03-21 01:11:02,015: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cd1cdf65-100f-4f15-9b01-b6b6105cc900] succeeded in 1.4988179410001976s: None
2024-03-21T01:11:02.054925867Z [2024-03-21 01:11:02,054: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:11:02.058580367Z [2024-03-21 01:11:02,058: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:11:02.084700391Z [2024-03-21 01:11:02,084: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:11:02.086203039Z [2024-03-21 01:11:02,085: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:11:02.086366076Z [2024-03-21 01:11:02,086: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:11:02.086590974Z [2024-03-21 01:11:02,086: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:11:02.086708410Z [2024-03-21 01:11:02,086: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:11:02.087007563Z [2024-03-21 01:11:02,086: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:11:02.087167689Z [2024-03-21 01:11:02,086: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:11:02.186667837Z [2024-03-21 01:11:02,186: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:11:02.320579995Z [2024-03-21 01:11:02,308: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:11:02.320612666Z [2024-03-21 01:11:02,312: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:11:02.407207878Z [2024-03-21 01:11:02,406: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:11:02.408976045Z [2024-03-21 01:11:02,408: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:11:02.408995804Z [2024-03-21 01:11:02,408: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:11:02.409211372Z [2024-03-21 01:11:02,408: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:11:02.409248422Z [2024-03-21 01:11:02,409: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:11:02.409519244Z [2024-03-21 01:11:02,409: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:11:02.409545427Z [2024-03-21 01:11:02,409: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:11:02.500882951Z [2024-03-21 01:11:02,500: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:11:04.453664129Z [2024-03-21 01:11:04,453: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c1324fd8-0583-4c15-acc2-9dde0a808460] succeeded in 3.9255405920002886s: None
2024-03-21T01:11:04.717244615Z [2024-03-21 01:11:04,716: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9e5bf836-5cf6-451e-8ffd-b08d82fa3869] succeeded in 4.197488553999392s: None
2024-03-21T01:12:00.468345991Z [2024-03-21 01:12:00,468: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4e9b1ca-18c1-4142-ae59-d6732793c0c7] received
2024-03-21T01:12:00.470144673Z [2024-03-21 01:12:00,469: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51b2772a-ff72-4adb-9726-e50004641539] received
2024-03-21T01:12:00.477053722Z [2024-03-21 01:12:00,476: INFO/ForkPoolWorker-16] [51b2772a-ff72-4adb-9726-e50004641539] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:12:00.481109563Z [2024-03-21 01:12:00,480: INFO/ForkPoolWorker-15] [f4e9b1ca-18c1-4142-ae59-d6732793c0c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:12:00.485542256Z [2024-03-21 01:12:00,485: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbafb3b5-2e08-471b-bd92-b3bee2d47466] received
2024-03-21T01:12:00.491220362Z [2024-03-21 01:12:00,490: INFO/ForkPoolWorker-1] [dbafb3b5-2e08-471b-bd92-b3bee2d47466] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:12:00.492526643Z [2024-03-21 01:12:00,490: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df84514a-55e2-4e52-b5f9-3397a2a2c7a5] received
2024-03-21T01:12:00.501370946Z [2024-03-21 01:12:00,501: INFO/ForkPoolWorker-2] [df84514a-55e2-4e52-b5f9-3397a2a2c7a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:12:00.827501835Z [2024-03-21 01:12:00,824: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:12:00.846267696Z [2024-03-21 01:12:00,842: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:12:00.859781087Z [2024-03-21 01:12:00,856: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:12:00.966148522Z [2024-03-21 01:12:00,962: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:12:01.080286190Z [2024-03-21 01:12:01,079: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:12:01.120165450Z [2024-03-21 01:12:01,119: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T01:12:01.126950311Z [2024-03-21 01:12:01,126: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:12:01.172967394Z [2024-03-21 01:12:01,172: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:12:01.178914151Z [2024-03-21 01:12:01,178: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:12:01.179649823Z [2024-03-21 01:12:01,178: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:12:01.179809100Z [2024-03-21 01:12:01,179: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T01:12:01.180072342Z [2024-03-21 01:12:01,179: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:12:01.271225634Z [2024-03-21 01:12:01,270: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:12:01.716573174Z [2024-03-21 01:12:01,716: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f4e9b1ca-18c1-4142-ae59-d6732793c0c7] succeeded in 1.2453179009999076s: None
2024-03-21T01:12:01.987165753Z [2024-03-21 01:12:01,986: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[51b2772a-ff72-4adb-9726-e50004641539] succeeded in 1.5157562760005021s: None
2024-03-21T01:12:02.220412983Z [2024-03-21 01:12:02,220: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T01:12:02.223661617Z [2024-03-21 01:12:02,223: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:12:02.236168603Z [2024-03-21 01:12:02,235: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:12:02.239913560Z [2024-03-21 01:12:02,239: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:12:02.252449814Z [2024-03-21 01:12:02,251: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:12:02.254538579Z [2024-03-21 01:12:02,254: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:12:02.254855716Z [2024-03-21 01:12:02,254: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:12:02.257207785Z [2024-03-21 01:12:02,254: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:12:02.257224391Z [2024-03-21 01:12:02,255: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T01:12:02.257230452Z [2024-03-21 01:12:02,255: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:12:02.257233818Z [2024-03-21 01:12:02,255: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:12:02.278728749Z [2024-03-21 01:12:02,276: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:12:02.279257557Z [2024-03-21 01:12:02,278: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:12:02.279273703Z [2024-03-21 01:12:02,278: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:12:02.279278348Z [2024-03-21 01:12:02,278: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:12:02.279290538Z [2024-03-21 01:12:02,278: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:12:02.279294041Z [2024-03-21 01:12:02,279: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:12:02.279297358Z [2024-03-21 01:12:02,279: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:12:02.440708647Z [2024-03-21 01:12:02,440: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:12:02.468359087Z [2024-03-21 01:12:02,468: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:12:04.152438910Z [2024-03-21 01:12:04,151: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dbafb3b5-2e08-471b-bd92-b3bee2d47466] succeeded in 3.6653013679997457s: None
2024-03-21T01:12:04.428531618Z [2024-03-21 01:12:04,427: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[df84514a-55e2-4e52-b5f9-3397a2a2c7a5] succeeded in 3.934103592999236s: None
2024-03-21T01:13:00.323038026Z [2024-03-21 01:13:00,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db30ebc0-14c9-47f6-a58b-f2c2bdf191c2] received
2024-03-21T01:13:00.331508972Z [2024-03-21 01:13:00,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6b1b336-9f59-4449-b6a7-3a159f9efc96] received
2024-03-21T01:13:00.334649177Z [2024-03-21 01:13:00,334: INFO/ForkPoolWorker-15] [db30ebc0-14c9-47f6-a58b-f2c2bdf191c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:13:00.340149640Z [2024-03-21 01:13:00,339: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f7777a0-4977-497b-b460-1a0a39f8c9a4] received
2024-03-21T01:13:00.340927748Z [2024-03-21 01:13:00,340: INFO/ForkPoolWorker-16] [b6b1b336-9f59-4449-b6a7-3a159f9efc96] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:13:00.355495195Z [2024-03-21 01:13:00,355: INFO/ForkPoolWorker-1] [3f7777a0-4977-497b-b460-1a0a39f8c9a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:13:00.628083399Z [2024-03-21 01:13:00,625: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:13:00.642373143Z [2024-03-21 01:13:00,639: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:13:00.644186479Z [2024-03-21 01:13:00,641: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:13:00.807817147Z [2024-03-21 01:13:00,807: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T01:13:00.811819365Z [2024-03-21 01:13:00,811: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:13:00.849329079Z [2024-03-21 01:13:00,849: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:13:00.852787986Z [2024-03-21 01:13:00,852: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:13:00.853082150Z [2024-03-21 01:13:00,852: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:13:00.853310899Z [2024-03-21 01:13:00,853: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T01:13:00.853736943Z [2024-03-21 01:13:00,853: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:13:00.991948995Z [2024-03-21 01:13:00,991: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:13:01.628084609Z [2024-03-21 01:13:01,627: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3f7777a0-4977-497b-b460-1a0a39f8c9a4] succeeded in 1.2852032380005767s: None
2024-03-21T01:13:01.766122116Z [2024-03-21 01:13:01,765: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:13:01.769869040Z [2024-03-21 01:13:01,769: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:13:01.786390691Z [2024-03-21 01:13:01,786: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:13:01.789876970Z [2024-03-21 01:13:01,789: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:13:01.793416713Z [2024-03-21 01:13:01,793: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:13:01.794790236Z [2024-03-21 01:13:01,794: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:13:01.794808997Z [2024-03-21 01:13:01,794: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:13:01.795085293Z [2024-03-21 01:13:01,794: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:13:01.795093654Z [2024-03-21 01:13:01,795: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:13:01.795518300Z [2024-03-21 01:13:01,795: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:13:01.795536211Z [2024-03-21 01:13:01,795: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:13:01.815640582Z [2024-03-21 01:13:01,815: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:13:01.821718859Z [2024-03-21 01:13:01,821: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:13:01.821756147Z [2024-03-21 01:13:01,821: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:13:01.822082863Z [2024-03-21 01:13:01,821: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:13:01.822320611Z [2024-03-21 01:13:01,821: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:13:01.822935012Z [2024-03-21 01:13:01,822: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:13:01.823044344Z [2024-03-21 01:13:01,822: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:13:01.882266169Z [2024-03-21 01:13:01,881: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:13:01.948982020Z [2024-03-21 01:13:01,948: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:13:03.849702264Z [2024-03-21 01:13:03,849: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b6b1b336-9f59-4449-b6a7-3a159f9efc96] succeeded in 3.515157195000029s: None
2024-03-21T01:13:04.330433183Z [2024-03-21 01:13:04,330: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[db30ebc0-14c9-47f6-a58b-f2c2bdf191c2] succeeded in 4.000752139999349s: None
2024-03-21T01:14:00.367430582Z [2024-03-21 01:14:00,366: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d80e8b2-fd4e-4dd5-b326-f6bd81ca31a5] received
2024-03-21T01:14:00.371668224Z [2024-03-21 01:14:00,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7fe9782c-a2e7-4772-837e-dd7d4d0f4eba] received
2024-03-21T01:14:00.375111992Z [2024-03-21 01:14:00,374: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab00e9f1-f3e1-42e0-8350-b4239fff200a] received
2024-03-21T01:14:00.377805558Z [2024-03-21 01:14:00,377: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28795c21-4efc-478d-9928-1e387dbef432] received
2024-03-21T01:14:00.385650085Z [2024-03-21 01:14:00,385: INFO/ForkPoolWorker-15] [4d80e8b2-fd4e-4dd5-b326-f6bd81ca31a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:14:00.386645244Z [2024-03-21 01:14:00,386: INFO/ForkPoolWorker-2] [28795c21-4efc-478d-9928-1e387dbef432] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:14:00.390198295Z [2024-03-21 01:14:00,389: INFO/ForkPoolWorker-16] [7fe9782c-a2e7-4772-837e-dd7d4d0f4eba] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:14:00.391084112Z [2024-03-21 01:14:00,390: INFO/ForkPoolWorker-1] [ab00e9f1-f3e1-42e0-8350-b4239fff200a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:14:00.684487486Z [2024-03-21 01:14:00,680: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:14:00.701694174Z [2024-03-21 01:14:00,698: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:14:00.727852449Z [2024-03-21 01:14:00,723: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:14:00.751085919Z [2024-03-21 01:14:00,747: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:14:00.970733565Z [2024-03-21 01:14:00,970: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T01:14:00.975329432Z [2024-03-21 01:14:00,974: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:14:01.017649582Z [2024-03-21 01:14:01,017: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:14:01.020060433Z [2024-03-21 01:14:01,019: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:14:01.020099278Z [2024-03-21 01:14:01,019: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:14:01.020161317Z [2024-03-21 01:14:01,020: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T01:14:01.020383143Z [2024-03-21 01:14:01,020: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:14:01.168855019Z [2024-03-21 01:14:01,168: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:14:01.173769884Z [2024-03-21 01:14:01,173: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:14:02.052038459Z [2024-03-21 01:14:02,051: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4d80e8b2-fd4e-4dd5-b326-f6bd81ca31a5] succeeded in 1.677015346999724s: None
2024-03-21T01:14:02.053861072Z [2024-03-21 01:14:02,053: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7fe9782c-a2e7-4772-837e-dd7d4d0f4eba] succeeded in 1.6800817999992432s: None
2024-03-21T01:14:02.394788937Z [2024-03-21 01:14:02,394: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T01:14:02.403664449Z [2024-03-21 01:14:02,402: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:14:02.509044980Z [2024-03-21 01:14:02,508: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:14:02.517421142Z [2024-03-21 01:14:02,517: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:14:02.517570067Z [2024-03-21 01:14:02,517: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:14:02.518320196Z [2024-03-21 01:14:02,517: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:14:02.518454415Z [2024-03-21 01:14:02,518: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T01:14:02.518818250Z [2024-03-21 01:14:02,518: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:14:02.519657194Z [2024-03-21 01:14:02,518: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:14:02.617807131Z [2024-03-21 01:14:02,617: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:14:02.622823606Z [2024-03-21 01:14:02,622: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:14:02.669621821Z [2024-03-21 01:14:02,669: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:14:02.672819043Z [2024-03-21 01:14:02,672: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:14:02.674108586Z [2024-03-21 01:14:02,673: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:14:02.674184853Z [2024-03-21 01:14:02,674: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:14:02.674344589Z [2024-03-21 01:14:02,674: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:14:02.674414017Z [2024-03-21 01:14:02,674: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:14:02.674863626Z [2024-03-21 01:14:02,674: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:14:02.674965193Z [2024-03-21 01:14:02,674: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:14:02.840054011Z [2024-03-21 01:14:02,839: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:14:06.353771874Z [2024-03-21 01:14:06,353: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ab00e9f1-f3e1-42e0-8350-b4239fff200a] succeeded in 5.975095028999931s: None
2024-03-21T01:14:06.565705678Z [2024-03-21 01:14:06,565: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[28795c21-4efc-478d-9928-1e387dbef432] succeeded in 6.185921563999727s: None
2024-03-21T01:15:00.330314488Z [2024-03-21 01:15:00,329: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de69adfc-a829-4df2-98d6-3b7456282dbd] received
2024-03-21T01:15:00.331699998Z [2024-03-21 01:15:00,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1e45de6-d0a2-4a54-8870-b1faa29f4b6c] received
2024-03-21T01:15:00.340335681Z [2024-03-21 01:15:00,340: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17f7e8f5-da65-47a3-8169-4d39242b6efa] received
2024-03-21T01:15:00.343097437Z [2024-03-21 01:15:00,342: INFO/ForkPoolWorker-16] [f1e45de6-d0a2-4a54-8870-b1faa29f4b6c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:15:00.348398768Z [2024-03-21 01:15:00,348: INFO/ForkPoolWorker-1] [17f7e8f5-da65-47a3-8169-4d39242b6efa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:15:00.350429273Z [2024-03-21 01:15:00,350: INFO/ForkPoolWorker-15] [de69adfc-a829-4df2-98d6-3b7456282dbd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:15:00.353971028Z [2024-03-21 01:15:00,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c7ff552-614b-4743-91dc-8ebb603b120f] received
2024-03-21T01:15:00.360142483Z [2024-03-21 01:15:00,359: INFO/ForkPoolWorker-2] [3c7ff552-614b-4743-91dc-8ebb603b120f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:15:00.689039656Z [2024-03-21 01:15:00,685: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:15:00.720219823Z [2024-03-21 01:15:00,716: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:15:00.721749286Z [2024-03-21 01:15:00,717: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:15:00.724783709Z [2024-03-21 01:15:00,721: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:15:00.968814782Z [2024-03-21 01:15:00,968: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T01:15:00.974242641Z [2024-03-21 01:15:00,973: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:15:01.024968435Z [2024-03-21 01:15:01,024: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:15:01.026542511Z [2024-03-21 01:15:01,026: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:15:01.026660939Z [2024-03-21 01:15:01,026: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:15:01.026725836Z [2024-03-21 01:15:01,026: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T01:15:01.026928652Z [2024-03-21 01:15:01,026: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:15:01.189709769Z [2024-03-21 01:15:01,189: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:15:01.845322601Z [2024-03-21 01:15:01,844: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[17f7e8f5-da65-47a3-8169-4d39242b6efa] succeeded in 1.502758827999969s: None
2024-03-21T01:15:02.084466129Z [2024-03-21 01:15:02,084: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:15:02.090212399Z [2024-03-21 01:15:02,089: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:15:02.122467056Z [2024-03-21 01:15:02,122: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:15:02.123863425Z [2024-03-21 01:15:02,123: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:15:02.123878295Z [2024-03-21 01:15:02,123: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:15:02.124061581Z [2024-03-21 01:15:02,123: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:15:02.124115872Z [2024-03-21 01:15:02,124: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:15:02.124578273Z [2024-03-21 01:15:02,124: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:15:02.124840419Z [2024-03-21 01:15:02,124: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:15:02.141535419Z [2024-03-21 01:15:02,141: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T01:15:02.154323250Z [2024-03-21 01:15:02,153: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:15:02.176556010Z [2024-03-21 01:15:02,176: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:15:02.182743901Z [2024-03-21 01:15:02,182: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:15:02.192071875Z [2024-03-21 01:15:02,191: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:15:02.193475102Z [2024-03-21 01:15:02,193: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:15:02.193492593Z [2024-03-21 01:15:02,193: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:15:02.193618714Z [2024-03-21 01:15:02,193: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:15:02.193631916Z [2024-03-21 01:15:02,193: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T01:15:02.193955925Z [2024-03-21 01:15:02,193: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:15:02.193966056Z [2024-03-21 01:15:02,193: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:15:02.214474589Z [2024-03-21 01:15:02,214: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T01:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:15:02.216733481Z [2024-03-21 01:15:02,216: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:15:02.218899959Z [2024-03-21 01:15:02,218: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:15:02.219132820Z [2024-03-21 01:15:02,218: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:15:02.219452063Z [2024-03-21 01:15:02,219: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:15:02.219723835Z [2024-03-21 01:15:02,219: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:15:02.221024078Z [2024-03-21 01:15:02,220: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:15:02.221233625Z [2024-03-21 01:15:02,221: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:15:02.330659412Z [2024-03-21 01:15:02,329: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:15:02.472759216Z [2024-03-21 01:15:02,472: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:15:03.103855961Z [2024-03-21 01:15:03,103: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[de69adfc-a829-4df2-98d6-3b7456282dbd] succeeded in 2.7708570780005175s: None
2024-03-21T01:15:03.242464463Z [2024-03-21 01:15:03,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f2941f7-045b-4021-a941-0a122183b7d2] received
2024-03-21T01:15:03.255206322Z [2024-03-21 01:15:03,254: INFO/ForkPoolWorker-15] [9f2941f7-045b-4021-a941-0a122183b7d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:15:03.618729536Z [2024-03-21 01:15:03,615: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:15:03.998107927Z [2024-03-21 01:15:03,997: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f1e45de6-d0a2-4a54-8870-b1faa29f4b6c] succeeded in 3.665196878999268s: None
2024-03-21T01:15:04.817427946Z [2024-03-21 01:15:04,817: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:15:04.821135902Z [2024-03-21 01:15:04,820: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:15:04.844953941Z [2024-03-21 01:15:04,844: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:15:04.849845291Z [2024-03-21 01:15:04,849: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:15:04.850290875Z [2024-03-21 01:15:04,849: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:15:04.850746347Z [2024-03-21 01:15:04,850: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:15:04.851031044Z [2024-03-21 01:15:04,850: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:15:04.851674464Z [2024-03-21 01:15:04,851: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:15:04.851882035Z [2024-03-21 01:15:04,851: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:15:04.942009448Z [2024-03-21 01:15:04,941: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T01:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:15:05.154712636Z [2024-03-21 01:15:05,154: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3c7ff552-614b-4743-91dc-8ebb603b120f] succeeded in 4.799053069000365s: None
2024-03-21T01:15:05.609921087Z [2024-03-21 01:15:05,609: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9f2941f7-045b-4021-a941-0a122183b7d2] succeeded in 2.3655897560001904s: None
2024-03-21T01:15:06.089253583Z [2024-03-21 01:15:06,087: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0693d09-54ce-4171-ab88-f82a1227bf6d] received
2024-03-21T01:15:06.110486949Z [2024-03-21 01:15:06,110: INFO/ForkPoolWorker-15] [f0693d09-54ce-4171-ab88-f82a1227bf6d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T01:15:06.386467287Z [2024-03-21 01:15:06,383: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:15:07.543789880Z [2024-03-21 01:15:07,543: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:15:07.547325046Z [2024-03-21 01:15:07,546: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:15:07.568436105Z [2024-03-21 01:15:07,568: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:15:07.570637675Z [2024-03-21 01:15:07,570: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:15:07.570658472Z [2024-03-21 01:15:07,570: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:15:07.570820563Z [2024-03-21 01:15:07,570: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:15:07.570936219Z [2024-03-21 01:15:07,570: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:15:07.571379717Z [2024-03-21 01:15:07,571: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:15:07.571575928Z [2024-03-21 01:15:07,571: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:15:07.654923850Z [2024-03-21 01:15:07,654: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T01:10:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:15:08.188421064Z [2024-03-21 01:15:08,186: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f0693d09-54ce-4171-ab88-f82a1227bf6d] succeeded in 2.093278277000536s: None
2024-03-21T01:15:08.411637717Z [2024-03-21 01:15:08,411: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc9e4606-6386-411b-904d-ddef7395caeb] received
2024-03-21T01:15:08.418123534Z [2024-03-21 01:15:08,417: INFO/ForkPoolWorker-15] [fc9e4606-6386-411b-904d-ddef7395caeb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:15:08.766713459Z [2024-03-21 01:15:08,763: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:15:10.139215262Z [2024-03-21 01:15:10,138: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:15:10.142880566Z [2024-03-21 01:15:10,142: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:15:10.178439603Z [2024-03-21 01:15:10,178: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:15:10.180288978Z [2024-03-21 01:15:10,180: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:15:10.180589420Z [2024-03-21 01:15:10,180: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:15:10.180900593Z [2024-03-21 01:15:10,180: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:15:10.181098075Z [2024-03-21 01:15:10,180: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:15:10.181489360Z [2024-03-21 01:15:10,181: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:15:10.182057425Z [2024-03-21 01:15:10,181: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:15:10.313794668Z [2024-03-21 01:15:10,313: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T01:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:15:10.991454731Z [2024-03-21 01:15:10,990: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fc9e4606-6386-411b-904d-ddef7395caeb] succeeded in 2.5783290330000455s: None
2024-03-21T01:16:01.297169802Z [2024-03-21 01:16:01,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54bcc92b-7b41-4c0e-9d34-c7f41e395dd3] received
2024-03-21T01:16:01.301427087Z [2024-03-21 01:16:01,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fef5434d-078f-4115-bcab-5d47401bc50a] received
2024-03-21T01:16:01.310594041Z [2024-03-21 01:16:01,310: INFO/ForkPoolWorker-15] [54bcc92b-7b41-4c0e-9d34-c7f41e395dd3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:16:01.313121768Z [2024-03-21 01:16:01,312: INFO/ForkPoolWorker-16] [fef5434d-078f-4115-bcab-5d47401bc50a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:16:01.323038998Z [2024-03-21 01:16:01,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cdb0c2e9-1313-4a37-b37f-5f6906996a8e] received
2024-03-21T01:16:01.325211278Z [2024-03-21 01:16:01,324: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fa6ab45-0b51-4c24-bdfe-8e235bead792] received
2024-03-21T01:16:01.346765765Z [2024-03-21 01:16:01,342: INFO/ForkPoolWorker-1] [cdb0c2e9-1313-4a37-b37f-5f6906996a8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:16:01.363448534Z [2024-03-21 01:16:01,362: INFO/ForkPoolWorker-2] [9fa6ab45-0b51-4c24-bdfe-8e235bead792] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:16:01.632820548Z [2024-03-21 01:16:01,629: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:16:01.846597661Z [2024-03-21 01:16:01,842: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:16:01.854548173Z [2024-03-21 01:16:01,850: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:16:01.915301834Z [2024-03-21 01:16:01,906: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:16:01.931265738Z [2024-03-21 01:16:01,930: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:16:02.045295987Z [2024-03-21 01:16:02,044: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T01:16:02.050102641Z [2024-03-21 01:16:02,049: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:16:02.095042127Z [2024-03-21 01:16:02,094: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:16:02.096524606Z [2024-03-21 01:16:02,096: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:16:02.096544864Z [2024-03-21 01:16:02,096: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:16:02.096637855Z [2024-03-21 01:16:02,096: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T01:16:02.096915746Z [2024-03-21 01:16:02,096: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:16:02.212447386Z [2024-03-21 01:16:02,211: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:16:02.751832044Z [2024-03-21 01:16:02,751: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[54bcc92b-7b41-4c0e-9d34-c7f41e395dd3] succeeded in 1.451250611999967s: None
2024-03-21T01:16:03.120432301Z [2024-03-21 01:16:03,119: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fef5434d-078f-4115-bcab-5d47401bc50a] succeeded in 1.816432481999982s: None
2024-03-21T01:16:03.663898817Z [2024-03-21 01:16:03,663: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:16:03.667484311Z [2024-03-21 01:16:03,666: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:16:03.688555998Z [2024-03-21 01:16:03,688: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:16:03.690057831Z [2024-03-21 01:16:03,689: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:16:03.690076643Z [2024-03-21 01:16:03,689: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:16:03.690199714Z [2024-03-21 01:16:03,690: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:16:03.690238650Z [2024-03-21 01:16:03,690: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:16:03.690500144Z [2024-03-21 01:16:03,690: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:16:03.690651404Z [2024-03-21 01:16:03,690: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:16:03.782596080Z [2024-03-21 01:16:03,782: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:16:03.785156327Z [2024-03-21 01:16:03,784: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T01:16:03.788573681Z [2024-03-21 01:16:03,788: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:16:03.810227965Z [2024-03-21 01:16:03,810: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:16:03.811410802Z [2024-03-21 01:16:03,811: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:16:03.811554268Z [2024-03-21 01:16:03,811: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:16:03.811751412Z [2024-03-21 01:16:03,811: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:16:03.811762726Z [2024-03-21 01:16:03,811: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T01:16:03.812014154Z [2024-03-21 01:16:03,811: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:16:03.812129563Z [2024-03-21 01:16:03,812: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:16:03.917456402Z [2024-03-21 01:16:03,917: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:16:07.811336445Z [2024-03-21 01:16:07,810: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cdb0c2e9-1313-4a37-b37f-5f6906996a8e] succeeded in 6.482586979000189s: None
2024-03-21T01:16:09.195778700Z [2024-03-21 01:16:09,195: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9fa6ab45-0b51-4c24-bdfe-8e235bead792] succeeded in 7.8659896760000265s: None
2024-03-21T01:16:42.525821327Z [2024-03-21 01:16:42,525: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bbd9559-d1b3-4f91-832d-165f6eb3525f] received
2024-03-21T01:16:42.532302583Z [2024-03-21 01:16:42,532: INFO/ForkPoolWorker-15] [9bbd9559-d1b3-4f91-832d-165f6eb3525f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:16:42.831411474Z [2024-03-21 01:16:42,828: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:16:42.996864892Z [2024-03-21 01:16:42,996: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T01:16:43.012132805Z [2024-03-21 01:16:43,011: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:16:43.029967063Z [2024-03-21 01:16:43,029: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:16:43.030925743Z [2024-03-21 01:16:43,030: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:16:43.030939196Z [2024-03-21 01:16:43,030: INFO/ForkPoolWorker-15] Read SDNC d6222687-71a3-4a78-9eae-f1a0289509d5 (epa_03)
2024-03-21T01:16:43.031082845Z [2024-03-21 01:16:43,030: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': 'd6222687-71a3-4a78-9eae-f1a0289509d5', 'name': 'epa_03', 'type': 'onos_vpls'}]
2024-03-21T01:16:43.031143036Z [2024-03-21 01:16:43,031: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T01:16:43.031426922Z [2024-03-21 01:16:43,031: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:16:43.038304202Z [2024-03-21 01:16:43,038: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5
2024-03-21T01:16:43.108711007Z [2024-03-21 01:16:43,108: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:16:43.648432726Z [2024-03-21 01:16:43,647: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9bbd9559-d1b3-4f91-832d-165f6eb3525f] succeeded in 1.1202679889993306s: None
2024-03-21T01:17:00.919396002Z [2024-03-21 01:17:00,919: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[423fd28d-368d-4a00-bb36-a5a5d8012131] received
2024-03-21T01:17:00.925547351Z [2024-03-21 01:17:00,923: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f218d33-27cf-4f04-a0b4-2d2c4a02c030] received
2024-03-21T01:17:00.929104595Z [2024-03-21 01:17:00,928: INFO/ForkPoolWorker-15] [423fd28d-368d-4a00-bb36-a5a5d8012131] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:17:00.934141043Z [2024-03-21 01:17:00,933: INFO/ForkPoolWorker-16] [0f218d33-27cf-4f04-a0b4-2d2c4a02c030] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:17:00.936169065Z [2024-03-21 01:17:00,935: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b5b5f87-aa06-4075-955e-739f25685c4d] received
2024-03-21T01:17:00.939098234Z [2024-03-21 01:17:00,938: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f514b113-bd61-408d-8695-ca4b06a7dd8e] received
2024-03-21T01:17:00.945521928Z [2024-03-21 01:17:00,945: INFO/ForkPoolWorker-1] [2b5b5f87-aa06-4075-955e-739f25685c4d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:17:00.947303528Z [2024-03-21 01:17:00,947: INFO/ForkPoolWorker-2] [f514b113-bd61-408d-8695-ca4b06a7dd8e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:17:01.359342647Z [2024-03-21 01:17:01,356: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:17:01.362089387Z [2024-03-21 01:17:01,354: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:17:01.362118787Z [2024-03-21 01:17:01,357: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:17:01.443107787Z [2024-03-21 01:17:01,427: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:17:01.556136582Z [2024-03-21 01:17:01,555: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T01:17:01.560490129Z [2024-03-21 01:17:01,559: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:17:01.579977818Z [2024-03-21 01:17:01,579: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T01:17:01.587161555Z [2024-03-21 01:17:01,586: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:17:01.588190259Z [2024-03-21 01:17:01,587: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:17:01.590725582Z [2024-03-21 01:17:01,590: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:17:01.590973246Z [2024-03-21 01:17:01,590: INFO/ForkPoolWorker-1] Read SDNC d6222687-71a3-4a78-9eae-f1a0289509d5 (epa_03)
2024-03-21T01:17:01.591196583Z [2024-03-21 01:17:01,590: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': 'd6222687-71a3-4a78-9eae-f1a0289509d5', 'name': 'epa_03', 'type': 'onos_vpls'}]
2024-03-21T01:17:01.591303371Z [2024-03-21 01:17:01,591: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T01:17:01.591839480Z [2024-03-21 01:17:01,591: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:17:01.602499981Z [2024-03-21 01:17:01,602: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5
2024-03-21T01:17:01.626201234Z [2024-03-21 01:17:01,625: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:17:01.628029645Z [2024-03-21 01:17:01,627: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:17:01.628259799Z [2024-03-21 01:17:01,627: INFO/ForkPoolWorker-2] Read SDNC d6222687-71a3-4a78-9eae-f1a0289509d5 (epa_03)
2024-03-21T01:17:01.629542125Z [2024-03-21 01:17:01,629: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': 'd6222687-71a3-4a78-9eae-f1a0289509d5', 'name': 'epa_03', 'type': 'onos_vpls'}]
2024-03-21T01:17:01.629902848Z [2024-03-21 01:17:01,629: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T01:17:01.630321710Z [2024-03-21 01:17:01,630: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:17:01.640171778Z [2024-03-21 01:17:01,639: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5
2024-03-21T01:17:01.692328843Z [2024-03-21 01:17:01,692: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:17:01.781518934Z [2024-03-21 01:17:01,781: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:17:02.539051729Z [2024-03-21 01:17:02,538: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2b5b5f87-aa06-4075-955e-739f25685c4d] succeeded in 1.59987802500018s: None
2024-03-21T01:17:02.620892129Z [2024-03-21 01:17:02,620: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f514b113-bd61-408d-8695-ca4b06a7dd8e] succeeded in 1.6779974919991218s: None
2024-03-21T01:17:02.970474544Z [2024-03-21 01:17:02,970: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:17:02.974120110Z [2024-03-21 01:17:02,973: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:17:02.990953606Z [2024-03-21 01:17:02,990: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:17:02.995312188Z [2024-03-21 01:17:02,995: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:17:02.995689724Z [2024-03-21 01:17:02,995: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:17:02.997231888Z [2024-03-21 01:17:02,996: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:17:02.997356506Z [2024-03-21 01:17:02,997: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:17:02.997602496Z [2024-03-21 01:17:02,997: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:17:02.997663732Z [2024-03-21 01:17:02,997: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:17:02.998068480Z [2024-03-21 01:17:02,997: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:17:02.998195761Z [2024-03-21 01:17:02,998: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:17:03.017101033Z [2024-03-21 01:17:03,016: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:17:03.018473835Z [2024-03-21 01:17:03,018: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:17:03.018646049Z [2024-03-21 01:17:03,018: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:17:03.018875963Z [2024-03-21 01:17:03,018: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:17:03.018972476Z [2024-03-21 01:17:03,018: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:17:03.019391902Z [2024-03-21 01:17:03,019: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:17:03.019499745Z [2024-03-21 01:17:03,019: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:17:03.111987097Z [2024-03-21 01:17:03,111: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:17:03.113083094Z [2024-03-21 01:17:03,112: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:17:04.957927462Z [2024-03-21 01:17:04,957: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[423fd28d-368d-4a00-bb36-a5a5d8012131] succeeded in 4.03682810600003s: None
2024-03-21T01:17:05.367802045Z [2024-03-21 01:17:05,367: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0f218d33-27cf-4f04-a0b4-2d2c4a02c030] succeeded in 4.438160823000544s: None
2024-03-21T01:18:00.528699697Z [2024-03-21 01:18:00,528: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ffa4b73-8128-4639-abec-1b5a989dddb5] received
2024-03-21T01:18:00.532596648Z [2024-03-21 01:18:00,532: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ae424ea-c8d7-42b9-97a0-51fd05cce77d] received
2024-03-21T01:18:00.536688719Z [2024-03-21 01:18:00,536: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08b2831c-a9f4-4cbd-b8a3-ec36f5225d09] received
2024-03-21T01:18:00.540696611Z [2024-03-21 01:18:00,540: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[899e8a95-2257-4d6e-9ffd-c790ba9163a2] received
2024-03-21T01:18:00.550102109Z [2024-03-21 01:18:00,549: INFO/ForkPoolWorker-2] [899e8a95-2257-4d6e-9ffd-c790ba9163a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:18:00.551862197Z [2024-03-21 01:18:00,551: INFO/ForkPoolWorker-1] [08b2831c-a9f4-4cbd-b8a3-ec36f5225d09] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:18:00.553364478Z [2024-03-21 01:18:00,553: INFO/ForkPoolWorker-16] [6ae424ea-c8d7-42b9-97a0-51fd05cce77d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:18:00.554396179Z [2024-03-21 01:18:00,552: INFO/ForkPoolWorker-15] [5ffa4b73-8128-4639-abec-1b5a989dddb5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:18:00.560011123Z [2024-03-21 01:18:00,559: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2caa3d62-d26f-4edb-a924-06fddecaeab1] received
2024-03-21T01:18:00.579110865Z [2024-03-21 01:18:00,578: INFO/ForkPoolWorker-3] [2caa3d62-d26f-4edb-a924-06fddecaeab1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:18:00.963109035Z [2024-03-21 01:18:00,959: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:18:00.993855595Z [2024-03-21 01:18:00,990: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:18:01.060201549Z [2024-03-21 01:18:01,057: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:18:01.096728547Z [2024-03-21 01:18:01,067: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:18:01.306740154Z [2024-03-21 01:18:01,297: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:18:01.355295666Z [2024-03-21 01:18:01,355: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:18:01.862865802Z [2024-03-21 01:18:01,862: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T01:18:01.870763032Z [2024-03-21 01:18:01,870: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:18:01.941001960Z [2024-03-21 01:18:01,940: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:18:01.942706271Z [2024-03-21 01:18:01,942: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:18:01.942917014Z [2024-03-21 01:18:01,942: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:18:01.943083182Z [2024-03-21 01:18:01,942: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T01:18:01.943901064Z [2024-03-21 01:18:01,943: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:18:01.949658161Z [2024-03-21 01:18:01,949: INFO/ForkPoolWorker-3] Getting SDNC list
2024-03-21T01:18:01.958163711Z [2024-03-21 01:18:01,957: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:18:01.959544781Z [2024-03-21 01:18:01,959: WARNING/ForkPoolWorker-1] Dag 'sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:18:01.960034939Z [2024-03-21 01:18:01,959: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:18:01.961448510Z [2024-03-21 01:18:01,961: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T01:18:01.965528080Z [2024-03-21 01:18:01,965: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:18:01.999658581Z [2024-03-21 01:18:01,999: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:18:02.005755767Z [2024-03-21 01:18:02,005: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:18:02.005783406Z [2024-03-21 01:18:02,005: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-21T01:18:02.006208148Z [2024-03-21 01:18:02,005: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:18:02.006408681Z [2024-03-21 01:18:02,006: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T01:18:02.006790615Z [2024-03-21 01:18:02,006: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:18:02.008071176Z [2024-03-21 01:18:02,007: INFO/ForkPoolWorker-3] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:18:02.008159621Z [2024-03-21 01:18:02,007: INFO/ForkPoolWorker-3] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:18:02.008199904Z [2024-03-21 01:18:02,008: INFO/ForkPoolWorker-3] Getting SDNC list OK
2024-03-21T01:18:02.008503473Z [2024-03-21 01:18:02,008: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:18:02.013034067Z [2024-03-21 01:18:02,012: ERROR/ForkPoolWorker-1] [08b2831c-a9f4-4cbd-b8a3-ec36f5225d09] Failed to execute task Dag 'sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5' could not be found; either it does not exist or it failed to parse..
2024-03-21T01:18:02.013056036Z Traceback (most recent call last):
2024-03-21T01:18:02.013061137Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-21T01:18:02.013065425Z     args.func(args)
2024-03-21T01:18:02.013069774Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-21T01:18:02.013073624Z     return func(*args, **kwargs)
2024-03-21T01:18:02.013076924Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-21T01:18:02.013080535Z     return f(*args, **kwargs)
2024-03-21T01:18:02.013083829Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-21T01:18:02.013087120Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-21T01:18:02.013090417Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-21T01:18:02.013093825Z     raise AirflowException(
2024-03-21T01:18:02.013100192Z airflow.exceptions.AirflowException: Dag 'sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5' could not be found; either it does not exist or it failed to parse.
2024-03-21T01:18:02.055124228Z [2024-03-21 01:18:02,054: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[08b2831c-a9f4-4cbd-b8a3-ec36f5225d09] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 08b2831c-a9f4-4cbd-b8a3-ec36f5225d09')
2024-03-21T01:18:02.055159588Z Traceback (most recent call last):
2024-03-21T01:18:02.055165930Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-21T01:18:02.055170938Z     R = retval = fun(*args, **kwargs)
2024-03-21T01:18:02.055194550Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-21T01:18:02.055199666Z     return self.run(*args, **kwargs)
2024-03-21T01:18:02.055205668Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-21T01:18:02.055211905Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-21T01:18:02.055217536Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-21T01:18:02.055223888Z     raise AirflowException(msg)
2024-03-21T01:18:02.055230091Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 08b2831c-a9f4-4cbd-b8a3-ec36f5225d09
2024-03-21T01:18:02.189452331Z [2024-03-21 01:18:02,189: INFO/ForkPoolWorker-3] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:18:02.407361384Z [2024-03-21 01:18:02,406: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5ffa4b73-8128-4639-abec-1b5a989dddb5] succeeded in 1.8761303390001558s: None
2024-03-21T01:18:02.663571527Z [2024-03-21 01:18:02,663: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T01:18:02.677959761Z [2024-03-21 01:18:02,676: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:18:02.708349226Z [2024-03-21 01:18:02,708: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:18:02.710216698Z [2024-03-21 01:18:02,709: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:18:02.710261229Z [2024-03-21 01:18:02,710: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:18:02.710599391Z [2024-03-21 01:18:02,710: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:18:02.710706529Z [2024-03-21 01:18:02,710: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T01:18:02.711516698Z [2024-03-21 01:18:02,711: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:18:02.711694266Z [2024-03-21 01:18:02,711: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:18:02.858132526Z [2024-03-21 01:18:02,857: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:18:03.052458191Z [2024-03-21 01:18:03,052: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:18:03.056506877Z [2024-03-21 01:18:03,055: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:18:03.073986337Z [2024-03-21 01:18:03,073: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[2caa3d62-d26f-4edb-a924-06fddecaeab1] succeeded in 2.511551796999811s: None
2024-03-21T01:18:03.080774017Z [2024-03-21 01:18:03,080: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:18:03.081932115Z [2024-03-21 01:18:03,081: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:18:03.081946324Z [2024-03-21 01:18:03,081: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:18:03.082067765Z [2024-03-21 01:18:03,081: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:18:03.082074758Z [2024-03-21 01:18:03,082: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:18:03.082293227Z [2024-03-21 01:18:03,082: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:18:03.082386814Z [2024-03-21 01:18:03,082: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:18:03.185253385Z [2024-03-21 01:18:03,184: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:18:04.498676646Z [2024-03-21 01:18:04,498: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[899e8a95-2257-4d6e-9ffd-c790ba9163a2] succeeded in 3.9560521120001795s: None
2024-03-21T01:18:05.362628884Z [2024-03-21 01:18:05,362: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6ae424ea-c8d7-42b9-97a0-51fd05cce77d] succeeded in 4.827812100999836s: None
2024-03-21T01:18:12.447031909Z [2024-03-21 01:18:12,446: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0083f791-4b56-46ce-899b-452428f1108b] received
2024-03-21T01:18:12.456434770Z [2024-03-21 01:18:12,455: INFO/ForkPoolWorker-15] [0083f791-4b56-46ce-899b-452428f1108b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:18:12.725129975Z [2024-03-21 01:18:12,721: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:18:12.881130024Z [2024-03-21 01:18:12,880: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T01:18:12.886794996Z [2024-03-21 01:18:12,886: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:18:12.904399728Z [2024-03-21 01:18:12,903: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:18:12.905930713Z [2024-03-21 01:18:12,905: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:18:12.906129015Z [2024-03-21 01:18:12,905: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:18:12.906238438Z [2024-03-21 01:18:12,906: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T01:18:12.906502464Z [2024-03-21 01:18:12,906: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:18:12.914971676Z [2024-03-21 01:18:12,914: WARNING/ForkPoolWorker-15] Dag 'sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:18:12.915235998Z [2024-03-21 01:18:12,915: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:18:12.916028516Z [2024-03-21 01:18:12,915: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T01:18:12.918862303Z [2024-03-21 01:18:12,918: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:18:12.932503156Z [2024-03-21 01:18:12,932: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:18:12.934118718Z [2024-03-21 01:18:12,933: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:18:12.934448436Z [2024-03-21 01:18:12,934: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:18:12.934682513Z [2024-03-21 01:18:12,934: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T01:18:12.935138642Z [2024-03-21 01:18:12,934: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:18:12.942329215Z [2024-03-21 01:18:12,941: ERROR/ForkPoolWorker-15] [0083f791-4b56-46ce-899b-452428f1108b] Failed to execute task Dag 'sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5' could not be found; either it does not exist or it failed to parse..
2024-03-21T01:18:12.942350514Z Traceback (most recent call last):
2024-03-21T01:18:12.942355721Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-21T01:18:12.942360713Z     args.func(args)
2024-03-21T01:18:12.942365731Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-21T01:18:12.942370282Z     return func(*args, **kwargs)
2024-03-21T01:18:12.942374365Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-21T01:18:12.942378578Z     return f(*args, **kwargs)
2024-03-21T01:18:12.942382824Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-21T01:18:12.942386865Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-21T01:18:12.942390906Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-21T01:18:12.942395235Z     raise AirflowException(
2024-03-21T01:18:12.942400011Z airflow.exceptions.AirflowException: Dag 'sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5' could not be found; either it does not exist or it failed to parse.
2024-03-21T01:18:12.962484840Z [2024-03-21 01:18:12,961: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0083f791-4b56-46ce-899b-452428f1108b] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0083f791-4b56-46ce-899b-452428f1108b')
2024-03-21T01:18:12.962507931Z Traceback (most recent call last):
2024-03-21T01:18:12.962513502Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-21T01:18:12.962517781Z     R = retval = fun(*args, **kwargs)
2024-03-21T01:18:12.962521743Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-21T01:18:12.962525882Z     return self.run(*args, **kwargs)
2024-03-21T01:18:12.962530779Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-21T01:18:12.962550662Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-21T01:18:12.962554854Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-21T01:18:12.962559518Z     raise AirflowException(msg)
2024-03-21T01:18:12.962564223Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0083f791-4b56-46ce-899b-452428f1108b
2024-03-21T01:19:00.416490224Z [2024-03-21 01:19:00,416: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f64b3225-ded8-4c0f-9384-bb8ce726acfa] received
2024-03-21T01:19:00.419498002Z [2024-03-21 01:19:00,419: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a44e8f9f-f03b-430b-8dc3-e7fae1780551] received
2024-03-21T01:19:00.427194689Z [2024-03-21 01:19:00,426: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31a5fa22-6857-4528-b09f-aa494ed41e6a] received
2024-03-21T01:19:00.431115510Z [2024-03-21 01:19:00,430: INFO/ForkPoolWorker-16] [a44e8f9f-f03b-430b-8dc3-e7fae1780551] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:19:00.434401255Z [2024-03-21 01:19:00,434: INFO/ForkPoolWorker-1] [31a5fa22-6857-4528-b09f-aa494ed41e6a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:19:00.436882763Z [2024-03-21 01:19:00,436: INFO/ForkPoolWorker-15] [f64b3225-ded8-4c0f-9384-bb8ce726acfa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:19:00.441655466Z [2024-03-21 01:19:00,441: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0e9ae44-296e-4619-980c-c3c60dbf4019] received
2024-03-21T01:19:00.450205624Z [2024-03-21 01:19:00,449: INFO/ForkPoolWorker-2] [f0e9ae44-296e-4619-980c-c3c60dbf4019] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:19:00.736786766Z [2024-03-21 01:19:00,733: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:19:00.755128882Z [2024-03-21 01:19:00,752: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:19:00.862914411Z [2024-03-21 01:19:00,858: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:19:00.901848171Z [2024-03-21 01:19:00,898: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:19:00.957663480Z [2024-03-21 01:19:00,957: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T01:19:00.961823185Z [2024-03-21 01:19:00,961: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:19:00.985798251Z [2024-03-21 01:19:00,985: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:19:00.988639226Z [2024-03-21 01:19:00,988: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:19:00.988792975Z [2024-03-21 01:19:00,988: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:19:00.988885462Z [2024-03-21 01:19:00,988: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T01:19:00.989206478Z [2024-03-21 01:19:00,989: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:19:01.039583348Z [2024-03-21 01:19:01,039: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T01:19:01.044225871Z [2024-03-21 01:19:01,043: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:19:01.087863843Z [2024-03-21 01:19:01,087: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:19:01.089496328Z [2024-03-21 01:19:01,089: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:19:01.089652205Z [2024-03-21 01:19:01,089: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:19:01.089712491Z [2024-03-21 01:19:01,089: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T01:19:01.089911063Z [2024-03-21 01:19:01,089: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:19:01.100772522Z [2024-03-21 01:19:01,100: WARNING/ForkPoolWorker-1] Dag 'sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:19:01.101099252Z [2024-03-21 01:19:01,100: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:19:01.102180662Z [2024-03-21 01:19:01,101: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T01:19:01.105057868Z [2024-03-21 01:19:01,104: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:19:01.126008243Z [2024-03-21 01:19:01,125: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:19:01.127136578Z [2024-03-21 01:19:01,126: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:19:01.127279045Z [2024-03-21 01:19:01,127: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:19:01.127323765Z [2024-03-21 01:19:01,127: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T01:19:01.127664683Z [2024-03-21 01:19:01,127: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:19:01.131602341Z [2024-03-21 01:19:01,130: ERROR/ForkPoolWorker-1] [31a5fa22-6857-4528-b09f-aa494ed41e6a] Failed to execute task Dag 'sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5' could not be found; either it does not exist or it failed to parse..
2024-03-21T01:19:01.131631392Z Traceback (most recent call last):
2024-03-21T01:19:01.131658685Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-21T01:19:01.131662581Z     args.func(args)
2024-03-21T01:19:01.131666725Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-21T01:19:01.131670506Z     return func(*args, **kwargs)
2024-03-21T01:19:01.131673572Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-21T01:19:01.131676565Z     return f(*args, **kwargs)
2024-03-21T01:19:01.131679704Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-21T01:19:01.131687687Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-21T01:19:01.131690875Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-21T01:19:01.131693922Z     raise AirflowException(
2024-03-21T01:19:01.131698055Z airflow.exceptions.AirflowException: Dag 'sdnc_status_d6222687-71a3-4a78-9eae-f1a0289509d5' could not be found; either it does not exist or it failed to parse.
2024-03-21T01:19:01.138824199Z [2024-03-21 01:19:01,138: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:19:01.160980331Z [2024-03-21 01:19:01,160: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[31a5fa22-6857-4528-b09f-aa494ed41e6a] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 31a5fa22-6857-4528-b09f-aa494ed41e6a')
2024-03-21T01:19:01.161004118Z Traceback (most recent call last):
2024-03-21T01:19:01.161008763Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-21T01:19:01.161012013Z     R = retval = fun(*args, **kwargs)
2024-03-21T01:19:01.161015646Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-21T01:19:01.161019051Z     return self.run(*args, **kwargs)
2024-03-21T01:19:01.161023398Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-21T01:19:01.161027488Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-21T01:19:01.161030928Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-21T01:19:01.161034759Z     raise AirflowException(msg)
2024-03-21T01:19:01.161043483Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 31a5fa22-6857-4528-b09f-aa494ed41e6a
2024-03-21T01:19:01.837394631Z [2024-03-21 01:19:01,836: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f64b3225-ded8-4c0f-9384-bb8ce726acfa] succeeded in 1.4172329429993624s: None
2024-03-21T01:19:02.300567887Z [2024-03-21 01:19:02,293: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:19:02.300601377Z [2024-03-21 01:19:02,297: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:19:02.353048334Z [2024-03-21 01:19:02,347: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:19:02.353089791Z [2024-03-21 01:19:02,349: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:19:02.353096469Z [2024-03-21 01:19:02,349: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:19:02.353102723Z [2024-03-21 01:19:02,349: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:19:02.353121295Z [2024-03-21 01:19:02,349: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:19:02.353126534Z [2024-03-21 01:19:02,350: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:19:02.353131104Z [2024-03-21 01:19:02,350: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:19:02.410107537Z [2024-03-21 01:19:02,409: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T01:19:02.416903617Z [2024-03-21 01:19:02,415: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:19:02.443973114Z [2024-03-21 01:19:02,443: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:19:02.484526830Z [2024-03-21 01:19:02,484: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:19:02.489048865Z [2024-03-21 01:19:02,488: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:19:02.489060991Z [2024-03-21 01:19:02,488: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:19:02.490158477Z [2024-03-21 01:19:02,488: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:19:02.490170772Z [2024-03-21 01:19:02,489: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T01:19:02.490175232Z [2024-03-21 01:19:02,489: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:19:02.490178655Z [2024-03-21 01:19:02,489: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:19:02.611270191Z [2024-03-21 01:19:02,610: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:19:03.979550820Z [2024-03-21 01:19:03,978: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a44e8f9f-f03b-430b-8dc3-e7fae1780551] succeeded in 3.557244594999247s: None
2024-03-21T01:19:05.031831591Z [2024-03-21 01:19:05,031: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f0e9ae44-296e-4619-980c-c3c60dbf4019] succeeded in 4.588072260999979s: None
2024-03-21T01:20:01.315628189Z [2024-03-21 01:20:01,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[09fa838d-af27-4616-b31c-6d87689bc31a] received
2024-03-21T01:20:01.318128292Z [2024-03-21 01:20:01,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6843b02-22e5-4377-bb9b-32448bf36af6] received
2024-03-21T01:20:01.320644705Z [2024-03-21 01:20:01,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0944566-e991-4776-b2e3-bb369e8edbc9] received
2024-03-21T01:20:01.323046512Z [2024-03-21 01:20:01,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18b813e4-0267-479d-a12b-e84191614f1e] received
2024-03-21T01:20:01.324895121Z [2024-03-21 01:20:01,324: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[40d6e677-ada1-4dcd-bccf-7f030e64ef87] received
2024-03-21T01:20:01.334212685Z [2024-03-21 01:20:01,332: INFO/ForkPoolWorker-16] [f6843b02-22e5-4377-bb9b-32448bf36af6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:20:01.334962158Z [2024-03-21 01:20:01,334: INFO/ForkPoolWorker-15] [09fa838d-af27-4616-b31c-6d87689bc31a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:20:01.336896208Z [2024-03-21 01:20:01,336: INFO/ForkPoolWorker-1] [e0944566-e991-4776-b2e3-bb369e8edbc9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:20:01.336973831Z [2024-03-21 01:20:01,336: INFO/ForkPoolWorker-3] [40d6e677-ada1-4dcd-bccf-7f030e64ef87] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:20:01.338103965Z [2024-03-21 01:20:01,337: INFO/ForkPoolWorker-2] [18b813e4-0267-479d-a12b-e84191614f1e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:20:01.706936370Z [2024-03-21 01:20:01,703: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:20:01.750303018Z [2024-03-21 01:20:01,747: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:20:01.763471782Z [2024-03-21 01:20:01,759: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:20:01.919217293Z [2024-03-21 01:20:01,916: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:20:01.951148043Z [2024-03-21 01:20:01,941: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:20:01.977364506Z [2024-03-21 01:20:01,976: INFO/ForkPoolWorker-3] Getting SDNC list
2024-03-21T01:20:01.981296949Z [2024-03-21 01:20:01,980: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:20:01.997689522Z [2024-03-21 01:20:01,997: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-21T01:20:01.998737930Z [2024-03-21 01:20:01,998: INFO/ForkPoolWorker-3] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:20:02.000176826Z [2024-03-21 01:20:01,998: INFO/ForkPoolWorker-3] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:20:02.000455608Z [2024-03-21 01:20:02,000: INFO/ForkPoolWorker-3] Getting SDNC list OK
2024-03-21T01:20:02.001165119Z [2024-03-21 01:20:02,000: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:20:02.141776861Z [2024-03-21 01:20:02,139: INFO/ForkPoolWorker-3] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:20:02.588698214Z [2024-03-21 01:20:02,588: INFO/ForkPoolWorker-2] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:20:03.305852032Z [2024-03-21 01:20:03,305: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[40d6e677-ada1-4dcd-bccf-7f030e64ef87] succeeded in 1.9787614580000081s: None
2024-03-21T01:20:03.448819937Z [2024-03-21 01:20:03,448: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:20:03.452485506Z [2024-03-21 01:20:03,451: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:20:03.481769744Z [2024-03-21 01:20:03,481: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:20:03.483583506Z [2024-03-21 01:20:03,482: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:20:03.483614916Z [2024-03-21 01:20:03,483: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:20:03.483881386Z [2024-03-21 01:20:03,483: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:20:03.483896261Z [2024-03-21 01:20:03,483: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:20:03.483925850Z [2024-03-21 01:20:03,483: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:20:03.483977701Z [2024-03-21 01:20:03,483: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:20:03.568371010Z [2024-03-21 01:20:03,567: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[18b813e4-0267-479d-a12b-e84191614f1e] succeeded in 2.2426996540007167s: None
2024-03-21T01:20:03.576813017Z [2024-03-21 01:20:03,576: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T01:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:20:03.618081414Z [2024-03-21 01:20:03,617: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:20:03.624575275Z [2024-03-21 01:20:03,623: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:20:03.648780095Z [2024-03-21 01:20:03,648: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:20:03.650279841Z [2024-03-21 01:20:03,650: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:20:03.650329976Z [2024-03-21 01:20:03,650: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:20:03.650450421Z [2024-03-21 01:20:03,650: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:20:03.650458591Z [2024-03-21 01:20:03,650: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:20:03.650748404Z [2024-03-21 01:20:03,650: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:20:03.650824475Z [2024-03-21 01:20:03,650: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:20:03.713870161Z [2024-03-21 01:20:03,713: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:20:03.717641654Z [2024-03-21 01:20:03,717: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:20:03.746650880Z [2024-03-21 01:20:03,746: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:20:03.747914132Z [2024-03-21 01:20:03,747: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:20:03.749700641Z [2024-03-21 01:20:03,749: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:20:03.749761523Z [2024-03-21 01:20:03,749: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:20:03.749993020Z [2024-03-21 01:20:03,749: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:20:03.750174495Z [2024-03-21 01:20:03,749: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:20:03.750492355Z [2024-03-21 01:20:03,750: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:20:03.750594385Z [2024-03-21 01:20:03,750: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:20:03.833089398Z [2024-03-21 01:20:03,832: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:20:04.192447153Z [2024-03-21 01:20:04,192: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a6e40dc-b615-4ad8-92bd-1927735089cf] received
2024-03-21T01:20:04.206147532Z [2024-03-21 01:20:04,205: INFO/ForkPoolWorker-2] [3a6e40dc-b615-4ad8-92bd-1927735089cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:20:04.268416803Z [2024-03-21 01:20:04,267: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[09fa838d-af27-4616-b31c-6d87689bc31a] succeeded in 2.950412733000121s: None
2024-03-21T01:20:04.618529573Z [2024-03-21 01:20:04,615: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:20:05.755451892Z [2024-03-21 01:20:05,754: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T01:20:05.758730325Z [2024-03-21 01:20:05,758: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:20:05.778899733Z [2024-03-21 01:20:05,778: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:20:05.780167768Z [2024-03-21 01:20:05,779: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:20:05.780182940Z [2024-03-21 01:20:05,780: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:20:05.780374015Z [2024-03-21 01:20:05,780: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:20:05.780386928Z [2024-03-21 01:20:05,780: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T01:20:05.780659419Z [2024-03-21 01:20:05,780: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:20:05.780673564Z [2024-03-21 01:20:05,780: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:20:05.861381947Z [2024-03-21 01:20:05,861: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T01:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:20:05.969939655Z [2024-03-21 01:20:05,969: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f6843b02-22e5-4377-bb9b-32448bf36af6] succeeded in 4.649805849000586s: None
2024-03-21T01:20:06.309646829Z [2024-03-21 01:20:06,309: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e0944566-e991-4776-b2e3-bb369e8edbc9] succeeded in 4.985640682999474s: None
2024-03-21T01:20:06.533978245Z [2024-03-21 01:20:06,533: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d719ee75-25b2-4ad4-85eb-55e578c997ba] received
2024-03-21T01:20:06.544208960Z [2024-03-21 01:20:06,543: INFO/ForkPoolWorker-15] [d719ee75-25b2-4ad4-85eb-55e578c997ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T01:20:06.588945952Z [2024-03-21 01:20:06,588: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3a6e40dc-b615-4ad8-92bd-1927735089cf] succeeded in 2.391416407000179s: None
2024-03-21T01:20:06.830144271Z [2024-03-21 01:20:06,826: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:20:07.983399015Z [2024-03-21 01:20:07,981: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:20:07.986619985Z [2024-03-21 01:20:07,984: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:20:08.011857362Z [2024-03-21 01:20:08,011: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:20:08.021430507Z [2024-03-21 01:20:08,019: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:20:08.021440158Z [2024-03-21 01:20:08,019: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:20:08.021444694Z [2024-03-21 01:20:08,019: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:20:08.021460658Z [2024-03-21 01:20:08,019: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:20:08.021464031Z [2024-03-21 01:20:08,019: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:20:08.021467120Z [2024-03-21 01:20:08,019: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:20:08.098742232Z [2024-03-21 01:20:08,098: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T01:15:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:20:08.751160444Z [2024-03-21 01:20:08,750: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d719ee75-25b2-4ad4-85eb-55e578c997ba] succeeded in 2.2151167109996095s: None
2024-03-21T01:20:09.102436846Z [2024-03-21 01:20:09,101: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab10295a-14f6-4277-99c5-28a6562ea4a3] received
2024-03-21T01:20:09.115304069Z [2024-03-21 01:20:09,114: INFO/ForkPoolWorker-15] [ab10295a-14f6-4277-99c5-28a6562ea4a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:20:09.519082138Z [2024-03-21 01:20:09,515: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:20:10.798641746Z [2024-03-21 01:20:10,798: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:20:10.802292857Z [2024-03-21 01:20:10,801: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:20:10.821133224Z [2024-03-21 01:20:10,820: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:20:10.822368068Z [2024-03-21 01:20:10,822: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:20:10.822383052Z [2024-03-21 01:20:10,822: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:20:10.822482455Z [2024-03-21 01:20:10,822: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:20:10.822516135Z [2024-03-21 01:20:10,822: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:20:10.822725933Z [2024-03-21 01:20:10,822: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:20:10.822782262Z [2024-03-21 01:20:10,822: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:20:10.911300989Z [2024-03-21 01:20:10,910: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T01:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:20:11.462018613Z [2024-03-21 01:20:11,461: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ab10295a-14f6-4277-99c5-28a6562ea4a3] succeeded in 2.356547792999663s: None
2024-03-21T01:21:00.301880684Z [2024-03-21 01:21:00,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7708f908-8e71-417c-9009-c6f7f99c069c] received
2024-03-21T01:21:00.307229303Z [2024-03-21 01:21:00,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[480c999a-0c8c-4502-8482-a0033fe4d762] received
2024-03-21T01:21:00.309262634Z [2024-03-21 01:21:00,309: INFO/ForkPoolWorker-15] [7708f908-8e71-417c-9009-c6f7f99c069c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:21:00.311501362Z [2024-03-21 01:21:00,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9838f9c-6c95-46ab-901d-4334a21ddc9d] received
2024-03-21T01:21:00.320337786Z [2024-03-21 01:21:00,320: INFO/ForkPoolWorker-16] [480c999a-0c8c-4502-8482-a0033fe4d762] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:21:00.330795324Z [2024-03-21 01:21:00,330: INFO/ForkPoolWorker-1] [d9838f9c-6c95-46ab-901d-4334a21ddc9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:21:00.644707450Z [2024-03-21 01:21:00,640: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:21:00.665803190Z [2024-03-21 01:21:00,662: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:21:00.700246447Z [2024-03-21 01:21:00,693: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:21:00.843601193Z [2024-03-21 01:21:00,843: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T01:21:00.848242059Z [2024-03-21 01:21:00,847: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:21:00.875956494Z [2024-03-21 01:21:00,875: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:21:00.877149843Z [2024-03-21 01:21:00,876: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:21:00.877186493Z [2024-03-21 01:21:00,877: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:21:00.877249706Z [2024-03-21 01:21:00,877: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T01:21:00.877443036Z [2024-03-21 01:21:00,877: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:21:00.973446991Z [2024-03-21 01:21:00,973: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:21:01.626585682Z [2024-03-21 01:21:01,626: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d9838f9c-6c95-46ab-901d-4334a21ddc9d] succeeded in 1.30800308400012s: None
2024-03-21T01:21:01.892546503Z [2024-03-21 01:21:01,892: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:21:01.896196720Z [2024-03-21 01:21:01,895: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:21:01.913680818Z [2024-03-21 01:21:01,913: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:21:01.914933572Z [2024-03-21 01:21:01,914: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:21:01.915020447Z [2024-03-21 01:21:01,914: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:21:01.915233312Z [2024-03-21 01:21:01,915: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:21:01.915345581Z [2024-03-21 01:21:01,915: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:21:01.915596009Z [2024-03-21 01:21:01,915: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:21:01.915690561Z [2024-03-21 01:21:01,915: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:21:01.956422649Z [2024-03-21 01:21:01,956: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:21:01.960229097Z [2024-03-21 01:21:01,959: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:21:01.987406968Z [2024-03-21 01:21:01,987: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:21:01.988827562Z [2024-03-21 01:21:01,988: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:21:01.988971043Z [2024-03-21 01:21:01,988: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:21:01.989200454Z [2024-03-21 01:21:01,988: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:21:01.989342208Z [2024-03-21 01:21:01,989: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:21:01.989710180Z [2024-03-21 01:21:01,989: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:21:01.989842270Z [2024-03-21 01:21:01,989: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:21:01.997123718Z [2024-03-21 01:21:01,996: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:21:02.077326554Z [2024-03-21 01:21:02,077: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:21:04.003114932Z [2024-03-21 01:21:04,002: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7708f908-8e71-417c-9009-c6f7f99c069c] succeeded in 3.698967635000372s: None
2024-03-21T01:21:04.396152075Z [2024-03-21 01:21:04,395: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[480c999a-0c8c-4502-8482-a0033fe4d762] succeeded in 4.087246871999923s: None
2024-03-21T01:22:00.980999440Z [2024-03-21 01:22:00,980: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ffe5342-2433-40e2-8c13-6fdef2cc425e] received
2024-03-21T01:22:00.982431081Z [2024-03-21 01:22:00,982: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cd253b4-3952-4131-850e-cb15cdf53b1e] received
2024-03-21T01:22:00.987442004Z [2024-03-21 01:22:00,987: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[028d4146-6091-40c4-9eb2-6391cd81f7bc] received
2024-03-21T01:22:00.988168431Z [2024-03-21 01:22:00,987: INFO/ForkPoolWorker-15] [5ffe5342-2433-40e2-8c13-6fdef2cc425e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:22:00.990451138Z [2024-03-21 01:22:00,990: INFO/ForkPoolWorker-16] [4cd253b4-3952-4131-850e-cb15cdf53b1e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:22:00.990956627Z [2024-03-21 01:22:00,990: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84a930ec-70ba-4bf3-a81d-6deeafa6a166] received
2024-03-21T01:22:01.005205300Z [2024-03-21 01:22:01,004: INFO/ForkPoolWorker-1] [028d4146-6091-40c4-9eb2-6391cd81f7bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:22:01.008705514Z [2024-03-21 01:22:01,004: INFO/ForkPoolWorker-2] [84a930ec-70ba-4bf3-a81d-6deeafa6a166] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:22:01.398855400Z [2024-03-21 01:22:01,394: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:22:01.468603393Z [2024-03-21 01:22:01,465: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:22:01.470707036Z [2024-03-21 01:22:01,467: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:22:01.500988698Z [2024-03-21 01:22:01,497: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:22:01.810037064Z [2024-03-21 01:22:01,809: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T01:22:01.820271957Z [2024-03-21 01:22:01,819: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:22:01.875417611Z [2024-03-21 01:22:01,874: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:22:01.878895814Z [2024-03-21 01:22:01,878: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:22:01.882428551Z [2024-03-21 01:22:01,882: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:22:01.882724402Z [2024-03-21 01:22:01,882: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:22:01.882890854Z [2024-03-21 01:22:01,882: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T01:22:01.883193044Z [2024-03-21 01:22:01,883: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:22:02.048038789Z [2024-03-21 01:22:02,047: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:22:02.953929425Z [2024-03-21 01:22:02,953: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5ffe5342-2433-40e2-8c13-6fdef2cc425e] succeeded in 1.970260837000751s: None
2024-03-21T01:22:03.041977697Z [2024-03-21 01:22:03,041: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[84a930ec-70ba-4bf3-a81d-6deeafa6a166] succeeded in 2.0484072190001825s: None
2024-03-21T01:22:03.198673846Z [2024-03-21 01:22:03,198: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:22:03.202684523Z [2024-03-21 01:22:03,202: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:22:03.226881012Z [2024-03-21 01:22:03,226: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:22:03.228897963Z [2024-03-21 01:22:03,228: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:22:03.229053716Z [2024-03-21 01:22:03,228: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:22:03.229274387Z [2024-03-21 01:22:03,229: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:22:03.229390647Z [2024-03-21 01:22:03,229: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:22:03.229951006Z [2024-03-21 01:22:03,229: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:22:03.230154128Z [2024-03-21 01:22:03,229: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:22:03.324188905Z [2024-03-21 01:22:03,322: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:22:03.327797009Z [2024-03-21 01:22:03,327: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:22:03.374006047Z [2024-03-21 01:22:03,373: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:22:03.375660895Z [2024-03-21 01:22:03,375: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:22:03.375708019Z [2024-03-21 01:22:03,375: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:22:03.375915583Z [2024-03-21 01:22:03,375: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:22:03.375960804Z [2024-03-21 01:22:03,375: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:22:03.376371752Z [2024-03-21 01:22:03,376: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:22:03.376443899Z [2024-03-21 01:22:03,376: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:22:03.388038164Z [2024-03-21 01:22:03,387: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:22:03.486360746Z [2024-03-21 01:22:03,486: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:22:05.306641716Z [2024-03-21 01:22:05,306: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[028d4146-6091-40c4-9eb2-6391cd81f7bc] succeeded in 4.317079977000503s: None
2024-03-21T01:22:05.404571938Z [2024-03-21 01:22:05,403: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4cd253b4-3952-4131-850e-cb15cdf53b1e] succeeded in 4.420557405999716s: None
2024-03-21T01:23:00.280593724Z [2024-03-21 01:23:00,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1fa20031-efcb-42f9-90c1-31039b8e9149] received
2024-03-21T01:23:00.293854265Z [2024-03-21 01:23:00,293: INFO/ForkPoolWorker-15] [1fa20031-efcb-42f9-90c1-31039b8e9149] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:23:00.298260870Z [2024-03-21 01:23:00,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15ad4855-9551-4450-a8c8-0b85a9872e19] received
2024-03-21T01:23:00.304376198Z [2024-03-21 01:23:00,304: INFO/ForkPoolWorker-16] [15ad4855-9551-4450-a8c8-0b85a9872e19] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:23:00.312409411Z [2024-03-21 01:23:00,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7e6e502-41fb-4aeb-8b92-bf3ed8cc189f] received
2024-03-21T01:23:00.329723271Z [2024-03-21 01:23:00,329: INFO/ForkPoolWorker-1] [e7e6e502-41fb-4aeb-8b92-bf3ed8cc189f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:23:00.643094998Z [2024-03-21 01:23:00,637: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:23:00.669985649Z [2024-03-21 01:23:00,667: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:23:00.726940832Z [2024-03-21 01:23:00,723: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:23:00.827609478Z [2024-03-21 01:23:00,827: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T01:23:00.832966362Z [2024-03-21 01:23:00,832: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:23:00.871957673Z [2024-03-21 01:23:00,871: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:23:00.876066787Z [2024-03-21 01:23:00,875: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:23:00.876219756Z [2024-03-21 01:23:00,875: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:23:00.876328526Z [2024-03-21 01:23:00,876: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T01:23:00.876724801Z [2024-03-21 01:23:00,876: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:23:01.051555458Z [2024-03-21 01:23:01,051: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:23:01.814855864Z [2024-03-21 01:23:01,814: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[15ad4855-9551-4450-a8c8-0b85a9872e19] succeeded in 1.5150027010004123s: None
2024-03-21T01:23:02.397024871Z [2024-03-21 01:23:02,396: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:23:02.401635484Z [2024-03-21 01:23:02,401: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:23:02.514944355Z [2024-03-21 01:23:02,514: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:23:02.516718701Z [2024-03-21 01:23:02,516: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:23:02.516972639Z [2024-03-21 01:23:02,516: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:23:02.517235452Z [2024-03-21 01:23:02,517: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:23:02.517428304Z [2024-03-21 01:23:02,517: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:23:02.517828314Z [2024-03-21 01:23:02,517: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:23:02.517986353Z [2024-03-21 01:23:02,517: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:23:02.636257427Z [2024-03-21 01:23:02,635: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:23:02.657927449Z [2024-03-21 01:23:02,657: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:23:02.661735265Z [2024-03-21 01:23:02,661: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:23:02.689895068Z [2024-03-21 01:23:02,689: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:23:02.693390188Z [2024-03-21 01:23:02,693: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:23:02.693471749Z [2024-03-21 01:23:02,693: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:23:02.693544708Z [2024-03-21 01:23:02,693: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:23:02.693566753Z [2024-03-21 01:23:02,693: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:23:02.693779161Z [2024-03-21 01:23:02,693: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:23:02.693818075Z [2024-03-21 01:23:02,693: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:23:02.794999999Z [2024-03-21 01:23:02,794: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:23:04.443184144Z [2024-03-21 01:23:04,442: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e7e6e502-41fb-4aeb-8b92-bf3ed8cc189f] succeeded in 4.129032565999296s: None
2024-03-21T01:23:05.125069043Z [2024-03-21 01:23:05,124: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1fa20031-efcb-42f9-90c1-31039b8e9149] succeeded in 4.842533355999876s: None
2024-03-21T01:24:00.744750216Z [2024-03-21 01:24:00,744: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff28dfb9-6a6e-49b5-be52-9cdb004d93dd] received
2024-03-21T01:24:00.748863986Z [2024-03-21 01:24:00,748: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95f04404-5811-4f9c-83af-cd7c3dc64f5d] received
2024-03-21T01:24:00.759520636Z [2024-03-21 01:24:00,759: INFO/ForkPoolWorker-15] [ff28dfb9-6a6e-49b5-be52-9cdb004d93dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:24:00.759907275Z [2024-03-21 01:24:00,759: INFO/ForkPoolWorker-16] [95f04404-5811-4f9c-83af-cd7c3dc64f5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:24:00.765670759Z [2024-03-21 01:24:00,765: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5752d1fb-b022-4eab-9a6a-67b7cd8f101f] received
2024-03-21T01:24:00.770833946Z [2024-03-21 01:24:00,770: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f90aae8-b22c-452a-a67a-68d784188f4e] received
2024-03-21T01:24:00.790903897Z [2024-03-21 01:24:00,790: INFO/ForkPoolWorker-2] [3f90aae8-b22c-452a-a67a-68d784188f4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:24:00.791636922Z [2024-03-21 01:24:00,791: INFO/ForkPoolWorker-1] [5752d1fb-b022-4eab-9a6a-67b7cd8f101f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:24:01.135562745Z [2024-03-21 01:24:01,132: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:24:01.150852639Z [2024-03-21 01:24:01,146: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:24:01.153030498Z [2024-03-21 01:24:01,147: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:24:01.185795693Z [2024-03-21 01:24:01,180: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:24:01.316819790Z [2024-03-21 01:24:01,316: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T01:24:01.320781892Z [2024-03-21 01:24:01,320: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:24:01.362889713Z [2024-03-21 01:24:01,362: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:24:01.370641644Z [2024-03-21 01:24:01,370: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:24:01.370691936Z [2024-03-21 01:24:01,370: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:24:01.370697016Z [2024-03-21 01:24:01,370: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T01:24:01.371949296Z [2024-03-21 01:24:01,371: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:24:01.536847390Z [2024-03-21 01:24:01,535: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:24:01.559349369Z [2024-03-21 01:24:01,558: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:24:02.404059830Z [2024-03-21 01:24:02,403: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[95f04404-5811-4f9c-83af-cd7c3dc64f5d] succeeded in 1.6519839510001475s: None
2024-03-21T01:24:02.559494128Z [2024-03-21 01:24:02,559: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5752d1fb-b022-4eab-9a6a-67b7cd8f101f] succeeded in 1.7893941000002087s: None
2024-03-21T01:24:02.988275731Z [2024-03-21 01:24:02,987: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:24:02.992453650Z [2024-03-21 01:24:02,991: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:24:02.999718810Z [2024-03-21 01:24:02,999: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T01:24:03.003668467Z [2024-03-21 01:24:03,003: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:24:03.026889339Z [2024-03-21 01:24:03,026: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:24:03.028130390Z [2024-03-21 01:24:03,027: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:24:03.028232976Z [2024-03-21 01:24:03,028: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:24:03.028273882Z [2024-03-21 01:24:03,028: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:24:03.028479081Z [2024-03-21 01:24:03,028: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:24:03.028496661Z [2024-03-21 01:24:03,028: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:24:03.028796853Z [2024-03-21 01:24:03,028: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:24:03.028810478Z [2024-03-21 01:24:03,028: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:24:03.030226496Z [2024-03-21 01:24:03,029: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:24:03.030241541Z [2024-03-21 01:24:03,030: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:24:03.030460364Z [2024-03-21 01:24:03,030: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:24:03.030515928Z [2024-03-21 01:24:03,030: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T01:24:03.030975473Z [2024-03-21 01:24:03,030: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:24:03.031043147Z [2024-03-21 01:24:03,030: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:24:03.123584217Z [2024-03-21 01:24:03,123: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:24:03.127862826Z [2024-03-21 01:24:03,127: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:24:05.218537100Z [2024-03-21 01:24:05,218: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ff28dfb9-6a6e-49b5-be52-9cdb004d93dd] succeeded in 4.46839888500017s: None
2024-03-21T01:24:06.673541099Z [2024-03-21 01:24:06,672: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3f90aae8-b22c-452a-a67a-68d784188f4e] succeeded in 5.899830380999447s: None
2024-03-21T01:25:01.140744422Z [2024-03-21 01:25:01,140: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6232a1e5-f4b8-4529-8c65-0e4929a1d191] received
2024-03-21T01:25:01.145814743Z [2024-03-21 01:25:01,145: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f3bc1df-86ab-4787-9713-98e6f783ac58] received
2024-03-21T01:25:01.154684398Z [2024-03-21 01:25:01,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3bfc5606-e96a-41d0-af9d-212ee5128a66] received
2024-03-21T01:25:01.155797797Z [2024-03-21 01:25:01,155: INFO/ForkPoolWorker-16] [8f3bc1df-86ab-4787-9713-98e6f783ac58] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:25:01.159062843Z [2024-03-21 01:25:01,158: INFO/ForkPoolWorker-15] [6232a1e5-f4b8-4529-8c65-0e4929a1d191] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:25:01.160380732Z [2024-03-21 01:25:01,160: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[481bc166-363a-4d51-b44f-73c8dabc64b0] received
2024-03-21T01:25:01.161247113Z [2024-03-21 01:25:01,161: INFO/ForkPoolWorker-1] [3bfc5606-e96a-41d0-af9d-212ee5128a66] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:25:01.179267482Z [2024-03-21 01:25:01,179: INFO/ForkPoolWorker-2] [481bc166-363a-4d51-b44f-73c8dabc64b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:25:01.496244138Z [2024-03-21 01:25:01,493: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:25:01.513514106Z [2024-03-21 01:25:01,510: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:25:01.514785757Z [2024-03-21 01:25:01,511: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:25:01.553981760Z [2024-03-21 01:25:01,544: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:25:01.663992099Z [2024-03-21 01:25:01,663: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T01:25:01.667892182Z [2024-03-21 01:25:01,667: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:25:01.722266353Z [2024-03-21 01:25:01,721: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:25:01.730390736Z [2024-03-21 01:25:01,730: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:25:01.730506730Z [2024-03-21 01:25:01,730: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:25:01.730521515Z [2024-03-21 01:25:01,730: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T01:25:01.730817544Z [2024-03-21 01:25:01,730: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:25:01.861314297Z [2024-03-21 01:25:01,861: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:25:02.819404739Z [2024-03-21 01:25:02,819: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8f3bc1df-86ab-4787-9713-98e6f783ac58] succeeded in 1.671652611999889s: None
2024-03-21T01:25:03.235348657Z [2024-03-21 01:25:03,234: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:25:03.239488236Z [2024-03-21 01:25:03,238: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:25:03.260407403Z [2024-03-21 01:25:03,260: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:25:03.262189510Z [2024-03-21 01:25:03,261: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:25:03.262583345Z [2024-03-21 01:25:03,262: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:25:03.262824485Z [2024-03-21 01:25:03,262: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:25:03.263003519Z [2024-03-21 01:25:03,262: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:25:03.263356665Z [2024-03-21 01:25:03,263: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:25:03.263640852Z [2024-03-21 01:25:03,263: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:25:03.363070288Z [2024-03-21 01:25:03,362: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T01:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:25:03.364452943Z [2024-03-21 01:25:03,364: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T01:25:03.368149416Z [2024-03-21 01:25:03,367: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:25:03.406859750Z [2024-03-21 01:25:03,406: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:25:03.408917721Z [2024-03-21 01:25:03,408: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:25:03.409028352Z [2024-03-21 01:25:03,408: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:25:03.409246961Z [2024-03-21 01:25:03,409: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:25:03.409369204Z [2024-03-21 01:25:03,409: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T01:25:03.409733248Z [2024-03-21 01:25:03,409: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:25:03.410284585Z [2024-03-21 01:25:03,409: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:25:03.494412587Z [2024-03-21 01:25:03,494: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:25:03.670952976Z [2024-03-21 01:25:03,670: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:25:03.676455160Z [2024-03-21 01:25:03,675: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:25:03.716596343Z [2024-03-21 01:25:03,716: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:25:03.719754316Z [2024-03-21 01:25:03,719: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:25:03.719872016Z [2024-03-21 01:25:03,719: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:25:03.720112899Z [2024-03-21 01:25:03,719: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:25:03.720122837Z [2024-03-21 01:25:03,719: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:25:03.720360402Z [2024-03-21 01:25:03,720: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:25:03.720391872Z [2024-03-21 01:25:03,720: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:25:03.879791297Z [2024-03-21 01:25:03,879: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:25:04.178095533Z [2024-03-21 01:25:04,177: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97cc6fe0-7547-445f-8a66-0fbaad44934b] received
2024-03-21T01:25:04.191827132Z [2024-03-21 01:25:04,191: INFO/ForkPoolWorker-16] [97cc6fe0-7547-445f-8a66-0fbaad44934b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:25:04.204223867Z [2024-03-21 01:25:04,203: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3bfc5606-e96a-41d0-af9d-212ee5128a66] succeeded in 3.0480242690000523s: None
2024-03-21T01:25:04.512938504Z [2024-03-21 01:25:04,509: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:25:05.680810990Z [2024-03-21 01:25:05,680: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[481bc166-363a-4d51-b44f-73c8dabc64b0] succeeded in 4.507349077000072s: None
2024-03-21T01:25:05.735930240Z [2024-03-21 01:25:05,735: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:25:05.739527755Z [2024-03-21 01:25:05,739: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:25:05.743116567Z [2024-03-21 01:25:05,742: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6232a1e5-f4b8-4529-8c65-0e4929a1d191] succeeded in 4.597686080999665s: None
2024-03-21T01:25:05.761701791Z [2024-03-21 01:25:05,761: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:25:05.763355878Z [2024-03-21 01:25:05,763: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:25:05.763390450Z [2024-03-21 01:25:05,763: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:25:05.763563569Z [2024-03-21 01:25:05,763: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:25:05.763640415Z [2024-03-21 01:25:05,763: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:25:05.764401662Z [2024-03-21 01:25:05,764: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:25:05.764480642Z [2024-03-21 01:25:05,764: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:25:05.857046999Z [2024-03-21 01:25:05,856: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T01:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:25:06.520365046Z [2024-03-21 01:25:06,519: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[97cc6fe0-7547-445f-8a66-0fbaad44934b] succeeded in 2.3403076309996322s: None
2024-03-21T01:25:06.635176271Z [2024-03-21 01:25:06,630: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b6856d3-3221-4af8-a9c9-229241e7b766] received
2024-03-21T01:25:06.644220023Z [2024-03-21 01:25:06,643: INFO/ForkPoolWorker-15] [8b6856d3-3221-4af8-a9c9-229241e7b766] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T01:25:06.943876532Z [2024-03-21 01:25:06,940: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:25:08.084797971Z [2024-03-21 01:25:08,084: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:25:08.088539498Z [2024-03-21 01:25:08,087: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:25:08.112636287Z [2024-03-21 01:25:08,112: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:25:08.114574249Z [2024-03-21 01:25:08,114: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:25:08.114597045Z [2024-03-21 01:25:08,114: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:25:08.114795565Z [2024-03-21 01:25:08,114: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:25:08.114876042Z [2024-03-21 01:25:08,114: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:25:08.115258176Z [2024-03-21 01:25:08,115: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:25:08.115404729Z [2024-03-21 01:25:08,115: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:25:08.215440784Z [2024-03-21 01:25:08,215: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T01:20:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:25:08.833153262Z [2024-03-21 01:25:08,832: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9d5dea0-d105-46c2-9563-6ace938b1b1d] received
2024-03-21T01:25:08.841066363Z [2024-03-21 01:25:08,840: INFO/ForkPoolWorker-16] [d9d5dea0-d105-46c2-9563-6ace938b1b1d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:25:08.935123339Z [2024-03-21 01:25:08,934: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8b6856d3-3221-4af8-a9c9-229241e7b766] succeeded in 2.2967729619995225s: None
2024-03-21T01:25:09.292172605Z [2024-03-21 01:25:09,284: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:25:10.729484963Z [2024-03-21 01:25:10,729: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:25:10.733107579Z [2024-03-21 01:25:10,732: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:25:10.761791144Z [2024-03-21 01:25:10,761: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:25:10.763567555Z [2024-03-21 01:25:10,763: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:25:10.763727537Z [2024-03-21 01:25:10,763: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:25:10.763957368Z [2024-03-21 01:25:10,763: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:25:10.764258670Z [2024-03-21 01:25:10,763: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:25:10.764750029Z [2024-03-21 01:25:10,764: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:25:10.764853186Z [2024-03-21 01:25:10,764: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:25:10.895087155Z [2024-03-21 01:25:10,894: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T01:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:25:11.431202364Z [2024-03-21 01:25:11,430: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d9d5dea0-d105-46c2-9563-6ace938b1b1d] succeeded in 2.5957369820007443s: None
2024-03-21T01:26:00.384715397Z [2024-03-21 01:26:00,384: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[667db5dc-8655-44b0-a5b4-c05c9e5f11da] received
2024-03-21T01:26:00.392877407Z [2024-03-21 01:26:00,392: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22808a18-efd2-468b-b25f-6af028e6793f] received
2024-03-21T01:26:00.393967616Z [2024-03-21 01:26:00,393: INFO/ForkPoolWorker-15] [667db5dc-8655-44b0-a5b4-c05c9e5f11da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:26:00.397437521Z [2024-03-21 01:26:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fc027ba-ff04-4072-ad29-d9174d715cc5] received
2024-03-21T01:26:00.400776052Z [2024-03-21 01:26:00,400: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70b17eca-92e4-4e51-b210-689d047a6708] received
2024-03-21T01:26:00.409064441Z [2024-03-21 01:26:00,408: INFO/ForkPoolWorker-1] [8fc027ba-ff04-4072-ad29-d9174d715cc5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:26:00.416443774Z [2024-03-21 01:26:00,415: INFO/ForkPoolWorker-16] [22808a18-efd2-468b-b25f-6af028e6793f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:26:00.425484975Z [2024-03-21 01:26:00,425: INFO/ForkPoolWorker-2] [70b17eca-92e4-4e51-b210-689d047a6708] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:26:00.705364925Z [2024-03-21 01:26:00,702: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:26:00.710902002Z [2024-03-21 01:26:00,707: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:26:00.727059056Z [2024-03-21 01:26:00,723: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:26:00.784160701Z [2024-03-21 01:26:00,774: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:26:00.902091167Z [2024-03-21 01:26:00,901: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T01:26:00.906016655Z [2024-03-21 01:26:00,905: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:26:00.935055571Z [2024-03-21 01:26:00,934: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:26:00.940088794Z [2024-03-21 01:26:00,939: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:26:00.940252347Z [2024-03-21 01:26:00,939: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:26:00.940324436Z [2024-03-21 01:26:00,940: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T01:26:00.940626252Z [2024-03-21 01:26:00,940: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:26:00.981327251Z [2024-03-21 01:26:00,981: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:26:01.064610812Z [2024-03-21 01:26:01,064: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:26:01.620273485Z [2024-03-21 01:26:01,619: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8fc027ba-ff04-4072-ad29-d9174d715cc5] succeeded in 1.2208188219992735s: None
2024-03-21T01:26:01.627088368Z [2024-03-21 01:26:01,626: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[22808a18-efd2-468b-b25f-6af028e6793f] succeeded in 1.2280775200006246s: None
2024-03-21T01:26:02.135058732Z [2024-03-21 01:26:02,134: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:26:02.139729057Z [2024-03-21 01:26:02,139: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:26:02.161352462Z [2024-03-21 01:26:02,161: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:26:02.162857546Z [2024-03-21 01:26:02,162: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:26:02.163054969Z [2024-03-21 01:26:02,162: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:26:02.163263479Z [2024-03-21 01:26:02,163: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:26:02.163387267Z [2024-03-21 01:26:02,163: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:26:02.163740284Z [2024-03-21 01:26:02,163: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:26:02.164227776Z [2024-03-21 01:26:02,164: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:26:02.301026786Z [2024-03-21 01:26:02,298: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:26:02.466387198Z [2024-03-21 01:26:02,465: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T01:26:02.469864220Z [2024-03-21 01:26:02,469: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:26:02.492281816Z [2024-03-21 01:26:02,492: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:26:02.494101384Z [2024-03-21 01:26:02,493: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:26:02.494236110Z [2024-03-21 01:26:02,494: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:26:02.494438029Z [2024-03-21 01:26:02,494: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:26:02.494551135Z [2024-03-21 01:26:02,494: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T01:26:02.494871018Z [2024-03-21 01:26:02,494: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:26:02.494998977Z [2024-03-21 01:26:02,494: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:26:02.593176687Z [2024-03-21 01:26:02,592: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:26:03.844216071Z [2024-03-21 01:26:03,843: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[667db5dc-8655-44b0-a5b4-c05c9e5f11da] succeeded in 3.457608681000238s: None
2024-03-21T01:26:04.714659442Z [2024-03-21 01:26:04,713: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[70b17eca-92e4-4e51-b210-689d047a6708] succeeded in 4.302833999000541s: None
2024-03-21T01:27:01.119075153Z [2024-03-21 01:27:01,118: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[636dbf91-404a-41a7-bcb2-f1a14c4e72f7] received
2024-03-21T01:27:01.128039667Z [2024-03-21 01:27:01,127: INFO/ForkPoolWorker-15] [636dbf91-404a-41a7-bcb2-f1a14c4e72f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:27:01.133239373Z [2024-03-21 01:27:01,132: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ea15567-996d-4fd8-99ff-d55ac08b5fe7] received
2024-03-21T01:27:01.143000978Z [2024-03-21 01:27:01,142: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[055b9c34-c58b-4ba3-bf74-6634f2ef35b6] received
2024-03-21T01:27:01.151991158Z [2024-03-21 01:27:01,151: INFO/ForkPoolWorker-1] [055b9c34-c58b-4ba3-bf74-6634f2ef35b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:27:01.158553089Z [2024-03-21 01:27:01,158: INFO/ForkPoolWorker-16] [7ea15567-996d-4fd8-99ff-d55ac08b5fe7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:27:01.461358925Z [2024-03-21 01:27:01,458: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:27:01.492910404Z [2024-03-21 01:27:01,488: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:27:01.542515037Z [2024-03-21 01:27:01,538: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:27:01.626092914Z [2024-03-21 01:27:01,625: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T01:27:01.630356142Z [2024-03-21 01:27:01,629: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:27:01.655047134Z [2024-03-21 01:27:01,654: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:27:01.656235348Z [2024-03-21 01:27:01,655: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:27:01.656513509Z [2024-03-21 01:27:01,656: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:27:01.656630066Z [2024-03-21 01:27:01,656: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T01:27:01.656957981Z [2024-03-21 01:27:01,656: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:27:01.781693976Z [2024-03-21 01:27:01,781: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:27:02.603494211Z [2024-03-21 01:27:02,602: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7ea15567-996d-4fd8-99ff-d55ac08b5fe7] succeeded in 1.4585781420000785s: None
2024-03-21T01:27:02.977860411Z [2024-03-21 01:27:02,977: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:27:02.993678150Z [2024-03-21 01:27:02,993: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:27:03.037592236Z [2024-03-21 01:27:03,037: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:27:03.039006007Z [2024-03-21 01:27:03,038: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:27:03.039027368Z [2024-03-21 01:27:03,038: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:27:03.039089800Z [2024-03-21 01:27:03,038: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:27:03.039135744Z [2024-03-21 01:27:03,039: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:27:03.039443503Z [2024-03-21 01:27:03,039: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:27:03.039483990Z [2024-03-21 01:27:03,039: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:27:03.172736108Z [2024-03-21 01:27:03,172: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:27:03.210230186Z [2024-03-21 01:27:03,209: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:27:03.213836216Z [2024-03-21 01:27:03,213: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:27:03.243432550Z [2024-03-21 01:27:03,243: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:27:03.245197285Z [2024-03-21 01:27:03,244: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:27:03.245219608Z [2024-03-21 01:27:03,245: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:27:03.245463391Z [2024-03-21 01:27:03,245: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:27:03.245697412Z [2024-03-21 01:27:03,245: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:27:03.246174724Z [2024-03-21 01:27:03,245: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:27:03.246338508Z [2024-03-21 01:27:03,246: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:27:03.358708845Z [2024-03-21 01:27:03,358: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:27:06.589388673Z [2024-03-21 01:27:06,588: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[636dbf91-404a-41a7-bcb2-f1a14c4e72f7] succeeded in 5.466995437000151s: None
2024-03-21T01:27:06.790503724Z [2024-03-21 01:27:06,789: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[055b9c34-c58b-4ba3-bf74-6634f2ef35b6] succeeded in 5.6455952320002325s: None
2024-03-21T01:28:01.261686171Z [2024-03-21 01:28:01,261: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7959dd71-a969-478d-9637-dfdd7b475c9d] received
2024-03-21T01:28:01.265726859Z [2024-03-21 01:28:01,265: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1cc72949-c0d2-4e5e-95bf-86aeec245237] received
2024-03-21T01:28:01.277527021Z [2024-03-21 01:28:01,277: INFO/ForkPoolWorker-15] [7959dd71-a969-478d-9637-dfdd7b475c9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:28:01.277982369Z [2024-03-21 01:28:01,277: INFO/ForkPoolWorker-16] [1cc72949-c0d2-4e5e-95bf-86aeec245237] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:28:01.282600355Z [2024-03-21 01:28:01,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90b0c638-a29f-46e1-9aed-cc82c9ca602c] received
2024-03-21T01:28:01.289692633Z [2024-03-21 01:28:01,289: INFO/ForkPoolWorker-1] [90b0c638-a29f-46e1-9aed-cc82c9ca602c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:28:01.290150759Z [2024-03-21 01:28:01,289: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb9c6393-9d64-4447-97ef-0eba369394df] received
2024-03-21T01:28:01.318877551Z [2024-03-21 01:28:01,318: INFO/ForkPoolWorker-2] [fb9c6393-9d64-4447-97ef-0eba369394df] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:28:01.705621445Z [2024-03-21 01:28:01,702: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:28:01.747100010Z [2024-03-21 01:28:01,743: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:28:01.785265275Z [2024-03-21 01:28:01,781: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:28:01.861485654Z [2024-03-21 01:28:01,860: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T01:28:01.865720420Z [2024-03-21 01:28:01,865: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:28:01.878835879Z [2024-03-21 01:28:01,874: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:28:01.908985888Z [2024-03-21 01:28:01,908: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:28:01.910216468Z [2024-03-21 01:28:01,909: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:28:01.910412085Z [2024-03-21 01:28:01,910: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:28:01.910558333Z [2024-03-21 01:28:01,910: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T01:28:01.910845700Z [2024-03-21 01:28:01,910: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:28:02.047777966Z [2024-03-21 01:28:02,047: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:28:02.079160539Z [2024-03-21 01:28:02,078: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:28:02.872720834Z [2024-03-21 01:28:02,872: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fb9c6393-9d64-4447-97ef-0eba369394df] succeeded in 1.5641711259995645s: None
2024-03-21T01:28:02.908969383Z [2024-03-21 01:28:02,908: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7959dd71-a969-478d-9637-dfdd7b475c9d] succeeded in 1.6414941490002093s: None
2024-03-21T01:28:03.304221758Z [2024-03-21 01:28:03,303: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:28:03.307815424Z [2024-03-21 01:28:03,307: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:28:03.329842181Z [2024-03-21 01:28:03,329: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:28:03.332392958Z [2024-03-21 01:28:03,331: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:28:03.332987378Z [2024-03-21 01:28:03,332: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:28:03.333457416Z [2024-03-21 01:28:03,332: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:28:03.333695200Z [2024-03-21 01:28:03,333: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:28:03.334595231Z [2024-03-21 01:28:03,334: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:28:03.334965545Z [2024-03-21 01:28:03,334: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:28:03.456581013Z [2024-03-21 01:28:03,456: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:28:03.477512584Z [2024-03-21 01:28:03,477: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:28:03.481051931Z [2024-03-21 01:28:03,480: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:28:03.502917427Z [2024-03-21 01:28:03,502: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:28:03.504127695Z [2024-03-21 01:28:03,503: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:28:03.504226760Z [2024-03-21 01:28:03,504: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:28:03.504440447Z [2024-03-21 01:28:03,504: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:28:03.504522587Z [2024-03-21 01:28:03,504: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:28:03.504811459Z [2024-03-21 01:28:03,504: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:28:03.504939981Z [2024-03-21 01:28:03,504: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:28:03.592172174Z [2024-03-21 01:28:03,591: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:28:07.037588826Z [2024-03-21 01:28:07,037: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1cc72949-c0d2-4e5e-95bf-86aeec245237] succeeded in 5.769825375000437s: None
2024-03-21T01:28:07.193715330Z [2024-03-21 01:28:07,192: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[90b0c638-a29f-46e1-9aed-cc82c9ca602c] succeeded in 5.908623919000092s: None
2024-03-21T01:29:01.263969220Z [2024-03-21 01:29:01,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7822d44a-75fb-4f87-9357-0e0469126658] received
2024-03-21T01:29:01.273215557Z [2024-03-21 01:29:01,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d50ec3c1-bf88-4cf0-9e4e-02e5008cf05d] received
2024-03-21T01:29:01.276038866Z [2024-03-21 01:29:01,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94e66bae-5b14-4270-8f18-7182472b7a84] received
2024-03-21T01:29:01.278051674Z [2024-03-21 01:29:01,277: INFO/ForkPoolWorker-15] [7822d44a-75fb-4f87-9357-0e0469126658] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:29:01.290422927Z [2024-03-21 01:29:01,290: INFO/ForkPoolWorker-16] [d50ec3c1-bf88-4cf0-9e4e-02e5008cf05d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:29:01.290802435Z [2024-03-21 01:29:01,290: INFO/ForkPoolWorker-1] [94e66bae-5b14-4270-8f18-7182472b7a84] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:29:01.594622294Z [2024-03-21 01:29:01,591: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:29:01.734631061Z [2024-03-21 01:29:01,728: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:29:01.750085420Z [2024-03-21 01:29:01,745: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:29:01.946476348Z [2024-03-21 01:29:01,945: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T01:29:01.951673034Z [2024-03-21 01:29:01,951: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:29:01.984512265Z [2024-03-21 01:29:01,984: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:29:01.989579928Z [2024-03-21 01:29:01,989: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:29:01.991896071Z [2024-03-21 01:29:01,991: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:29:01.992159633Z [2024-03-21 01:29:01,991: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T01:29:01.992681924Z [2024-03-21 01:29:01,992: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:29:02.174227268Z [2024-03-21 01:29:02,173: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:29:02.930589660Z [2024-03-21 01:29:02,930: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[94e66bae-5b14-4270-8f18-7182472b7a84] succeeded in 1.6511830429999463s: None
2024-03-21T01:29:03.065580417Z [2024-03-21 01:29:03,065: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:29:03.069364279Z [2024-03-21 01:29:03,068: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:29:03.099330137Z [2024-03-21 01:29:03,098: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:29:03.101188251Z [2024-03-21 01:29:03,100: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:29:03.101317111Z [2024-03-21 01:29:03,101: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:29:03.101586571Z [2024-03-21 01:29:03,101: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:29:03.101797180Z [2024-03-21 01:29:03,101: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:29:03.102208700Z [2024-03-21 01:29:03,101: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:29:03.102403587Z [2024-03-21 01:29:03,102: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:29:03.124187864Z [2024-03-21 01:29:03,123: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:29:03.127832222Z [2024-03-21 01:29:03,127: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:29:03.151369014Z [2024-03-21 01:29:03,151: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:29:03.152891405Z [2024-03-21 01:29:03,152: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:29:03.152919504Z [2024-03-21 01:29:03,152: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:29:03.153261625Z [2024-03-21 01:29:03,152: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:29:03.153334361Z [2024-03-21 01:29:03,153: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:29:03.153656075Z [2024-03-21 01:29:03,153: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:29:03.153672414Z [2024-03-21 01:29:03,153: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:29:03.223775124Z [2024-03-21 01:29:03,223: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:29:03.251496404Z [2024-03-21 01:29:03,251: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:29:07.308405475Z [2024-03-21 01:29:07,307: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7822d44a-75fb-4f87-9357-0e0469126658] succeeded in 6.04072174599969s: None
2024-03-21T01:29:07.783004702Z [2024-03-21 01:29:07,782: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d50ec3c1-bf88-4cf0-9e4e-02e5008cf05d] succeeded in 6.508068570999967s: None
2024-03-21T01:30:01.320868972Z [2024-03-21 01:30:01,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c2d3d3c-fe21-4c7a-9395-2aea53d5413f] received
2024-03-21T01:30:01.326062253Z [2024-03-21 01:30:01,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f75fc5b-2135-4ee9-bd94-da5efbecfecf] received
2024-03-21T01:30:01.328998374Z [2024-03-21 01:30:01,328: INFO/ForkPoolWorker-15] [0c2d3d3c-fe21-4c7a-9395-2aea53d5413f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:30:01.337502670Z [2024-03-21 01:30:01,336: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73fc3c5f-729d-4645-9f24-f76096a4a7d9] received
2024-03-21T01:30:01.341591530Z [2024-03-21 01:30:01,341: INFO/ForkPoolWorker-16] [3f75fc5b-2135-4ee9-bd94-da5efbecfecf] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:30:01.343917714Z [2024-03-21 01:30:01,343: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2040101b-21f0-4564-ab80-83f1ebc5e236] received
2024-03-21T01:30:01.347087294Z [2024-03-21 01:30:01,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f74cbf26-fc67-4d35-be51-5d421076584b] received
2024-03-21T01:30:01.353229240Z [2024-03-21 01:30:01,352: INFO/ForkPoolWorker-2] [2040101b-21f0-4564-ab80-83f1ebc5e236] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:30:01.355599732Z [2024-03-21 01:30:01,355: INFO/ForkPoolWorker-1] [73fc3c5f-729d-4645-9f24-f76096a4a7d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:30:01.393142293Z [2024-03-21 01:30:01,387: INFO/ForkPoolWorker-3] [f74cbf26-fc67-4d35-be51-5d421076584b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:30:01.701394206Z [2024-03-21 01:30:01,697: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:30:01.815376203Z [2024-03-21 01:30:01,810: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:30:01.853637764Z [2024-03-21 01:30:01,849: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:30:02.012278417Z [2024-03-21 01:30:02,011: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T01:30:02.021012197Z [2024-03-21 01:30:02,015: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:30:02.025541558Z [2024-03-21 01:30:02,021: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:30:02.044272100Z [2024-03-21 01:30:02,039: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:30:02.093887663Z [2024-03-21 01:30:02,093: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:30:02.097618062Z [2024-03-21 01:30:02,097: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:30:02.097688176Z [2024-03-21 01:30:02,097: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:30:02.097704489Z [2024-03-21 01:30:02,097: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T01:30:02.097949433Z [2024-03-21 01:30:02,097: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:30:02.210308320Z [2024-03-21 01:30:02,209: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:30:02.615431064Z [2024-03-21 01:30:02,615: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:30:03.175063340Z [2024-03-21 01:30:03,174: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2040101b-21f0-4564-ab80-83f1ebc5e236] succeeded in 1.8282502769998246s: None
2024-03-21T01:30:03.427457808Z [2024-03-21 01:30:03,427: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3f75fc5b-2135-4ee9-bd94-da5efbecfecf] succeeded in 2.097804322000229s: None
2024-03-21T01:30:03.654858337Z [2024-03-21 01:30:03,654: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:30:03.658159664Z [2024-03-21 01:30:03,657: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:30:03.685442820Z [2024-03-21 01:30:03,685: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:30:03.687100093Z [2024-03-21 01:30:03,686: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:30:03.687236252Z [2024-03-21 01:30:03,687: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:30:03.687487093Z [2024-03-21 01:30:03,687: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:30:03.687617550Z [2024-03-21 01:30:03,687: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:30:03.687894082Z [2024-03-21 01:30:03,687: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:30:03.687928308Z [2024-03-21 01:30:03,687: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:30:03.758665866Z [2024-03-21 01:30:03,758: INFO/ForkPoolWorker-3] Getting VIM list
2024-03-21T01:30:03.762203373Z [2024-03-21 01:30:03,761: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:30:03.771441401Z [2024-03-21 01:30:03,771: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:30:03.781842448Z [2024-03-21 01:30:03,781: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-21T01:30:03.783087988Z [2024-03-21 01:30:03,782: INFO/ForkPoolWorker-3] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:30:03.783101267Z [2024-03-21 01:30:03,782: INFO/ForkPoolWorker-3] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:30:03.783211135Z [2024-03-21 01:30:03,783: INFO/ForkPoolWorker-3] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:30:03.783229526Z [2024-03-21 01:30:03,783: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-03-21T01:30:03.783477218Z [2024-03-21 01:30:03,783: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:30:03.783493987Z [2024-03-21 01:30:03,783: INFO/ForkPoolWorker-3] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:30:03.896964437Z [2024-03-21 01:30:03,896: INFO/ForkPoolWorker-3] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:30:03.980213579Z [2024-03-21 01:30:03,979: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:30:03.983768509Z [2024-03-21 01:30:03,983: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:30:04.000807945Z [2024-03-21 01:30:04,000: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:30:04.007203825Z [2024-03-21 01:30:04,006: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:30:04.007279770Z [2024-03-21 01:30:04,007: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:30:04.007304018Z [2024-03-21 01:30:04,007: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:30:04.007324106Z [2024-03-21 01:30:04,007: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:30:04.007639299Z [2024-03-21 01:30:04,007: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:30:04.007730093Z [2024-03-21 01:30:04,007: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:30:04.111340942Z [2024-03-21 01:30:04,111: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T01:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:30:04.826336326Z [2024-03-21 01:30:04,825: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0c2d3d3c-fe21-4c7a-9395-2aea53d5413f] succeeded in 3.5042280170000595s: None
2024-03-21T01:30:05.103948825Z [2024-03-21 01:30:05,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db778c5c-5c8e-4839-ad3e-1d0dcb20b2f3] received
2024-03-21T01:30:05.112220285Z [2024-03-21 01:30:05,111: INFO/ForkPoolWorker-15] [db778c5c-5c8e-4839-ad3e-1d0dcb20b2f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:30:05.454468950Z [2024-03-21 01:30:05,451: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:30:05.686349265Z [2024-03-21 01:30:05,685: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[f74cbf26-fc67-4d35-be51-5d421076584b] succeeded in 4.329886294000062s: None
2024-03-21T01:30:05.794566666Z [2024-03-21 01:30:05,794: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[73fc3c5f-729d-4645-9f24-f76096a4a7d9] succeeded in 4.4531126389993005s: None
2024-03-21T01:30:06.632036626Z [2024-03-21 01:30:06,631: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:30:06.635350055Z [2024-03-21 01:30:06,634: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:30:06.651497277Z [2024-03-21 01:30:06,651: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:30:06.652792205Z [2024-03-21 01:30:06,652: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:30:06.652886071Z [2024-03-21 01:30:06,652: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:30:06.653028909Z [2024-03-21 01:30:06,652: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:30:06.653121408Z [2024-03-21 01:30:06,653: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:30:06.653351245Z [2024-03-21 01:30:06,653: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:30:06.653447439Z [2024-03-21 01:30:06,653: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:30:06.727428543Z [2024-03-21 01:30:06,727: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T01:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:30:07.307775568Z [2024-03-21 01:30:07,307: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[db778c5c-5c8e-4839-ad3e-1d0dcb20b2f3] succeeded in 2.2017657810001765s: None
2024-03-21T01:30:07.507741774Z [2024-03-21 01:30:07,507: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ec606c7-f2cf-4292-b068-852bfd438378] received
2024-03-21T01:30:07.518746902Z [2024-03-21 01:30:07,518: INFO/ForkPoolWorker-15] [2ec606c7-f2cf-4292-b068-852bfd438378] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T01:30:07.777024491Z [2024-03-21 01:30:07,773: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:30:08.911994895Z [2024-03-21 01:30:08,911: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:30:08.915168429Z [2024-03-21 01:30:08,914: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:30:08.931045201Z [2024-03-21 01:30:08,930: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:30:08.932405439Z [2024-03-21 01:30:08,932: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:30:08.932429440Z [2024-03-21 01:30:08,932: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:30:08.932566888Z [2024-03-21 01:30:08,932: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:30:08.932576599Z [2024-03-21 01:30:08,932: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:30:08.933404215Z [2024-03-21 01:30:08,933: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:30:08.933419504Z [2024-03-21 01:30:08,933: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:30:09.009676600Z [2024-03-21 01:30:09,009: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T01:25:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:30:09.617541407Z [2024-03-21 01:30:09,617: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2ec606c7-f2cf-4292-b068-852bfd438378] succeeded in 2.1066182009999466s: None
2024-03-21T01:30:10.144391368Z [2024-03-21 01:30:10,143: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4bcfe94d-a61b-40d0-aeb2-3ce9e1c48880] received
2024-03-21T01:30:10.165583507Z [2024-03-21 01:30:10,164: INFO/ForkPoolWorker-15] [4bcfe94d-a61b-40d0-aeb2-3ce9e1c48880] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:30:10.600814129Z [2024-03-21 01:30:10,596: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:30:12.018665604Z [2024-03-21 01:30:12,018: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:30:12.022471363Z [2024-03-21 01:30:12,021: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:30:12.047867989Z [2024-03-21 01:30:12,047: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:30:12.050090693Z [2024-03-21 01:30:12,049: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:30:12.050121355Z [2024-03-21 01:30:12,049: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:30:12.050300063Z [2024-03-21 01:30:12,050: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:30:12.050344688Z [2024-03-21 01:30:12,050: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:30:12.051006629Z [2024-03-21 01:30:12,050: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:30:12.051129410Z [2024-03-21 01:30:12,050: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:30:12.146009509Z [2024-03-21 01:30:12,145: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T01:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:30:12.690637589Z [2024-03-21 01:30:12,690: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4bcfe94d-a61b-40d0-aeb2-3ce9e1c48880] succeeded in 2.5437725669999054s: None
2024-03-21T01:31:00.231408341Z [2024-03-21 01:31:00,231: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1da6b88f-30cc-4b70-8a52-ff076a67e851] received
2024-03-21T01:31:00.236755689Z [2024-03-21 01:31:00,236: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e500938-3d19-41e9-9ea6-1608bc34a8b3] received
2024-03-21T01:31:00.246112988Z [2024-03-21 01:31:00,245: INFO/ForkPoolWorker-15] [1da6b88f-30cc-4b70-8a52-ff076a67e851] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:31:00.248199752Z [2024-03-21 01:31:00,247: INFO/ForkPoolWorker-16] [1e500938-3d19-41e9-9ea6-1608bc34a8b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:31:00.253852499Z [2024-03-21 01:31:00,253: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6fff40a-a8c2-46bd-8f53-03e09502df8f] received
2024-03-21T01:31:00.261023726Z [2024-03-21 01:31:00,260: INFO/ForkPoolWorker-1] [d6fff40a-a8c2-46bd-8f53-03e09502df8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:31:00.538732314Z [2024-03-21 01:31:00,535: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:31:00.566085069Z [2024-03-21 01:31:00,562: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:31:00.570912523Z [2024-03-21 01:31:00,567: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:31:00.727266996Z [2024-03-21 01:31:00,726: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T01:31:00.731519960Z [2024-03-21 01:31:00,731: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:31:00.756283831Z [2024-03-21 01:31:00,755: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:31:00.757533039Z [2024-03-21 01:31:00,757: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:31:00.757932874Z [2024-03-21 01:31:00,757: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:31:00.759362005Z [2024-03-21 01:31:00,757: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T01:31:00.759720548Z [2024-03-21 01:31:00,759: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:31:00.891665849Z [2024-03-21 01:31:00,891: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:31:01.522417762Z [2024-03-21 01:31:01,521: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d6fff40a-a8c2-46bd-8f53-03e09502df8f] succeeded in 1.2669394109998393s: None
2024-03-21T01:31:01.803604777Z [2024-03-21 01:31:01,803: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:31:01.807658752Z [2024-03-21 01:31:01,807: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:31:01.830909982Z [2024-03-21 01:31:01,830: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:31:01.832829615Z [2024-03-21 01:31:01,832: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:31:01.832966298Z [2024-03-21 01:31:01,832: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:31:01.833181603Z [2024-03-21 01:31:01,832: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:31:01.833292121Z [2024-03-21 01:31:01,833: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:31:01.833650940Z [2024-03-21 01:31:01,833: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:31:01.834145180Z [2024-03-21 01:31:01,833: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:31:01.916919741Z [2024-03-21 01:31:01,916: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:31:01.949932587Z [2024-03-21 01:31:01,949: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:31:01.953408989Z [2024-03-21 01:31:01,952: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:31:01.978302248Z [2024-03-21 01:31:01,977: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:31:01.980243499Z [2024-03-21 01:31:01,979: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:31:01.980623108Z [2024-03-21 01:31:01,980: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:31:01.981019918Z [2024-03-21 01:31:01,980: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:31:01.981225139Z [2024-03-21 01:31:01,981: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:31:01.981804817Z [2024-03-21 01:31:01,981: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:31:01.981937043Z [2024-03-21 01:31:01,981: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:31:02.092917903Z [2024-03-21 01:31:02,092: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:31:03.716015062Z [2024-03-21 01:31:03,715: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1e500938-3d19-41e9-9ea6-1608bc34a8b3] succeeded in 3.475492567999936s: None
2024-03-21T01:31:04.224261827Z [2024-03-21 01:31:04,223: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1da6b88f-30cc-4b70-8a52-ff076a67e851] succeeded in 3.988745719999315s: None
2024-03-21T01:32:01.090854554Z [2024-03-21 01:32:01,090: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e728ae23-afb0-47c0-aef8-7abdbd018b97] received
2024-03-21T01:32:01.093297051Z [2024-03-21 01:32:01,093: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77642215-cedf-4b94-b421-6906301e6c3c] received
2024-03-21T01:32:01.097224322Z [2024-03-21 01:32:01,097: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b796a3a-5480-46ac-a9b7-720329e12975] received
2024-03-21T01:32:01.109061472Z [2024-03-21 01:32:01,108: INFO/ForkPoolWorker-16] [77642215-cedf-4b94-b421-6906301e6c3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:32:01.109700117Z [2024-03-21 01:32:01,109: INFO/ForkPoolWorker-1] [8b796a3a-5480-46ac-a9b7-720329e12975] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:32:01.113267356Z [2024-03-21 01:32:01,113: INFO/ForkPoolWorker-15] [e728ae23-afb0-47c0-aef8-7abdbd018b97] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:32:01.116537074Z [2024-03-21 01:32:01,116: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c0c0f8e-a8dd-40d6-a3d0-bae4a6420bc2] received
2024-03-21T01:32:01.138086971Z [2024-03-21 01:32:01,137: INFO/ForkPoolWorker-2] [8c0c0f8e-a8dd-40d6-a3d0-bae4a6420bc2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:32:01.649745714Z [2024-03-21 01:32:01,642: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:32:01.680776280Z [2024-03-21 01:32:01,675: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:32:01.697861391Z [2024-03-21 01:32:01,694: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:32:01.931032961Z [2024-03-21 01:32:01,925: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:32:02.126033971Z [2024-03-21 01:32:02,125: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:32:02.377810606Z [2024-03-21 01:32:02,377: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T01:32:02.385192918Z [2024-03-21 01:32:02,384: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:32:02.534670883Z [2024-03-21 01:32:02,534: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:32:02.537723714Z [2024-03-21 01:32:02,537: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:32:02.537944599Z [2024-03-21 01:32:02,537: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:32:02.538084029Z [2024-03-21 01:32:02,537: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T01:32:02.538471821Z [2024-03-21 01:32:02,538: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:32:02.697884184Z [2024-03-21 01:32:02,697: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:32:03.013444181Z [2024-03-21 01:32:03,012: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e728ae23-afb0-47c0-aef8-7abdbd018b97] succeeded in 1.919962680000026s: None
2024-03-21T01:32:03.391948677Z [2024-03-21 01:32:03,390: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:32:03.399327178Z [2024-03-21 01:32:03,398: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:32:03.427973302Z [2024-03-21 01:32:03,427: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:32:03.431358702Z [2024-03-21 01:32:03,430: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8c0c0f8e-a8dd-40d6-a3d0-bae4a6420bc2] succeeded in 2.312522082000214s: None
2024-03-21T01:32:03.432479504Z [2024-03-21 01:32:03,431: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:32:03.432761895Z [2024-03-21 01:32:03,432: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:32:03.433044425Z [2024-03-21 01:32:03,432: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:32:03.433076337Z [2024-03-21 01:32:03,432: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:32:03.433504728Z [2024-03-21 01:32:03,433: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:32:03.434176006Z [2024-03-21 01:32:03,433: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:32:03.549139490Z [2024-03-21 01:32:03,548: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:32:03.609481600Z [2024-03-21 01:32:03,609: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:32:03.613063703Z [2024-03-21 01:32:03,612: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:32:03.635033123Z [2024-03-21 01:32:03,634: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:32:03.636655547Z [2024-03-21 01:32:03,636: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:32:03.636723332Z [2024-03-21 01:32:03,636: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:32:03.636916848Z [2024-03-21 01:32:03,636: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:32:03.636997909Z [2024-03-21 01:32:03,636: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:32:03.637516367Z [2024-03-21 01:32:03,637: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:32:03.637576836Z [2024-03-21 01:32:03,637: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:32:03.735648479Z [2024-03-21 01:32:03,735: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:32:06.016256229Z [2024-03-21 01:32:06,015: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8b796a3a-5480-46ac-a9b7-720329e12975] succeeded in 4.916611192999881s: None
2024-03-21T01:32:06.866640778Z [2024-03-21 01:32:06,866: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[77642215-cedf-4b94-b421-6906301e6c3c] succeeded in 5.7716450480002095s: None
2024-03-21T01:33:00.881872733Z [2024-03-21 01:33:00,881: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[199c66e4-73ce-463f-b1bf-3344cde56f36] received
2024-03-21T01:33:00.885202312Z [2024-03-21 01:33:00,884: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87cb5323-aa43-424f-8187-67be7623d80b] received
2024-03-21T01:33:00.887982213Z [2024-03-21 01:33:00,887: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[629c6d7c-1b36-4e1d-b5e7-7d743eae67da] received
2024-03-21T01:33:00.892165394Z [2024-03-21 01:33:00,891: INFO/ForkPoolWorker-16] [87cb5323-aa43-424f-8187-67be7623d80b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:33:00.893019179Z [2024-03-21 01:33:00,892: INFO/ForkPoolWorker-15] [199c66e4-73ce-463f-b1bf-3344cde56f36] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:33:00.901884526Z [2024-03-21 01:33:00,901: INFO/ForkPoolWorker-1] [629c6d7c-1b36-4e1d-b5e7-7d743eae67da] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:33:01.190594074Z [2024-03-21 01:33:01,187: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:33:01.200152412Z [2024-03-21 01:33:01,197: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:33:01.256413215Z [2024-03-21 01:33:01,253: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:33:01.376026846Z [2024-03-21 01:33:01,375: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T01:33:01.380241471Z [2024-03-21 01:33:01,379: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:33:01.431446836Z [2024-03-21 01:33:01,431: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:33:01.434748317Z [2024-03-21 01:33:01,434: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:33:01.435104439Z [2024-03-21 01:33:01,434: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:33:01.435319090Z [2024-03-21 01:33:01,435: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T01:33:01.435781488Z [2024-03-21 01:33:01,435: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:33:01.542479041Z [2024-03-21 01:33:01,542: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:33:02.392495898Z [2024-03-21 01:33:02,391: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[629c6d7c-1b36-4e1d-b5e7-7d743eae67da] succeeded in 1.5025423060005778s: None
2024-03-21T01:33:02.526499896Z [2024-03-21 01:33:02,526: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:33:02.530045515Z [2024-03-21 01:33:02,529: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:33:02.551460456Z [2024-03-21 01:33:02,551: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:33:02.554520442Z [2024-03-21 01:33:02,554: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:33:02.554537199Z [2024-03-21 01:33:02,554: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:33:02.556376695Z [2024-03-21 01:33:02,554: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:33:02.556451538Z [2024-03-21 01:33:02,556: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:33:02.556801657Z [2024-03-21 01:33:02,556: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:33:02.556916438Z [2024-03-21 01:33:02,556: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:33:02.582613901Z [2024-03-21 01:33:02,582: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:33:02.586417830Z [2024-03-21 01:33:02,585: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:33:02.606240363Z [2024-03-21 01:33:02,606: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:33:02.607559977Z [2024-03-21 01:33:02,607: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:33:02.607572758Z [2024-03-21 01:33:02,607: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:33:02.607840074Z [2024-03-21 01:33:02,607: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:33:02.607857600Z [2024-03-21 01:33:02,607: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:33:02.608256401Z [2024-03-21 01:33:02,608: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:33:02.608398730Z [2024-03-21 01:33:02,608: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:33:02.672089354Z [2024-03-21 01:33:02,671: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:33:02.689199686Z [2024-03-21 01:33:02,688: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:33:04.218415529Z [2024-03-21 01:33:04,216: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[87cb5323-aa43-424f-8187-67be7623d80b] succeeded in 3.329986779000137s: None
2024-03-21T01:33:04.609866483Z [2024-03-21 01:33:04,609: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[199c66e4-73ce-463f-b1bf-3344cde56f36] succeeded in 3.724455816000045s: None
2024-03-21T01:34:00.752016735Z [2024-03-21 01:34:00,751: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96091780-f927-48ed-ad85-5a1d67fe7969] received
2024-03-21T01:34:00.755908614Z [2024-03-21 01:34:00,755: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef464763-bfbf-4ee6-94c0-2be73aa2ebe4] received
2024-03-21T01:34:00.762280854Z [2024-03-21 01:34:00,762: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74d0d92f-2e83-458b-bc89-6e110f4a4dc5] received
2024-03-21T01:34:00.763224979Z [2024-03-21 01:34:00,762: INFO/ForkPoolWorker-16] [ef464763-bfbf-4ee6-94c0-2be73aa2ebe4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:34:00.767660129Z [2024-03-21 01:34:00,767: INFO/ForkPoolWorker-15] [96091780-f927-48ed-ad85-5a1d67fe7969] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:34:00.768408269Z [2024-03-21 01:34:00,767: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31c7de0a-5edb-4797-89de-13644c7f4a01] received
2024-03-21T01:34:00.784810406Z [2024-03-21 01:34:00,784: INFO/ForkPoolWorker-1] [74d0d92f-2e83-458b-bc89-6e110f4a4dc5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:34:00.784987090Z [2024-03-21 01:34:00,784: INFO/ForkPoolWorker-2] [31c7de0a-5edb-4797-89de-13644c7f4a01] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:34:01.143520330Z [2024-03-21 01:34:01,140: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:34:01.183654132Z [2024-03-21 01:34:01,180: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:34:01.188487945Z [2024-03-21 01:34:01,184: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:34:01.240495673Z [2024-03-21 01:34:01,236: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:34:01.417142414Z [2024-03-21 01:34:01,416: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T01:34:01.421575945Z [2024-03-21 01:34:01,421: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:34:01.480912289Z [2024-03-21 01:34:01,480: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:34:01.485617312Z [2024-03-21 01:34:01,485: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:34:01.485925584Z [2024-03-21 01:34:01,485: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:34:01.486103018Z [2024-03-21 01:34:01,485: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T01:34:01.488272845Z [2024-03-21 01:34:01,486: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:34:01.540863363Z [2024-03-21 01:34:01,540: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:34:01.693517859Z [2024-03-21 01:34:01,693: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:34:02.202927136Z [2024-03-21 01:34:02,202: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[96091780-f927-48ed-ad85-5a1d67fe7969] succeeded in 1.4473567370005185s: None
2024-03-21T01:34:02.601706641Z [2024-03-21 01:34:02,601: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[31c7de0a-5edb-4797-89de-13644c7f4a01] succeeded in 1.8309754720003184s: None
2024-03-21T01:34:02.790276576Z [2024-03-21 01:34:02,789: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:34:02.794121115Z [2024-03-21 01:34:02,793: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:34:02.815349669Z [2024-03-21 01:34:02,815: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:34:02.816927780Z [2024-03-21 01:34:02,816: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:34:02.817142105Z [2024-03-21 01:34:02,816: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:34:02.817364345Z [2024-03-21 01:34:02,817: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:34:02.817533366Z [2024-03-21 01:34:02,817: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:34:02.818297153Z [2024-03-21 01:34:02,818: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:34:02.818663560Z [2024-03-21 01:34:02,818: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:34:02.903980562Z [2024-03-21 01:34:02,903: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:34:02.947528192Z [2024-03-21 01:34:02,946: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:34:02.951625785Z [2024-03-21 01:34:02,950: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:34:02.978863450Z [2024-03-21 01:34:02,978: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:34:02.980584763Z [2024-03-21 01:34:02,980: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:34:02.980753630Z [2024-03-21 01:34:02,980: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:34:02.980940685Z [2024-03-21 01:34:02,980: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:34:02.981075209Z [2024-03-21 01:34:02,980: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:34:02.981568413Z [2024-03-21 01:34:02,981: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:34:02.981685918Z [2024-03-21 01:34:02,981: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:34:03.075565668Z [2024-03-21 01:34:03,075: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:34:04.385761322Z [2024-03-21 01:34:04,385: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ef464763-bfbf-4ee6-94c0-2be73aa2ebe4] succeeded in 3.6273749350002618s: None
2024-03-21T01:34:05.028203039Z [2024-03-21 01:34:05,027: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[74d0d92f-2e83-458b-bc89-6e110f4a4dc5] succeeded in 4.263754205000623s: None
2024-03-21T01:35:00.482651391Z [2024-03-21 01:35:00,482: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e72ba1b1-557b-424a-b69a-dc082f9728d6] received
2024-03-21T01:35:00.487129911Z [2024-03-21 01:35:00,486: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e5f00fa-308f-4395-8540-f48b62e0f60a] received
2024-03-21T01:35:00.490892772Z [2024-03-21 01:35:00,490: INFO/ForkPoolWorker-15] [e72ba1b1-557b-424a-b69a-dc082f9728d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:35:00.498109241Z [2024-03-21 01:35:00,497: INFO/ForkPoolWorker-16] [0e5f00fa-308f-4395-8540-f48b62e0f60a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:35:00.517191821Z [2024-03-21 01:35:00,516: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a12e5ca5-45e9-4d40-92f9-7c4b79415959] received
2024-03-21T01:35:00.520280407Z [2024-03-21 01:35:00,520: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1dacbbc-afe7-4df8-95cf-7b243a15263f] received
2024-03-21T01:35:00.526154851Z [2024-03-21 01:35:00,524: INFO/ForkPoolWorker-1] [a12e5ca5-45e9-4d40-92f9-7c4b79415959] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:35:00.547019494Z [2024-03-21 01:35:00,546: INFO/ForkPoolWorker-2] [d1dacbbc-afe7-4df8-95cf-7b243a15263f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:35:00.878883326Z [2024-03-21 01:35:00,875: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:35:00.891258876Z [2024-03-21 01:35:00,887: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:35:00.939401784Z [2024-03-21 01:35:00,935: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:35:00.957846829Z [2024-03-21 01:35:00,952: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:35:01.066373279Z [2024-03-21 01:35:01,065: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T01:35:01.070319420Z [2024-03-21 01:35:01,069: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:35:01.099699368Z [2024-03-21 01:35:01,099: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:35:01.101064502Z [2024-03-21 01:35:01,100: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:35:01.101148976Z [2024-03-21 01:35:01,100: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:35:01.101217996Z [2024-03-21 01:35:01,101: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T01:35:01.101879448Z [2024-03-21 01:35:01,101: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:35:01.217267472Z [2024-03-21 01:35:01,217: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:35:02.013770981Z [2024-03-21 01:35:02,013: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d1dacbbc-afe7-4df8-95cf-7b243a15263f] succeeded in 1.488187119000031s: None
2024-03-21T01:35:02.345892570Z [2024-03-21 01:35:02,345: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:35:02.351416619Z [2024-03-21 01:35:02,350: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:35:02.471371446Z [2024-03-21 01:35:02,471: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:35:02.484448028Z [2024-03-21 01:35:02,484: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:35:02.484506275Z [2024-03-21 01:35:02,484: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:35:02.484518600Z [2024-03-21 01:35:02,484: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:35:02.484523195Z [2024-03-21 01:35:02,484: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:35:02.485092547Z [2024-03-21 01:35:02,484: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:35:02.485101840Z [2024-03-21 01:35:02,484: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:35:02.575919896Z [2024-03-21 01:35:02,575: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:35:02.579780689Z [2024-03-21 01:35:02,579: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:35:02.599349911Z [2024-03-21 01:35:02,599: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T01:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:35:02.611528142Z [2024-03-21 01:35:02,611: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:35:02.613599942Z [2024-03-21 01:35:02,613: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:35:02.613938186Z [2024-03-21 01:35:02,613: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:35:02.614307790Z [2024-03-21 01:35:02,614: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:35:02.614617530Z [2024-03-21 01:35:02,614: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:35:02.616294634Z [2024-03-21 01:35:02,616: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:35:02.617363294Z [2024-03-21 01:35:02,617: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:35:02.680962239Z [2024-03-21 01:35:02,680: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:35:02.685427812Z [2024-03-21 01:35:02,684: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:35:02.714999295Z [2024-03-21 01:35:02,714: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:35:02.716497245Z [2024-03-21 01:35:02,716: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:35:02.716746027Z [2024-03-21 01:35:02,716: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:35:02.716996084Z [2024-03-21 01:35:02,716: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:35:02.717228337Z [2024-03-21 01:35:02,717: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:35:02.719104604Z [2024-03-21 01:35:02,717: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:35:02.719418346Z [2024-03-21 01:35:02,719: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:35:02.726170511Z [2024-03-21 01:35:02,725: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:35:02.877056999Z [2024-03-21 01:35:02,876: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:35:03.397827154Z [2024-03-21 01:35:03,397: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e72ba1b1-557b-424a-b69a-dc082f9728d6] succeeded in 2.9126227329998073s: None
2024-03-21T01:35:03.597136961Z [2024-03-21 01:35:03,596: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cada8341-f89e-4bcb-a4f1-25f8c5c43705] received
2024-03-21T01:35:03.604692657Z [2024-03-21 01:35:03,604: INFO/ForkPoolWorker-15] [cada8341-f89e-4bcb-a4f1-25f8c5c43705] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:35:03.902681295Z [2024-03-21 01:35:03,899: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:35:04.467826005Z [2024-03-21 01:35:04,467: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a12e5ca5-45e9-4d40-92f9-7c4b79415959] succeeded in 3.949017822999849s: None
2024-03-21T01:35:05.015750884Z [2024-03-21 01:35:05,015: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0e5f00fa-308f-4395-8540-f48b62e0f60a] succeeded in 4.5267784709994885s: None
2024-03-21T01:35:05.113386002Z [2024-03-21 01:35:05,113: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:35:05.116624352Z [2024-03-21 01:35:05,116: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:35:05.132927483Z [2024-03-21 01:35:05,132: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:35:05.134293551Z [2024-03-21 01:35:05,134: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:35:05.134360166Z [2024-03-21 01:35:05,134: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:35:05.134543937Z [2024-03-21 01:35:05,134: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:35:05.134638767Z [2024-03-21 01:35:05,134: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:35:05.134929299Z [2024-03-21 01:35:05,134: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:35:05.135031212Z [2024-03-21 01:35:05,134: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:35:05.209691734Z [2024-03-21 01:35:05,209: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T01:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:35:05.831125160Z [2024-03-21 01:35:05,830: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cada8341-f89e-4bcb-a4f1-25f8c5c43705] succeeded in 2.2312700290003704s: None
2024-03-21T01:35:06.134948270Z [2024-03-21 01:35:06,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41ddabbc-671d-4659-8f0e-6a967090b7f3] received
2024-03-21T01:35:06.144924802Z [2024-03-21 01:35:06,144: INFO/ForkPoolWorker-15] [41ddabbc-671d-4659-8f0e-6a967090b7f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T01:35:06.408198317Z [2024-03-21 01:35:06,405: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:35:07.518455438Z [2024-03-21 01:35:07,518: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:35:07.521704664Z [2024-03-21 01:35:07,521: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:35:07.541276459Z [2024-03-21 01:35:07,540: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:35:07.543287643Z [2024-03-21 01:35:07,543: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:35:07.543316349Z [2024-03-21 01:35:07,543: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:35:07.543424075Z [2024-03-21 01:35:07,543: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:35:07.543481956Z [2024-03-21 01:35:07,543: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:35:07.543767239Z [2024-03-21 01:35:07,543: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:35:07.543781537Z [2024-03-21 01:35:07,543: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:35:07.629056145Z [2024-03-21 01:35:07,628: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T01:30:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:35:08.115748992Z [2024-03-21 01:35:08,115: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[41ddabbc-671d-4659-8f0e-6a967090b7f3] succeeded in 1.9788528260005478s: None
2024-03-21T01:35:08.494712720Z [2024-03-21 01:35:08,493: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91d588de-a4c8-476a-9f63-bf4265cc2ccc] received
2024-03-21T01:35:08.500153311Z [2024-03-21 01:35:08,499: INFO/ForkPoolWorker-15] [91d588de-a4c8-476a-9f63-bf4265cc2ccc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:35:08.801509677Z [2024-03-21 01:35:08,798: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:35:10.028011696Z [2024-03-21 01:35:10,027: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:35:10.031425951Z [2024-03-21 01:35:10,030: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:35:10.069791707Z [2024-03-21 01:35:10,069: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:35:10.073841790Z [2024-03-21 01:35:10,073: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:35:10.073952188Z [2024-03-21 01:35:10,073: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:35:10.074015921Z [2024-03-21 01:35:10,073: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:35:10.074075614Z [2024-03-21 01:35:10,073: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:35:10.074376778Z [2024-03-21 01:35:10,074: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:35:10.074435795Z [2024-03-21 01:35:10,074: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:35:10.170620584Z [2024-03-21 01:35:10,170: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T01:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:35:10.833507821Z [2024-03-21 01:35:10,833: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[91d588de-a4c8-476a-9f63-bf4265cc2ccc] succeeded in 2.3387270830007765s: None
2024-03-21T01:36:00.313395444Z [2024-03-21 01:36:00,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d374fe07-adf0-4d00-a310-9584278a669e] received
2024-03-21T01:36:00.315769699Z [2024-03-21 01:36:00,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69fe7a00-9aa9-4e74-8a3a-d6050ff95832] received
2024-03-21T01:36:00.317917499Z [2024-03-21 01:36:00,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19e8759a-56e2-4002-93eb-165f9e1a92dc] received
2024-03-21T01:36:00.322551742Z [2024-03-21 01:36:00,322: INFO/ForkPoolWorker-15] [d374fe07-adf0-4d00-a310-9584278a669e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:36:00.327921011Z [2024-03-21 01:36:00,327: INFO/ForkPoolWorker-16] [69fe7a00-9aa9-4e74-8a3a-d6050ff95832] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:36:00.336351669Z [2024-03-21 01:36:00,336: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62bd7439-9c05-47f1-8ea5-738a04a24f69] received
2024-03-21T01:36:00.337154835Z [2024-03-21 01:36:00,336: INFO/ForkPoolWorker-1] [19e8759a-56e2-4002-93eb-165f9e1a92dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:36:00.350469914Z [2024-03-21 01:36:00,350: INFO/ForkPoolWorker-2] [62bd7439-9c05-47f1-8ea5-738a04a24f69] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:36:00.639612323Z [2024-03-21 01:36:00,636: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:36:00.646157597Z [2024-03-21 01:36:00,642: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:36:00.659453318Z [2024-03-21 01:36:00,656: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:36:00.694228312Z [2024-03-21 01:36:00,689: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:36:00.853489963Z [2024-03-21 01:36:00,852: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T01:36:00.871831882Z [2024-03-21 01:36:00,870: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:36:00.908891052Z [2024-03-21 01:36:00,908: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:36:00.924759505Z [2024-03-21 01:36:00,924: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:36:00.927353629Z [2024-03-21 01:36:00,927: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:36:00.927645877Z [2024-03-21 01:36:00,927: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:36:00.927704032Z [2024-03-21 01:36:00,927: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T01:36:00.927989608Z [2024-03-21 01:36:00,927: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:36:01.081184243Z [2024-03-21 01:36:01,080: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:36:01.499245647Z [2024-03-21 01:36:01,498: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d374fe07-adf0-4d00-a310-9584278a669e] succeeded in 1.184580305000054s: None
2024-03-21T01:36:01.741218120Z [2024-03-21 01:36:01,740: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[62bd7439-9c05-47f1-8ea5-738a04a24f69] succeeded in 1.396193933000177s: None
2024-03-21T01:36:01.917292468Z [2024-03-21 01:36:01,916: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:36:01.921435058Z [2024-03-21 01:36:01,920: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:36:01.951777576Z [2024-03-21 01:36:01,951: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:36:01.953357635Z [2024-03-21 01:36:01,953: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:36:01.953551068Z [2024-03-21 01:36:01,953: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:36:01.953760874Z [2024-03-21 01:36:01,953: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:36:01.953867570Z [2024-03-21 01:36:01,953: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:36:01.954234539Z [2024-03-21 01:36:01,954: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:36:01.954379872Z [2024-03-21 01:36:01,954: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:36:02.044462019Z [2024-03-21 01:36:02,044: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:36:02.124769875Z [2024-03-21 01:36:02,124: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:36:02.128368468Z [2024-03-21 01:36:02,127: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:36:02.152028430Z [2024-03-21 01:36:02,151: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:36:02.153572178Z [2024-03-21 01:36:02,153: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:36:02.153692532Z [2024-03-21 01:36:02,153: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:36:02.153974867Z [2024-03-21 01:36:02,153: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:36:02.154152622Z [2024-03-21 01:36:02,154: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:36:02.154658162Z [2024-03-21 01:36:02,154: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:36:02.154864263Z [2024-03-21 01:36:02,154: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:36:02.255424864Z [2024-03-21 01:36:02,244: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:36:03.720170284Z [2024-03-21 01:36:03,719: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[19e8759a-56e2-4002-93eb-165f9e1a92dc] succeeded in 3.400144363000436s: None
2024-03-21T01:36:04.328120166Z [2024-03-21 01:36:04,327: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[69fe7a00-9aa9-4e74-8a3a-d6050ff95832] succeeded in 4.010560521000116s: None
2024-03-21T01:37:00.833950275Z [2024-03-21 01:37:00,833: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e085007-216b-4bcd-823a-c1f641c3cadf] received
2024-03-21T01:37:00.837167186Z [2024-03-21 01:37:00,836: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0afed723-d6a2-475e-936a-e2f8cf23f250] received
2024-03-21T01:37:00.842384755Z [2024-03-21 01:37:00,842: INFO/ForkPoolWorker-15] [7e085007-216b-4bcd-823a-c1f641c3cadf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:37:00.843044416Z [2024-03-21 01:37:00,842: INFO/ForkPoolWorker-16] [0afed723-d6a2-475e-936a-e2f8cf23f250] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:37:00.845012834Z [2024-03-21 01:37:00,844: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23704544-285f-4f37-9b0d-f43a1c98afb7] received
2024-03-21T01:37:00.862443334Z [2024-03-21 01:37:00,862: INFO/ForkPoolWorker-1] [23704544-285f-4f37-9b0d-f43a1c98afb7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:37:01.165567204Z [2024-03-21 01:37:01,161: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:37:01.278155913Z [2024-03-21 01:37:01,274: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:37:01.337416756Z [2024-03-21 01:37:01,333: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:37:01.491893483Z [2024-03-21 01:37:01,490: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T01:37:01.495496079Z [2024-03-21 01:37:01,494: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:37:01.548351784Z [2024-03-21 01:37:01,548: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:37:01.556112876Z [2024-03-21 01:37:01,555: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:37:01.556143301Z [2024-03-21 01:37:01,555: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:37:01.556150034Z [2024-03-21 01:37:01,555: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T01:37:01.556418410Z [2024-03-21 01:37:01,556: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:37:01.734108850Z [2024-03-21 01:37:01,732: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:37:02.693038920Z [2024-03-21 01:37:02,692: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[23704544-285f-4f37-9b0d-f43a1c98afb7] succeeded in 1.8458697749993007s: None
2024-03-21T01:37:02.742841436Z [2024-03-21 01:37:02,742: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:37:02.747214987Z [2024-03-21 01:37:02,746: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:37:02.787729502Z [2024-03-21 01:37:02,786: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:37:02.797355770Z [2024-03-21 01:37:02,797: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:37:02.797383169Z [2024-03-21 01:37:02,797: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:37:02.797470073Z [2024-03-21 01:37:02,797: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:37:02.797482840Z [2024-03-21 01:37:02,797: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:37:02.798320275Z [2024-03-21 01:37:02,797: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:37:02.798343742Z [2024-03-21 01:37:02,798: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:37:02.896210571Z [2024-03-21 01:37:02,895: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:37:02.927755560Z [2024-03-21 01:37:02,927: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:37:02.934273827Z [2024-03-21 01:37:02,933: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:37:02.963246265Z [2024-03-21 01:37:02,963: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:37:02.965103466Z [2024-03-21 01:37:02,964: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:37:02.965362913Z [2024-03-21 01:37:02,965: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:37:02.965612933Z [2024-03-21 01:37:02,965: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:37:02.965830812Z [2024-03-21 01:37:02,965: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:37:02.966346099Z [2024-03-21 01:37:02,966: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:37:02.966630241Z [2024-03-21 01:37:02,966: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:37:03.090294606Z [2024-03-21 01:37:03,090: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:37:05.587537886Z [2024-03-21 01:37:05,586: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7e085007-216b-4bcd-823a-c1f641c3cadf] succeeded in 4.75191114900008s: None
2024-03-21T01:37:06.229475884Z [2024-03-21 01:37:06,229: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0afed723-d6a2-475e-936a-e2f8cf23f250] succeeded in 5.390964993000125s: None
2024-03-21T01:38:00.908378385Z [2024-03-21 01:38:00,907: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7cfafa3c-929f-4605-9dd3-cd84e4b1534c] received
2024-03-21T01:38:00.914840084Z [2024-03-21 01:38:00,914: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1011f000-600f-4a6b-bf52-760184d5bf19] received
2024-03-21T01:38:00.917404167Z [2024-03-21 01:38:00,916: INFO/ForkPoolWorker-15] [7cfafa3c-929f-4605-9dd3-cd84e4b1534c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:38:00.924518252Z [2024-03-21 01:38:00,923: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4bb2bfbe-69fc-4bbe-a871-e921425bb3ad] received
2024-03-21T01:38:00.942527449Z [2024-03-21 01:38:00,942: INFO/ForkPoolWorker-16] [1011f000-600f-4a6b-bf52-760184d5bf19] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:38:00.946999939Z [2024-03-21 01:38:00,946: INFO/ForkPoolWorker-1] [4bb2bfbe-69fc-4bbe-a871-e921425bb3ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:38:00.953758887Z [2024-03-21 01:38:00,953: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0dd44be5-4775-4480-bcd9-e9191376b2f8] received
2024-03-21T01:38:00.968285584Z [2024-03-21 01:38:00,968: INFO/ForkPoolWorker-2] [0dd44be5-4775-4480-bcd9-e9191376b2f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:38:01.273652881Z [2024-03-21 01:38:01,270: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:38:01.404447650Z [2024-03-21 01:38:01,401: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:38:01.428293264Z [2024-03-21 01:38:01,424: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:38:01.511288723Z [2024-03-21 01:38:01,505: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:38:01.585995515Z [2024-03-21 01:38:01,585: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:38:01.704703646Z [2024-03-21 01:38:01,703: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T01:38:01.712364562Z [2024-03-21 01:38:01,711: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:38:01.770691497Z [2024-03-21 01:38:01,770: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:38:01.771963104Z [2024-03-21 01:38:01,771: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:38:01.771982277Z [2024-03-21 01:38:01,771: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:38:01.772026620Z [2024-03-21 01:38:01,771: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T01:38:01.772236334Z [2024-03-21 01:38:01,772: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:38:01.902202405Z [2024-03-21 01:38:01,901: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:38:02.411942101Z [2024-03-21 01:38:02,411: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7cfafa3c-929f-4605-9dd3-cd84e4b1534c] succeeded in 1.501157859000159s: None
2024-03-21T01:38:02.664831434Z [2024-03-21 01:38:02,664: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0dd44be5-4775-4480-bcd9-e9191376b2f8] succeeded in 1.7086359079985414s: None
2024-03-21T01:38:03.051824767Z [2024-03-21 01:38:03,051: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:38:03.055369382Z [2024-03-21 01:38:03,054: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:38:03.074289330Z [2024-03-21 01:38:03,074: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:38:03.075457188Z [2024-03-21 01:38:03,075: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:38:03.075478778Z [2024-03-21 01:38:03,075: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:38:03.075579667Z [2024-03-21 01:38:03,075: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:38:03.075610492Z [2024-03-21 01:38:03,075: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:38:03.075896173Z [2024-03-21 01:38:03,075: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:38:03.075996085Z [2024-03-21 01:38:03,075: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:38:03.164811676Z [2024-03-21 01:38:03,164: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:38:03.174097220Z [2024-03-21 01:38:03,173: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:38:03.177457338Z [2024-03-21 01:38:03,176: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:38:03.198390101Z [2024-03-21 01:38:03,198: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:38:03.199772008Z [2024-03-21 01:38:03,199: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:38:03.199796889Z [2024-03-21 01:38:03,199: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:38:03.199984476Z [2024-03-21 01:38:03,199: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:38:03.200001890Z [2024-03-21 01:38:03,199: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:38:03.200288561Z [2024-03-21 01:38:03,200: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:38:03.200395890Z [2024-03-21 01:38:03,200: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:38:03.295817469Z [2024-03-21 01:38:03,295: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:38:04.954210916Z [2024-03-21 01:38:04,953: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1011f000-600f-4a6b-bf52-760184d5bf19] succeeded in 4.025126695998551s: None
2024-03-21T01:38:05.704885322Z [2024-03-21 01:38:05,704: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4bb2bfbe-69fc-4bbe-a871-e921425bb3ad] succeeded in 4.777976781999314s: None
2024-03-21T01:39:00.685578582Z [2024-03-21 01:39:00,685: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c308ead-ff0d-45a4-bb49-1cdc2a0235e0] received
2024-03-21T01:39:00.696378318Z [2024-03-21 01:39:00,696: INFO/ForkPoolWorker-15] [5c308ead-ff0d-45a4-bb49-1cdc2a0235e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:39:00.700292161Z [2024-03-21 01:39:00,700: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[288c1938-4b47-40db-9ea9-a2a14b418660] received
2024-03-21T01:39:00.711463738Z [2024-03-21 01:39:00,711: INFO/ForkPoolWorker-16] [288c1938-4b47-40db-9ea9-a2a14b418660] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:39:00.715633984Z [2024-03-21 01:39:00,715: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52c0ecb6-5e2f-4962-9707-05831a7e89ed] received
2024-03-21T01:39:00.725471455Z [2024-03-21 01:39:00,725: INFO/ForkPoolWorker-1] [52c0ecb6-5e2f-4962-9707-05831a7e89ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:39:01.022069842Z [2024-03-21 01:39:01,017: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:39:01.067582890Z [2024-03-21 01:39:01,064: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:39:01.072576346Z [2024-03-21 01:39:01,069: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:39:01.231843822Z [2024-03-21 01:39:01,231: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T01:39:01.236481848Z [2024-03-21 01:39:01,236: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:39:01.261294166Z [2024-03-21 01:39:01,261: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:39:01.265971675Z [2024-03-21 01:39:01,265: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:39:01.266295713Z [2024-03-21 01:39:01,265: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:39:01.266453437Z [2024-03-21 01:39:01,266: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T01:39:01.266760345Z [2024-03-21 01:39:01,266: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:39:01.409197932Z [2024-03-21 01:39:01,408: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:39:02.155074973Z [2024-03-21 01:39:02,154: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[52c0ecb6-5e2f-4962-9707-05831a7e89ed] succeeded in 1.4350495879989467s: None
2024-03-21T01:39:02.500663481Z [2024-03-21 01:39:02,500: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:39:02.504114328Z [2024-03-21 01:39:02,503: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:39:02.527925552Z [2024-03-21 01:39:02,527: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:39:02.530516841Z [2024-03-21 01:39:02,530: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:39:02.530718214Z [2024-03-21 01:39:02,530: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:39:02.531057693Z [2024-03-21 01:39:02,530: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:39:02.531244724Z [2024-03-21 01:39:02,531: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:39:02.531915972Z [2024-03-21 01:39:02,531: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:39:02.532094305Z [2024-03-21 01:39:02,531: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:39:02.667618007Z [2024-03-21 01:39:02,667: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:39:02.669406621Z [2024-03-21 01:39:02,669: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:39:02.673020066Z [2024-03-21 01:39:02,672: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:39:02.704136975Z [2024-03-21 01:39:02,703: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:39:02.706931860Z [2024-03-21 01:39:02,706: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:39:02.707097268Z [2024-03-21 01:39:02,706: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:39:02.707293558Z [2024-03-21 01:39:02,707: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:39:02.707404283Z [2024-03-21 01:39:02,707: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:39:02.707717274Z [2024-03-21 01:39:02,707: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:39:02.707872948Z [2024-03-21 01:39:02,707: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:39:02.804027765Z [2024-03-21 01:39:02,803: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:39:04.998207494Z [2024-03-21 01:39:04,997: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[288c1938-4b47-40db-9ea9-a2a14b418660] succeeded in 4.292461481998544s: None
2024-03-21T01:39:05.046760872Z [2024-03-21 01:39:05,046: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5c308ead-ff0d-45a4-bb49-1cdc2a0235e0] succeeded in 4.3594875689996115s: None
2024-03-21T01:40:00.554526241Z [2024-03-21 01:40:00,554: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fbe96232-e212-4314-90e5-2a1aef53f8d9] received
2024-03-21T01:40:00.561291544Z [2024-03-21 01:40:00,561: INFO/ForkPoolWorker-15] [fbe96232-e212-4314-90e5-2a1aef53f8d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:40:00.563421847Z [2024-03-21 01:40:00,563: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da54a44b-ddac-4cf8-bb26-2964433e3d44] received
2024-03-21T01:40:00.564940953Z [2024-03-21 01:40:00,564: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6fe66ae5-3183-4279-ba19-55947e96b9ed] received
2024-03-21T01:40:00.570485294Z [2024-03-21 01:40:00,570: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a44b1ab8-e9cb-4b0c-a561-50030b449ba7] received
2024-03-21T01:40:00.570678520Z [2024-03-21 01:40:00,570: INFO/ForkPoolWorker-1] [6fe66ae5-3183-4279-ba19-55947e96b9ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:40:00.577713172Z [2024-03-21 01:40:00,577: INFO/ForkPoolWorker-16] [da54a44b-ddac-4cf8-bb26-2964433e3d44] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:40:00.585217975Z [2024-03-21 01:40:00,584: INFO/ForkPoolWorker-2] [a44b1ab8-e9cb-4b0c-a561-50030b449ba7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:40:00.597014926Z [2024-03-21 01:40:00,596: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a098b123-6910-45cd-8ade-eb54688ecc53] received
2024-03-21T01:40:00.614619899Z [2024-03-21 01:40:00,614: INFO/ForkPoolWorker-3] [a098b123-6910-45cd-8ade-eb54688ecc53] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:40:01.087252250Z [2024-03-21 01:40:01,065: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:40:01.107706515Z [2024-03-21 01:40:01,104: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:40:01.161854658Z [2024-03-21 01:40:01,158: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:40:01.431781229Z [2024-03-21 01:40:01,431: INFO/ForkPoolWorker-2] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:40:01.548656704Z [2024-03-21 01:40:01,529: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:40:01.591788123Z [2024-03-21 01:40:01,591: INFO/ForkPoolWorker-3] Getting SDNC list
2024-03-21T01:40:01.594856954Z [2024-03-21 01:40:01,587: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:40:01.596118518Z [2024-03-21 01:40:01,595: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:40:01.625349945Z [2024-03-21 01:40:01,625: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-21T01:40:01.629260829Z [2024-03-21 01:40:01,629: INFO/ForkPoolWorker-3] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:40:01.629432356Z [2024-03-21 01:40:01,629: INFO/ForkPoolWorker-3] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:40:01.629545871Z [2024-03-21 01:40:01,629: INFO/ForkPoolWorker-3] Getting SDNC list OK
2024-03-21T01:40:01.629828364Z [2024-03-21 01:40:01,629: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:40:01.781610906Z [2024-03-21 01:40:01,781: INFO/ForkPoolWorker-3] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:40:02.967144905Z [2024-03-21 01:40:02,966: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a44b1ab8-e9cb-4b0c-a561-50030b449ba7] succeeded in 2.395179621000352s: None
2024-03-21T01:40:03.108010757Z [2024-03-21 01:40:03,107: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[a098b123-6910-45cd-8ade-eb54688ecc53] succeeded in 2.508683516000019s: None
2024-03-21T01:40:03.738572457Z [2024-03-21 01:40:03,738: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:40:03.742310450Z [2024-03-21 01:40:03,741: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:40:03.781729258Z [2024-03-21 01:40:03,781: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:40:03.783744612Z [2024-03-21 01:40:03,783: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:40:03.783972123Z [2024-03-21 01:40:03,783: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:40:03.784252584Z [2024-03-21 01:40:03,783: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:40:03.784464834Z [2024-03-21 01:40:03,784: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:40:03.784927715Z [2024-03-21 01:40:03,784: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:40:03.785601506Z [2024-03-21 01:40:03,785: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:40:03.871068634Z [2024-03-21 01:40:03,870: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:40:04.142346302Z [2024-03-21 01:40:04,141: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:40:04.142497060Z [2024-03-21 01:40:04,142: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:40:04.146147369Z [2024-03-21 01:40:04,145: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:40:04.147098961Z [2024-03-21 01:40:04,146: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:40:04.167737714Z [2024-03-21 01:40:04,167: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:40:04.168663490Z [2024-03-21 01:40:04,168: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:40:04.169855384Z [2024-03-21 01:40:04,169: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:40:04.169971925Z [2024-03-21 01:40:04,169: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:40:04.170190786Z [2024-03-21 01:40:04,169: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:40:04.170295833Z [2024-03-21 01:40:04,170: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:40:04.171625907Z [2024-03-21 01:40:04,171: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:40:04.171745812Z [2024-03-21 01:40:04,171: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:40:04.171790160Z [2024-03-21 01:40:04,171: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:40:04.172297297Z [2024-03-21 01:40:04,172: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:40:04.172434068Z [2024-03-21 01:40:04,172: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:40:04.172447916Z [2024-03-21 01:40:04,172: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:40:04.172822196Z [2024-03-21 01:40:04,172: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:40:04.172832826Z [2024-03-21 01:40:04,172: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:40:04.277464527Z [2024-03-21 01:40:04,277: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T01:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:40:04.277699242Z [2024-03-21 01:40:04,277: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:40:04.994143509Z [2024-03-21 01:40:04,993: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6fe66ae5-3183-4279-ba19-55947e96b9ed] succeeded in 4.427827883999271s: None
2024-03-21T01:40:05.528172242Z [2024-03-21 01:40:05,527: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d7fd85f9-fabf-453c-8de4-daeff99b02a2] received
2024-03-21T01:40:05.536537683Z [2024-03-21 01:40:05,536: INFO/ForkPoolWorker-1] [d7fd85f9-fabf-453c-8de4-daeff99b02a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:40:05.864762884Z [2024-03-21 01:40:05,860: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:40:06.019827625Z [2024-03-21 01:40:06,019: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[da54a44b-ddac-4cf8-bb26-2964433e3d44] succeeded in 5.453827896000803s: None
2024-03-21T01:40:06.041245219Z [2024-03-21 01:40:06,040: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fbe96232-e212-4314-90e5-2a1aef53f8d9] succeeded in 5.4850877139997465s: None
2024-03-21T01:40:07.086743762Z [2024-03-21 01:40:07,086: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:40:07.092299946Z [2024-03-21 01:40:07,091: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:40:07.125003214Z [2024-03-21 01:40:07,124: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:40:07.128708621Z [2024-03-21 01:40:07,128: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:40:07.128823601Z [2024-03-21 01:40:07,128: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:40:07.129018989Z [2024-03-21 01:40:07,128: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:40:07.129164318Z [2024-03-21 01:40:07,129: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:40:07.129943798Z [2024-03-21 01:40:07,129: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:40:07.129955128Z [2024-03-21 01:40:07,129: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:40:07.250528535Z [2024-03-21 01:40:07,250: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T01:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:40:07.879911040Z [2024-03-21 01:40:07,878: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d7fd85f9-fabf-453c-8de4-daeff99b02a2] succeeded in 2.3484087100005127s: None
2024-03-21T01:40:08.052425046Z [2024-03-21 01:40:08,051: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2129a618-dc7a-4c49-a2f2-dbb3d40b477a] received
2024-03-21T01:40:08.062849128Z [2024-03-21 01:40:08,062: INFO/ForkPoolWorker-15] [2129a618-dc7a-4c49-a2f2-dbb3d40b477a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T01:40:08.347577607Z [2024-03-21 01:40:08,344: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:40:09.557949670Z [2024-03-21 01:40:09,557: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:40:09.561722336Z [2024-03-21 01:40:09,561: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:40:09.585506743Z [2024-03-21 01:40:09,585: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:40:09.587180461Z [2024-03-21 01:40:09,586: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:40:09.587252702Z [2024-03-21 01:40:09,587: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:40:09.587453233Z [2024-03-21 01:40:09,587: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:40:09.587535967Z [2024-03-21 01:40:09,587: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:40:09.587897473Z [2024-03-21 01:40:09,587: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:40:09.587953731Z [2024-03-21 01:40:09,587: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:40:09.705438610Z [2024-03-21 01:40:09,705: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T01:35:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:40:10.323557449Z [2024-03-21 01:40:10,323: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2129a618-dc7a-4c49-a2f2-dbb3d40b477a] succeeded in 2.2683459060008317s: None
2024-03-21T01:40:10.622081006Z [2024-03-21 01:40:10,621: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[98f22e15-0078-460f-b006-8438122efcbd] received
2024-03-21T01:40:10.631172261Z [2024-03-21 01:40:10,630: INFO/ForkPoolWorker-15] [98f22e15-0078-460f-b006-8438122efcbd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:40:10.976097074Z [2024-03-21 01:40:10,973: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:40:12.199094091Z [2024-03-21 01:40:12,198: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:40:12.203117642Z [2024-03-21 01:40:12,202: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:40:12.241765761Z [2024-03-21 01:40:12,239: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:40:12.249012251Z [2024-03-21 01:40:12,248: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:40:12.249319289Z [2024-03-21 01:40:12,249: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:40:12.252497080Z [2024-03-21 01:40:12,249: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:40:12.252536408Z [2024-03-21 01:40:12,249: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:40:12.252540674Z [2024-03-21 01:40:12,250: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:40:12.252544303Z [2024-03-21 01:40:12,250: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:40:12.377044027Z [2024-03-21 01:40:12,376: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T01:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:40:12.941113751Z [2024-03-21 01:40:12,940: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[98f22e15-0078-460f-b006-8438122efcbd] succeeded in 2.3168839019999723s: None
2024-03-21T01:41:00.409143751Z [2024-03-21 01:41:00,408: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f99fd0b-81a8-43bd-b41b-a097d87411e0] received
2024-03-21T01:41:00.411889059Z [2024-03-21 01:41:00,411: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6682d741-e6db-472a-a841-647a16cb25f4] received
2024-03-21T01:41:00.419651105Z [2024-03-21 01:41:00,419: INFO/ForkPoolWorker-16] [6682d741-e6db-472a-a841-647a16cb25f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:41:00.419828245Z [2024-03-21 01:41:00,419: INFO/ForkPoolWorker-15] [4f99fd0b-81a8-43bd-b41b-a097d87411e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:41:00.428067641Z [2024-03-21 01:41:00,427: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e5e2169-36a5-43e3-bf47-bde00d57dc6e] received
2024-03-21T01:41:00.455383123Z [2024-03-21 01:41:00,455: INFO/ForkPoolWorker-1] [0e5e2169-36a5-43e3-bf47-bde00d57dc6e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:41:00.718037253Z [2024-03-21 01:41:00,715: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:41:00.828580826Z [2024-03-21 01:41:00,825: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:41:00.941367142Z [2024-03-21 01:41:00,937: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:41:01.218272930Z [2024-03-21 01:41:01,217: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T01:41:01.222585951Z [2024-03-21 01:41:01,222: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:41:01.241525846Z [2024-03-21 01:41:01,241: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:41:01.242842059Z [2024-03-21 01:41:01,242: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:41:01.242974999Z [2024-03-21 01:41:01,242: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:41:01.243005088Z [2024-03-21 01:41:01,242: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T01:41:01.243255939Z [2024-03-21 01:41:01,243: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:41:01.337793684Z [2024-03-21 01:41:01,337: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:41:02.030913074Z [2024-03-21 01:41:02,030: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0e5e2169-36a5-43e3-bf47-bde00d57dc6e] succeeded in 1.5923561149993475s: None
2024-03-21T01:41:02.267408178Z [2024-03-21 01:41:02,264: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:41:02.281026495Z [2024-03-21 01:41:02,274: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:41:02.372493474Z [2024-03-21 01:41:02,370: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:41:02.376452460Z [2024-03-21 01:41:02,375: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:41:02.414522088Z [2024-03-21 01:41:02,414: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:41:02.416179592Z [2024-03-21 01:41:02,415: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:41:02.416482301Z [2024-03-21 01:41:02,416: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:41:02.416909841Z [2024-03-21 01:41:02,416: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:41:02.417072726Z [2024-03-21 01:41:02,416: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:41:02.417447093Z [2024-03-21 01:41:02,417: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:41:02.417653962Z [2024-03-21 01:41:02,417: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:41:02.421522115Z [2024-03-21 01:41:02,421: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:41:02.423526835Z [2024-03-21 01:41:02,423: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:41:02.423667872Z [2024-03-21 01:41:02,423: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:41:02.423915178Z [2024-03-21 01:41:02,423: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:41:02.424070699Z [2024-03-21 01:41:02,423: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:41:02.424487594Z [2024-03-21 01:41:02,424: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:41:02.424673116Z [2024-03-21 01:41:02,424: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:41:02.536436022Z [2024-03-21 01:41:02,536: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:41:02.542329381Z [2024-03-21 01:41:02,541: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:41:04.442671629Z [2024-03-21 01:41:04,442: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6682d741-e6db-472a-a841-647a16cb25f4] succeeded in 4.028811772999688s: None
2024-03-21T01:41:04.678747071Z [2024-03-21 01:41:04,678: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4f99fd0b-81a8-43bd-b41b-a097d87411e0] succeeded in 4.26797181999973s: None
2024-03-21T01:42:01.225446852Z [2024-03-21 01:42:01,225: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71ce975f-505d-429f-b3f8-00ccd39df9eb] received
2024-03-21T01:42:01.233338375Z [2024-03-21 01:42:01,233: INFO/ForkPoolWorker-15] [71ce975f-505d-429f-b3f8-00ccd39df9eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:42:01.236829536Z [2024-03-21 01:42:01,236: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b7dd9bf-0a3c-49d1-babb-f08bace5f008] received
2024-03-21T01:42:01.246119641Z [2024-03-21 01:42:01,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77e909ad-f6b8-4f37-8f38-dc6559867e74] received
2024-03-21T01:42:01.248020513Z [2024-03-21 01:42:01,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc56b79b-71d0-4c76-bb54-01c4a931958a] received
2024-03-21T01:42:01.252364563Z [2024-03-21 01:42:01,252: INFO/ForkPoolWorker-16] [4b7dd9bf-0a3c-49d1-babb-f08bace5f008] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:42:01.257028789Z [2024-03-21 01:42:01,256: INFO/ForkPoolWorker-1] [77e909ad-f6b8-4f37-8f38-dc6559867e74] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:42:01.259391556Z [2024-03-21 01:42:01,259: INFO/ForkPoolWorker-2] [bc56b79b-71d0-4c76-bb54-01c4a931958a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:42:01.582738627Z [2024-03-21 01:42:01,577: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:42:01.660544483Z [2024-03-21 01:42:01,656: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:42:01.668296575Z [2024-03-21 01:42:01,664: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:42:01.875496458Z [2024-03-21 01:42:01,866: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:42:01.896492468Z [2024-03-21 01:42:01,896: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:42:01.962799462Z [2024-03-21 01:42:01,962: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T01:42:01.967041063Z [2024-03-21 01:42:01,966: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:42:02.011182471Z [2024-03-21 01:42:02,010: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:42:02.013723882Z [2024-03-21 01:42:02,013: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:42:02.014001619Z [2024-03-21 01:42:02,013: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:42:02.014201461Z [2024-03-21 01:42:02,014: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T01:42:02.014617839Z [2024-03-21 01:42:02,014: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:42:02.150538677Z [2024-03-21 01:42:02,150: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:42:02.835899565Z [2024-03-21 01:42:02,835: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[71ce975f-505d-429f-b3f8-00ccd39df9eb] succeeded in 1.6084151750001183s: None
2024-03-21T01:42:03.050341955Z [2024-03-21 01:42:03,049: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bc56b79b-71d0-4c76-bb54-01c4a931958a] succeeded in 1.7996156090011937s: None
2024-03-21T01:42:03.600958258Z [2024-03-21 01:42:03,600: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:42:03.604725278Z [2024-03-21 01:42:03,604: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:42:03.644812327Z [2024-03-21 01:42:03,644: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:42:03.646761211Z [2024-03-21 01:42:03,646: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:42:03.646931684Z [2024-03-21 01:42:03,646: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:42:03.647146771Z [2024-03-21 01:42:03,646: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:42:03.647335906Z [2024-03-21 01:42:03,647: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:42:03.647757499Z [2024-03-21 01:42:03,647: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:42:03.647988174Z [2024-03-21 01:42:03,647: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:42:03.774881626Z [2024-03-21 01:42:03,774: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:42:03.975474235Z [2024-03-21 01:42:03,974: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:42:03.979031763Z [2024-03-21 01:42:03,978: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:42:04.018464241Z [2024-03-21 01:42:04,018: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:42:04.019701386Z [2024-03-21 01:42:04,019: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:42:04.019715558Z [2024-03-21 01:42:04,019: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:42:04.019809829Z [2024-03-21 01:42:04,019: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:42:04.019859700Z [2024-03-21 01:42:04,019: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:42:04.020090423Z [2024-03-21 01:42:04,019: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:42:04.020099896Z [2024-03-21 01:42:04,020: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:42:04.164856261Z [2024-03-21 01:42:04,164: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:42:08.301508694Z [2024-03-21 01:42:08,301: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[77e909ad-f6b8-4f37-8f38-dc6559867e74] succeeded in 7.054009160001442s: None
2024-03-21T01:42:08.735588381Z [2024-03-21 01:42:08,735: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4b7dd9bf-0a3c-49d1-babb-f08bace5f008] succeeded in 7.497064436000073s: None
2024-03-21T01:43:00.644497452Z [2024-03-21 01:43:00,644: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01d1420e-b694-4e27-9de6-6fa59fb6b8ba] received
2024-03-21T01:43:00.652848144Z [2024-03-21 01:43:00,652: INFO/ForkPoolWorker-15] [01d1420e-b694-4e27-9de6-6fa59fb6b8ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:43:00.659156058Z [2024-03-21 01:43:00,658: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c3cbcbc-0d18-4145-aef4-7e2232b05f24] received
2024-03-21T01:43:00.664347725Z [2024-03-21 01:43:00,664: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[227e9f61-e287-4a54-a7a2-9efcf176d05c] received
2024-03-21T01:43:00.665969786Z [2024-03-21 01:43:00,665: INFO/ForkPoolWorker-16] [5c3cbcbc-0d18-4145-aef4-7e2232b05f24] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:43:00.674853233Z [2024-03-21 01:43:00,674: INFO/ForkPoolWorker-1] [227e9f61-e287-4a54-a7a2-9efcf176d05c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:43:00.994313864Z [2024-03-21 01:43:00,991: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:43:01.029735726Z [2024-03-21 01:43:01,026: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:43:01.042573790Z [2024-03-21 01:43:01,039: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:43:01.199454242Z [2024-03-21 01:43:01,199: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T01:43:01.203746748Z [2024-03-21 01:43:01,203: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:43:01.233966258Z [2024-03-21 01:43:01,233: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:43:01.235014937Z [2024-03-21 01:43:01,234: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:43:01.235187702Z [2024-03-21 01:43:01,234: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:43:01.235322828Z [2024-03-21 01:43:01,235: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T01:43:01.235559886Z [2024-03-21 01:43:01,235: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:43:01.322793891Z [2024-03-21 01:43:01,322: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:43:02.020137332Z [2024-03-21 01:43:02,019: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5c3cbcbc-0d18-4145-aef4-7e2232b05f24] succeeded in 1.3594039310009975s: None
2024-03-21T01:43:02.302218541Z [2024-03-21 01:43:02,300: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:43:02.325016129Z [2024-03-21 01:43:02,321: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:43:02.425694923Z [2024-03-21 01:43:02,425: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:43:02.427295572Z [2024-03-21 01:43:02,427: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:43:02.427368784Z [2024-03-21 01:43:02,427: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:43:02.427533152Z [2024-03-21 01:43:02,427: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:43:02.427620319Z [2024-03-21 01:43:02,427: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:43:02.427984395Z [2024-03-21 01:43:02,427: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:43:02.428047990Z [2024-03-21 01:43:02,427: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:43:02.554874137Z [2024-03-21 01:43:02,554: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:43:02.699659918Z [2024-03-21 01:43:02,699: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:43:02.703472353Z [2024-03-21 01:43:02,702: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:43:02.750191851Z [2024-03-21 01:43:02,749: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:43:02.761428202Z [2024-03-21 01:43:02,761: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:43:02.761540846Z [2024-03-21 01:43:02,761: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:43:02.761552950Z [2024-03-21 01:43:02,761: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:43:02.761561626Z [2024-03-21 01:43:02,761: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:43:02.761900347Z [2024-03-21 01:43:02,761: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:43:02.761976213Z [2024-03-21 01:43:02,761: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:43:02.881259757Z [2024-03-21 01:43:02,880: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:43:04.674314391Z [2024-03-21 01:43:04,673: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[227e9f61-e287-4a54-a7a2-9efcf176d05c] succeeded in 4.008273696999822s: None
2024-03-21T01:43:06.343944536Z [2024-03-21 01:43:06,343: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[01d1420e-b694-4e27-9de6-6fa59fb6b8ba] succeeded in 5.697301710999454s: None
2024-03-21T01:44:01.130550592Z [2024-03-21 01:44:01,130: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d27fc45-200a-4147-a0ae-65f14bb2db35] received
2024-03-21T01:44:01.133005639Z [2024-03-21 01:44:01,132: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f30fa44-b420-41df-8a01-393ba9a7022d] received
2024-03-21T01:44:01.140988142Z [2024-03-21 01:44:01,140: INFO/ForkPoolWorker-15] [0d27fc45-200a-4147-a0ae-65f14bb2db35] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:44:01.142298855Z [2024-03-21 01:44:01,141: INFO/ForkPoolWorker-16] [0f30fa44-b420-41df-8a01-393ba9a7022d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:44:01.148899051Z [2024-03-21 01:44:01,148: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62c22fe8-5c79-4392-8244-a95cc4379b85] received
2024-03-21T01:44:01.151403031Z [2024-03-21 01:44:01,151: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2f8cf44-e183-4744-a0ab-3580d811b358] received
2024-03-21T01:44:01.164626009Z [2024-03-21 01:44:01,164: INFO/ForkPoolWorker-2] [f2f8cf44-e183-4744-a0ab-3580d811b358] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:44:01.166662364Z [2024-03-21 01:44:01,164: INFO/ForkPoolWorker-1] [62c22fe8-5c79-4392-8244-a95cc4379b85] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:44:01.684295668Z [2024-03-21 01:44:01,680: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:44:01.739291685Z [2024-03-21 01:44:01,735: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:44:01.785264516Z [2024-03-21 01:44:01,782: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:44:01.845195784Z [2024-03-21 01:44:01,841: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:44:02.009354092Z [2024-03-21 01:44:02,008: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T01:44:02.016669874Z [2024-03-21 01:44:02,015: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:44:02.066474781Z [2024-03-21 01:44:02,066: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:44:02.073810338Z [2024-03-21 01:44:02,073: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:44:02.074045717Z [2024-03-21 01:44:02,073: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:44:02.074271467Z [2024-03-21 01:44:02,073: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T01:44:02.074664693Z [2024-03-21 01:44:02,074: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:44:02.108052012Z [2024-03-21 01:44:02,107: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:44:02.256719712Z [2024-03-21 01:44:02,256: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:44:03.154973738Z [2024-03-21 01:44:03,154: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0d27fc45-200a-4147-a0ae-65f14bb2db35] succeeded in 2.022168306999447s: None
2024-03-21T01:44:03.305936622Z [2024-03-21 01:44:03,305: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f2f8cf44-e183-4744-a0ab-3580d811b358] succeeded in 2.1523975279997103s: None
2024-03-21T01:44:03.558397776Z [2024-03-21 01:44:03,558: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:44:03.561877180Z [2024-03-21 01:44:03,561: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:44:03.581259416Z [2024-03-21 01:44:03,580: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:44:03.582472937Z [2024-03-21 01:44:03,582: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:44:03.582512375Z [2024-03-21 01:44:03,582: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:44:03.582693873Z [2024-03-21 01:44:03,582: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:44:03.582744976Z [2024-03-21 01:44:03,582: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:44:03.582961908Z [2024-03-21 01:44:03,582: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:44:03.582979071Z [2024-03-21 01:44:03,582: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:44:03.628361116Z [2024-03-21 01:44:03,627: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:44:03.632009538Z [2024-03-21 01:44:03,631: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:44:03.654679717Z [2024-03-21 01:44:03,654: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:44:03.656246628Z [2024-03-21 01:44:03,655: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:44:03.656527724Z [2024-03-21 01:44:03,656: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:44:03.656773724Z [2024-03-21 01:44:03,656: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:44:03.656896430Z [2024-03-21 01:44:03,656: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:44:03.657212268Z [2024-03-21 01:44:03,657: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:44:03.657672662Z [2024-03-21 01:44:03,657: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:44:03.674392349Z [2024-03-21 01:44:03,674: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:44:03.742959105Z [2024-03-21 01:44:03,742: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:44:06.515839362Z [2024-03-21 01:44:06,515: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[62c22fe8-5c79-4392-8244-a95cc4379b85] succeeded in 5.362893550000081s: None
2024-03-21T01:44:07.581467631Z [2024-03-21 01:44:07,580: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0f30fa44-b420-41df-8a01-393ba9a7022d] succeeded in 6.446500779999042s: None
2024-03-21T01:45:01.218972943Z [2024-03-21 01:45:01,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9411cb3-0758-430c-91e7-860eae537130] received
2024-03-21T01:45:01.224006782Z [2024-03-21 01:45:01,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80949ccc-4ea3-4491-8f55-d9c7037fd30f] received
2024-03-21T01:45:01.227745611Z [2024-03-21 01:45:01,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c78086bc-ec36-48d1-a1e7-c3df47a3f3df] received
2024-03-21T01:45:01.234244417Z [2024-03-21 01:45:01,233: INFO/ForkPoolWorker-15] [b9411cb3-0758-430c-91e7-860eae537130] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:45:01.234803091Z [2024-03-21 01:45:01,234: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e6a5a58-cb2b-4ed1-8926-7b8d41a2a840] received
2024-03-21T01:45:01.240359817Z [2024-03-21 01:45:01,239: INFO/ForkPoolWorker-16] [80949ccc-4ea3-4491-8f55-d9c7037fd30f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:45:01.242138300Z [2024-03-21 01:45:01,241: INFO/ForkPoolWorker-1] [c78086bc-ec36-48d1-a1e7-c3df47a3f3df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:45:01.250938948Z [2024-03-21 01:45:01,250: INFO/ForkPoolWorker-2] [6e6a5a58-cb2b-4ed1-8926-7b8d41a2a840] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:45:01.625877662Z [2024-03-21 01:45:01,620: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:45:01.688469128Z [2024-03-21 01:45:01,684: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:45:01.694788259Z [2024-03-21 01:45:01,691: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:45:01.756605212Z [2024-03-21 01:45:01,753: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:45:01.966820567Z [2024-03-21 01:45:01,966: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T01:45:01.971166065Z [2024-03-21 01:45:01,970: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:45:02.018630995Z [2024-03-21 01:45:02,018: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:45:02.021379138Z [2024-03-21 01:45:02,021: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:45:02.021601355Z [2024-03-21 01:45:02,021: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:45:02.021732029Z [2024-03-21 01:45:02,021: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T01:45:02.022070679Z [2024-03-21 01:45:02,021: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:45:02.155878451Z [2024-03-21 01:45:02,155: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:45:02.995935090Z [2024-03-21 01:45:02,995: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[80949ccc-4ea3-4491-8f55-d9c7037fd30f] succeeded in 1.7691421460003767s: None
2024-03-21T01:45:03.279310452Z [2024-03-21 01:45:03,278: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:45:03.282864020Z [2024-03-21 01:45:03,282: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:45:03.311940269Z [2024-03-21 01:45:03,311: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:45:03.313332435Z [2024-03-21 01:45:03,313: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:45:03.313364129Z [2024-03-21 01:45:03,313: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:45:03.313428540Z [2024-03-21 01:45:03,313: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:45:03.313441152Z [2024-03-21 01:45:03,313: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:45:03.313850529Z [2024-03-21 01:45:03,313: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:45:03.313858213Z [2024-03-21 01:45:03,313: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:45:03.357205639Z [2024-03-21 01:45:03,356: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T01:45:03.361096883Z [2024-03-21 01:45:03,360: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:45:03.394319775Z [2024-03-21 01:45:03,394: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:45:03.395733189Z [2024-03-21 01:45:03,395: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:45:03.395889429Z [2024-03-21 01:45:03,395: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:45:03.396059531Z [2024-03-21 01:45:03,395: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:45:03.396085517Z [2024-03-21 01:45:03,396: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T01:45:03.396400949Z [2024-03-21 01:45:03,396: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:45:03.396846431Z [2024-03-21 01:45:03,396: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:45:03.418874338Z [2024-03-21 01:45:03,418: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T01:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:45:03.516031818Z [2024-03-21 01:45:03,515: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:45:03.531173631Z [2024-03-21 01:45:03,530: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:45:03.534737598Z [2024-03-21 01:45:03,534: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:45:03.559369250Z [2024-03-21 01:45:03,559: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:45:03.560736424Z [2024-03-21 01:45:03,560: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:45:03.560755441Z [2024-03-21 01:45:03,560: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:45:03.560877065Z [2024-03-21 01:45:03,560: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:45:03.560910235Z [2024-03-21 01:45:03,560: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:45:03.561533151Z [2024-03-21 01:45:03,561: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:45:03.561546539Z [2024-03-21 01:45:03,561: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:45:03.699332867Z [2024-03-21 01:45:03,698: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:45:04.189521762Z [2024-03-21 01:45:04,188: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c78086bc-ec36-48d1-a1e7-c3df47a3f3df] succeeded in 2.9568051649985136s: None
2024-03-21T01:45:04.297064012Z [2024-03-21 01:45:04,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4baf84c-a73a-43a0-abdb-3be25539678d] received
2024-03-21T01:45:04.321775980Z [2024-03-21 01:45:04,321: INFO/ForkPoolWorker-16] [e4baf84c-a73a-43a0-abdb-3be25539678d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:45:04.627973580Z [2024-03-21 01:45:04,623: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:45:05.816237862Z [2024-03-21 01:45:05,815: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b9411cb3-0758-430c-91e7-860eae537130] succeeded in 4.594556018999356s: None
2024-03-21T01:45:05.964438087Z [2024-03-21 01:45:05,963: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:45:05.968174962Z [2024-03-21 01:45:05,967: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:45:05.991824129Z [2024-03-21 01:45:05,991: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:45:05.993864212Z [2024-03-21 01:45:05,993: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:45:05.993918131Z [2024-03-21 01:45:05,993: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:45:05.994021332Z [2024-03-21 01:45:05,993: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:45:05.994030211Z [2024-03-21 01:45:05,993: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:45:05.994389350Z [2024-03-21 01:45:05,994: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:45:05.994404492Z [2024-03-21 01:45:05,994: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:45:06.120861008Z [2024-03-21 01:45:06,120: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T01:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:45:06.122621991Z [2024-03-21 01:45:06,121: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6e6a5a58-cb2b-4ed1-8926-7b8d41a2a840] succeeded in 4.883396373001233s: None
2024-03-21T01:45:06.943496590Z [2024-03-21 01:45:06,942: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e4baf84c-a73a-43a0-abdb-3be25539678d] succeeded in 2.6427632009999797s: None
2024-03-21T01:45:07.364179791Z [2024-03-21 01:45:07,363: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6c059b8-f2ff-4399-a7fb-b1d538ee66d7] received
2024-03-21T01:45:07.371663787Z [2024-03-21 01:45:07,371: INFO/ForkPoolWorker-15] [b6c059b8-f2ff-4399-a7fb-b1d538ee66d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T01:45:07.678116864Z [2024-03-21 01:45:07,674: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:45:08.954289236Z [2024-03-21 01:45:08,953: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:45:08.957867859Z [2024-03-21 01:45:08,957: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:45:08.982715450Z [2024-03-21 01:45:08,982: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:45:08.984324593Z [2024-03-21 01:45:08,984: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:45:08.984505097Z [2024-03-21 01:45:08,984: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:45:08.984684743Z [2024-03-21 01:45:08,984: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:45:08.984770612Z [2024-03-21 01:45:08,984: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:45:08.985053452Z [2024-03-21 01:45:08,984: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:45:08.985215884Z [2024-03-21 01:45:08,985: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:45:09.085265310Z [2024-03-21 01:45:09,084: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T01:40:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:45:09.722973162Z [2024-03-21 01:45:09,722: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b6c059b8-f2ff-4399-a7fb-b1d538ee66d7] succeeded in 2.3568058110013226s: None
2024-03-21T01:45:10.165588082Z [2024-03-21 01:45:10,165: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f32a287e-e5c6-4a80-b5ac-17666c3db6fc] received
2024-03-21T01:45:10.171209215Z [2024-03-21 01:45:10,170: INFO/ForkPoolWorker-15] [f32a287e-e5c6-4a80-b5ac-17666c3db6fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:45:10.543837500Z [2024-03-21 01:45:10,539: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:45:11.743028319Z [2024-03-21 01:45:11,742: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:45:11.746245097Z [2024-03-21 01:45:11,745: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:45:11.763360971Z [2024-03-21 01:45:11,763: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:45:11.764419489Z [2024-03-21 01:45:11,764: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:45:11.764481327Z [2024-03-21 01:45:11,764: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:45:11.764691493Z [2024-03-21 01:45:11,764: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:45:11.764704142Z [2024-03-21 01:45:11,764: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:45:11.764947791Z [2024-03-21 01:45:11,764: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:45:11.764955664Z [2024-03-21 01:45:11,764: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:45:11.840807123Z [2024-03-21 01:45:11,840: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T01:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:45:12.384429329Z [2024-03-21 01:45:12,384: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f32a287e-e5c6-4a80-b5ac-17666c3db6fc] succeeded in 2.217522110000573s: None
2024-03-21T01:46:01.096938650Z [2024-03-21 01:46:01,096: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0a06d82-e27d-4d5d-af72-d5a60ec1adaf] received
2024-03-21T01:46:01.099051299Z [2024-03-21 01:46:01,098: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5aae80f4-153f-4c74-8da5-ee9f633c7e31] received
2024-03-21T01:46:01.104035305Z [2024-03-21 01:46:01,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d362602b-8ae5-4947-87a9-f41ebbe87288] received
2024-03-21T01:46:01.107527336Z [2024-03-21 01:46:01,107: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b09721ad-92e4-483d-b947-67870ab9b31a] received
2024-03-21T01:46:01.117690731Z [2024-03-21 01:46:01,117: INFO/ForkPoolWorker-16] [5aae80f4-153f-4c74-8da5-ee9f633c7e31] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:46:01.121227882Z [2024-03-21 01:46:01,120: INFO/ForkPoolWorker-15] [a0a06d82-e27d-4d5d-af72-d5a60ec1adaf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:46:01.127281071Z [2024-03-21 01:46:01,126: INFO/ForkPoolWorker-2] [b09721ad-92e4-483d-b947-67870ab9b31a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:46:01.128187022Z [2024-03-21 01:46:01,127: INFO/ForkPoolWorker-1] [d362602b-8ae5-4947-87a9-f41ebbe87288] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:46:01.417463815Z [2024-03-21 01:46:01,414: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:46:01.468464351Z [2024-03-21 01:46:01,464: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:46:01.513506997Z [2024-03-21 01:46:01,509: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:46:01.577925446Z [2024-03-21 01:46:01,570: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:46:01.844716081Z [2024-03-21 01:46:01,844: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T01:46:01.849367066Z [2024-03-21 01:46:01,848: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:46:01.882679116Z [2024-03-21 01:46:01,882: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:46:01.886269183Z [2024-03-21 01:46:01,886: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:46:01.888717647Z [2024-03-21 01:46:01,888: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:46:01.888891999Z [2024-03-21 01:46:01,888: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:46:01.888971369Z [2024-03-21 01:46:01,888: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T01:46:01.889340528Z [2024-03-21 01:46:01,889: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:46:02.047768695Z [2024-03-21 01:46:02,047: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:46:02.696843200Z [2024-03-21 01:46:02,696: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d362602b-8ae5-4947-87a9-f41ebbe87288] succeeded in 1.5832191259996762s: None
2024-03-21T01:46:02.971257463Z [2024-03-21 01:46:02,970: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5aae80f4-153f-4c74-8da5-ee9f633c7e31] succeeded in 1.8694805590002943s: None
2024-03-21T01:46:03.015932445Z [2024-03-21 01:46:03,015: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T01:46:03.020356719Z [2024-03-21 01:46:03,019: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:46:03.041897366Z [2024-03-21 01:46:03,041: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:46:03.043843408Z [2024-03-21 01:46:03,043: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:46:03.045472332Z [2024-03-21 01:46:03,045: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:46:03.045629762Z [2024-03-21 01:46:03,045: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:46:03.045859869Z [2024-03-21 01:46:03,045: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:46:03.045918589Z [2024-03-21 01:46:03,045: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T01:46:03.046337325Z [2024-03-21 01:46:03,046: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:46:03.046374529Z [2024-03-21 01:46:03,046: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:46:03.046441369Z [2024-03-21 01:46:03,045: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:46:03.078648217Z [2024-03-21 01:46:03,078: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:46:03.082207366Z [2024-03-21 01:46:03,080: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:46:03.082244938Z [2024-03-21 01:46:03,080: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:46:03.082252688Z [2024-03-21 01:46:03,080: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:46:03.082260060Z [2024-03-21 01:46:03,081: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:46:03.082265820Z [2024-03-21 01:46:03,081: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:46:03.082278077Z [2024-03-21 01:46:03,081: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:46:03.150906377Z [2024-03-21 01:46:03,150: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:46:03.228394526Z [2024-03-21 01:46:03,227: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:46:05.587581338Z [2024-03-21 01:46:05,587: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a0a06d82-e27d-4d5d-af72-d5a60ec1adaf] succeeded in 4.4822281720007595s: None
2024-03-21T01:46:05.970754882Z [2024-03-21 01:46:05,970: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b09721ad-92e4-483d-b947-67870ab9b31a] succeeded in 4.856382776999453s: None
2024-03-21T01:47:00.324562495Z [2024-03-21 01:47:00,324: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[666edc52-2861-45f7-8c83-8f91d887eda9] received
2024-03-21T01:47:00.328728521Z [2024-03-21 01:47:00,328: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9e45fcd-d823-490d-aed9-be025e7abd02] received
2024-03-21T01:47:00.330752916Z [2024-03-21 01:47:00,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66b1c7ff-e152-4af4-bacd-9fb69e16d657] received
2024-03-21T01:47:00.331092096Z [2024-03-21 01:47:00,330: INFO/ForkPoolWorker-15] [666edc52-2861-45f7-8c83-8f91d887eda9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:47:00.336920458Z [2024-03-21 01:47:00,336: INFO/ForkPoolWorker-16] [e9e45fcd-d823-490d-aed9-be025e7abd02] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:47:00.345028605Z [2024-03-21 01:47:00,344: INFO/ForkPoolWorker-1] [66b1c7ff-e152-4af4-bacd-9fb69e16d657] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:47:00.624674677Z [2024-03-21 01:47:00,621: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:47:00.644718512Z [2024-03-21 01:47:00,641: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:47:00.654824407Z [2024-03-21 01:47:00,651: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:47:00.801690846Z [2024-03-21 01:47:00,801: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T01:47:00.806011400Z [2024-03-21 01:47:00,805: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:47:00.831248434Z [2024-03-21 01:47:00,831: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:47:00.832860154Z [2024-03-21 01:47:00,832: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:47:00.833113855Z [2024-03-21 01:47:00,832: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:47:00.833285415Z [2024-03-21 01:47:00,833: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T01:47:00.833550575Z [2024-03-21 01:47:00,833: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:47:00.927473967Z [2024-03-21 01:47:00,927: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:47:01.559465124Z [2024-03-21 01:47:01,559: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e9e45fcd-d823-490d-aed9-be025e7abd02] succeeded in 1.2275767259998247s: None
2024-03-21T01:47:01.826285271Z [2024-03-21 01:47:01,825: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:47:01.830020074Z [2024-03-21 01:47:01,829: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:47:01.859233492Z [2024-03-21 01:47:01,858: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:47:01.861022775Z [2024-03-21 01:47:01,860: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:47:01.861168769Z [2024-03-21 01:47:01,860: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:47:01.861351899Z [2024-03-21 01:47:01,861: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:47:01.861479878Z [2024-03-21 01:47:01,861: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:47:01.861783836Z [2024-03-21 01:47:01,861: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:47:01.861951802Z [2024-03-21 01:47:01,861: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:47:01.864834626Z [2024-03-21 01:47:01,864: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:47:01.868990817Z [2024-03-21 01:47:01,868: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:47:01.899178855Z [2024-03-21 01:47:01,898: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:47:01.900763445Z [2024-03-21 01:47:01,900: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:47:01.900845374Z [2024-03-21 01:47:01,900: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:47:01.901036160Z [2024-03-21 01:47:01,900: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:47:01.901118858Z [2024-03-21 01:47:01,900: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:47:01.901557320Z [2024-03-21 01:47:01,901: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:47:01.901689858Z [2024-03-21 01:47:01,901: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:47:01.962663090Z [2024-03-21 01:47:01,962: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:47:02.001102791Z [2024-03-21 01:47:02,000: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:47:03.816999610Z [2024-03-21 01:47:03,816: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[66b1c7ff-e152-4af4-bacd-9fb69e16d657] succeeded in 3.484093021999797s: None
2024-03-21T01:47:04.950714517Z [2024-03-21 01:47:04,950: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[666edc52-2861-45f7-8c83-8f91d887eda9] succeeded in 4.624599416998535s: None
2024-03-21T01:48:00.761871296Z [2024-03-21 01:48:00,761: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af6eb958-2865-48dc-b1f6-198cebea5181] received
2024-03-21T01:48:00.763723527Z [2024-03-21 01:48:00,763: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38a92b87-5f08-4d6d-8ab1-47eb574b3424] received
2024-03-21T01:48:00.769158553Z [2024-03-21 01:48:00,768: INFO/ForkPoolWorker-15] [af6eb958-2865-48dc-b1f6-198cebea5181] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:48:00.775712812Z [2024-03-21 01:48:00,775: INFO/ForkPoolWorker-16] [38a92b87-5f08-4d6d-8ab1-47eb574b3424] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:48:00.780879019Z [2024-03-21 01:48:00,780: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c0fe60c-c30b-4922-a7a8-d53caa214194] received
2024-03-21T01:48:00.783327466Z [2024-03-21 01:48:00,783: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e768e4a0-323f-4b27-ba2b-4caa656db3c3] received
2024-03-21T01:48:00.788967565Z [2024-03-21 01:48:00,788: INFO/ForkPoolWorker-1] [7c0fe60c-c30b-4922-a7a8-d53caa214194] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:48:00.800225989Z [2024-03-21 01:48:00,798: INFO/ForkPoolWorker-2] [e768e4a0-323f-4b27-ba2b-4caa656db3c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:48:01.110518758Z [2024-03-21 01:48:01,107: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:48:01.155913572Z [2024-03-21 01:48:01,150: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:48:01.168882771Z [2024-03-21 01:48:01,165: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:48:01.188379812Z [2024-03-21 01:48:01,182: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:48:01.324737182Z [2024-03-21 01:48:01,324: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T01:48:01.329724889Z [2024-03-21 01:48:01,329: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:48:01.367263076Z [2024-03-21 01:48:01,367: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:48:01.369052537Z [2024-03-21 01:48:01,368: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:48:01.369316810Z [2024-03-21 01:48:01,368: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:48:01.369496400Z [2024-03-21 01:48:01,369: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T01:48:01.369815189Z [2024-03-21 01:48:01,369: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:48:01.378376742Z [2024-03-21 01:48:01,378: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:48:01.503398264Z [2024-03-21 01:48:01,503: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:48:02.016875569Z [2024-03-21 01:48:02,016: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[af6eb958-2865-48dc-b1f6-198cebea5181] succeeded in 1.253479951999907s: None
2024-03-21T01:48:02.323943716Z [2024-03-21 01:48:02,323: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e768e4a0-323f-4b27-ba2b-4caa656db3c3] succeeded in 1.5379468779992749s: None
2024-03-21T01:48:02.548534846Z [2024-03-21 01:48:02,548: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:48:02.552147069Z [2024-03-21 01:48:02,551: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:48:02.579457529Z [2024-03-21 01:48:02,579: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:48:02.580972050Z [2024-03-21 01:48:02,580: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:48:02.581130175Z [2024-03-21 01:48:02,580: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:48:02.581305272Z [2024-03-21 01:48:02,581: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:48:02.581389827Z [2024-03-21 01:48:02,581: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:48:02.581726469Z [2024-03-21 01:48:02,581: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:48:02.581816960Z [2024-03-21 01:48:02,581: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:48:02.603588649Z [2024-03-21 01:48:02,603: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:48:02.611111945Z [2024-03-21 01:48:02,610: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:48:02.643253123Z [2024-03-21 01:48:02,642: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:48:02.645235419Z [2024-03-21 01:48:02,644: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:48:02.645619952Z [2024-03-21 01:48:02,645: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:48:02.645902321Z [2024-03-21 01:48:02,645: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:48:02.646056891Z [2024-03-21 01:48:02,645: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:48:02.646441631Z [2024-03-21 01:48:02,646: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:48:02.646659225Z [2024-03-21 01:48:02,646: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:48:02.703605945Z [2024-03-21 01:48:02,703: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:48:02.759624163Z [2024-03-21 01:48:02,759: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:48:04.288929786Z [2024-03-21 01:48:04,288: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7c0fe60c-c30b-4922-a7a8-d53caa214194] succeeded in 3.506058187000235s: None
2024-03-21T01:48:05.240419608Z [2024-03-21 01:48:05,238: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[38a92b87-5f08-4d6d-8ab1-47eb574b3424] succeeded in 4.473013319000529s: None
2024-03-21T01:49:00.189122367Z [2024-03-21 01:49:00,188: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c575a90c-41e0-4c4f-9c14-6edb148e7db5] received
2024-03-21T01:49:00.199114143Z [2024-03-21 01:49:00,198: INFO/ForkPoolWorker-15] [c575a90c-41e0-4c4f-9c14-6edb148e7db5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:49:00.201611115Z [2024-03-21 01:49:00,201: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57630890-eebe-46e9-8fd1-c19adef073ba] received
2024-03-21T01:49:00.205896766Z [2024-03-21 01:49:00,204: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa381fc4-7b4b-47bd-a6b4-6fb4ec9b7646] received
2024-03-21T01:49:00.215756658Z [2024-03-21 01:49:00,215: INFO/ForkPoolWorker-16] [57630890-eebe-46e9-8fd1-c19adef073ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:49:00.217985140Z [2024-03-21 01:49:00,217: INFO/ForkPoolWorker-1] [fa381fc4-7b4b-47bd-a6b4-6fb4ec9b7646] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:49:00.492757597Z [2024-03-21 01:49:00,489: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:49:00.502513280Z [2024-03-21 01:49:00,499: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:49:00.516298250Z [2024-03-21 01:49:00,512: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:49:00.664731620Z [2024-03-21 01:49:00,664: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T01:49:00.668644975Z [2024-03-21 01:49:00,668: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:49:00.691508665Z [2024-03-21 01:49:00,691: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:49:00.694229697Z [2024-03-21 01:49:00,693: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:49:00.694538783Z [2024-03-21 01:49:00,694: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:49:00.694560573Z [2024-03-21 01:49:00,694: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T01:49:00.694886119Z [2024-03-21 01:49:00,694: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:49:00.803853381Z [2024-03-21 01:49:00,803: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:49:01.654412414Z [2024-03-21 01:49:01,653: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c575a90c-41e0-4c4f-9c14-6edb148e7db5] succeeded in 1.4606747900015762s: None
2024-03-21T01:49:02.103820306Z [2024-03-21 01:49:02,103: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:49:02.108190698Z [2024-03-21 01:49:02,107: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:49:02.139159374Z [2024-03-21 01:49:02,138: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:49:02.142276651Z [2024-03-21 01:49:02,140: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:49:02.142915568Z [2024-03-21 01:49:02,142: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:49:02.143306923Z [2024-03-21 01:49:02,142: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:49:02.143448847Z [2024-03-21 01:49:02,143: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:49:02.145624832Z [2024-03-21 01:49:02,145: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:49:02.145642453Z [2024-03-21 01:49:02,145: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:49:02.173994044Z [2024-03-21 01:49:02,173: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:49:02.178028630Z [2024-03-21 01:49:02,177: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:49:02.217804731Z [2024-03-21 01:49:02,217: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:49:02.219483638Z [2024-03-21 01:49:02,219: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:49:02.220250534Z [2024-03-21 01:49:02,219: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:49:02.220799035Z [2024-03-21 01:49:02,220: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:49:02.221104938Z [2024-03-21 01:49:02,220: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:49:02.221636080Z [2024-03-21 01:49:02,221: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:49:02.221795701Z [2024-03-21 01:49:02,221: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:49:02.272590941Z [2024-03-21 01:49:02,267: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:49:02.528951931Z [2024-03-21 01:49:02,528: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:49:04.487102190Z [2024-03-21 01:49:04,486: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fa381fc4-7b4b-47bd-a6b4-6fb4ec9b7646] succeeded in 4.27919849600039s: None
2024-03-21T01:49:04.525385608Z [2024-03-21 01:49:04,525: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[57630890-eebe-46e9-8fd1-c19adef073ba] succeeded in 4.3222159769993596s: None
2024-03-21T01:50:01.116759398Z [2024-03-21 01:50:01,116: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d243716b-4ec8-4dd4-a83d-2c7bfa8b1625] received
2024-03-21T01:50:01.119628018Z [2024-03-21 01:50:01,119: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a28378ba-229f-4265-bca7-d7ec813370c5] received
2024-03-21T01:50:01.126051830Z [2024-03-21 01:50:01,125: INFO/ForkPoolWorker-15] [d243716b-4ec8-4dd4-a83d-2c7bfa8b1625] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:50:01.126719539Z [2024-03-21 01:50:01,126: INFO/ForkPoolWorker-16] [a28378ba-229f-4265-bca7-d7ec813370c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:50:01.156414665Z [2024-03-21 01:50:01,156: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a588096-4503-494d-a1a8-e575d58b4231] received
2024-03-21T01:50:01.161997252Z [2024-03-21 01:50:01,161: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0cf0b50-745b-4ff9-8c1f-6a73ccaff6bf] received
2024-03-21T01:50:01.166279516Z [2024-03-21 01:50:01,165: INFO/ForkPoolWorker-1] [3a588096-4503-494d-a1a8-e575d58b4231] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:50:01.166912456Z [2024-03-21 01:50:01,166: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e2f4739-4af5-4ba1-abdd-d3783e14bfdf] received
2024-03-21T01:50:01.175715861Z [2024-03-21 01:50:01,175: INFO/ForkPoolWorker-2] [e0cf0b50-745b-4ff9-8c1f-6a73ccaff6bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:50:01.194297378Z [2024-03-21 01:50:01,193: INFO/ForkPoolWorker-3] [9e2f4739-4af5-4ba1-abdd-d3783e14bfdf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:50:01.554809210Z [2024-03-21 01:50:01,551: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:50:01.582625221Z [2024-03-21 01:50:01,579: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:50:01.614645710Z [2024-03-21 01:50:01,611: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:50:01.643803176Z [2024-03-21 01:50:01,639: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:50:01.900345281Z [2024-03-21 01:50:01,891: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:50:01.904498440Z [2024-03-21 01:50:01,904: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:50:02.333759612Z [2024-03-21 01:50:02,333: INFO/ForkPoolWorker-3] Getting SDNC list
2024-03-21T01:50:02.360425832Z [2024-03-21 01:50:02,359: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:50:02.485163240Z [2024-03-21 01:50:02,484: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-21T01:50:02.497633627Z [2024-03-21 01:50:02,497: INFO/ForkPoolWorker-3] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:50:02.497677979Z [2024-03-21 01:50:02,497: INFO/ForkPoolWorker-3] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:50:02.497799635Z [2024-03-21 01:50:02,497: INFO/ForkPoolWorker-3] Getting SDNC list OK
2024-03-21T01:50:02.498465908Z [2024-03-21 01:50:02,498: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:50:02.635037809Z [2024-03-21 01:50:02,634: INFO/ForkPoolWorker-3] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:50:02.909288788Z [2024-03-21 01:50:02,908: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a28378ba-229f-4265-bca7-d7ec813370c5] succeeded in 1.787965110001096s: None
2024-03-21T01:50:03.345988269Z [2024-03-21 01:50:03,345: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:50:03.350666980Z [2024-03-21 01:50:03,349: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:50:03.381550129Z [2024-03-21 01:50:03,381: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:50:03.386123160Z [2024-03-21 01:50:03,385: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:50:03.386302429Z [2024-03-21 01:50:03,386: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:50:03.386539487Z [2024-03-21 01:50:03,386: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:50:03.386699538Z [2024-03-21 01:50:03,386: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:50:03.387389494Z [2024-03-21 01:50:03,387: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:50:03.387818228Z [2024-03-21 01:50:03,387: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:50:03.450603332Z [2024-03-21 01:50:03,449: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[9e2f4739-4af5-4ba1-abdd-d3783e14bfdf] succeeded in 2.2772667610006465s: None
2024-03-21T01:50:03.530333054Z [2024-03-21 01:50:03,529: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T01:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:50:03.540801387Z [2024-03-21 01:50:03,540: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T01:50:03.544302385Z [2024-03-21 01:50:03,543: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:50:03.582278574Z [2024-03-21 01:50:03,581: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:50:03.583841641Z [2024-03-21 01:50:03,583: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:50:03.583858951Z [2024-03-21 01:50:03,583: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:50:03.583972238Z [2024-03-21 01:50:03,583: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:50:03.583978416Z [2024-03-21 01:50:03,583: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T01:50:03.584220693Z [2024-03-21 01:50:03,584: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:50:03.584233289Z [2024-03-21 01:50:03,584: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:50:03.629109987Z [2024-03-21 01:50:03,628: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:50:03.632624827Z [2024-03-21 01:50:03,632: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:50:03.657438009Z [2024-03-21 01:50:03,657: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:50:03.658759922Z [2024-03-21 01:50:03,658: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:50:03.658852849Z [2024-03-21 01:50:03,658: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:50:03.659055935Z [2024-03-21 01:50:03,658: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:50:03.659175207Z [2024-03-21 01:50:03,659: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:50:03.659542220Z [2024-03-21 01:50:03,659: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:50:03.659562177Z [2024-03-21 01:50:03,659: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:50:03.697037496Z [2024-03-21 01:50:03,696: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:50:03.818074457Z [2024-03-21 01:50:03,817: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:50:04.252386319Z [2024-03-21 01:50:04,251: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d243716b-4ec8-4dd4-a83d-2c7bfa8b1625] succeeded in 3.1316132949996245s: None
2024-03-21T01:50:04.508463597Z [2024-03-21 01:50:04,508: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a04de5e-f816-439c-8dc8-0d71fb247f25] received
2024-03-21T01:50:04.515250311Z [2024-03-21 01:50:04,514: INFO/ForkPoolWorker-15] [9a04de5e-f816-439c-8dc8-0d71fb247f25] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:50:04.819529845Z [2024-03-21 01:50:04,816: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:50:05.478711312Z [2024-03-21 01:50:05,478: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e0cf0b50-745b-4ff9-8c1f-6a73ccaff6bf] succeeded in 4.314512613000261s: None
2024-03-21T01:50:05.980264703Z [2024-03-21 01:50:05,979: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3a588096-4503-494d-a1a8-e575d58b4231] succeeded in 4.822286394000912s: None
2024-03-21T01:50:06.117857160Z [2024-03-21 01:50:06,117: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:50:06.121306070Z [2024-03-21 01:50:06,120: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:50:06.138501807Z [2024-03-21 01:50:06,138: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:50:06.139838789Z [2024-03-21 01:50:06,139: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:50:06.139912756Z [2024-03-21 01:50:06,139: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:50:06.140078163Z [2024-03-21 01:50:06,139: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:50:06.140156194Z [2024-03-21 01:50:06,140: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:50:06.140468350Z [2024-03-21 01:50:06,140: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:50:06.140541043Z [2024-03-21 01:50:06,140: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:50:06.229372120Z [2024-03-21 01:50:06,229: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T01:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:50:06.917557517Z [2024-03-21 01:50:06,917: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9a04de5e-f816-439c-8dc8-0d71fb247f25] succeeded in 2.4073870060001354s: None
2024-03-21T01:50:07.405771870Z [2024-03-21 01:50:07,405: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[daeaefea-8868-4a5a-aef2-6ee14acb7f0a] received
2024-03-21T01:50:07.414082527Z [2024-03-21 01:50:07,413: INFO/ForkPoolWorker-15] [daeaefea-8868-4a5a-aef2-6ee14acb7f0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T01:50:07.724569214Z [2024-03-21 01:50:07,720: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:50:09.002769927Z [2024-03-21 01:50:09,002: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:50:09.008596133Z [2024-03-21 01:50:09,007: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:50:09.032953601Z [2024-03-21 01:50:09,032: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:50:09.037576264Z [2024-03-21 01:50:09,037: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:50:09.037852476Z [2024-03-21 01:50:09,037: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:50:09.038138453Z [2024-03-21 01:50:09,037: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:50:09.038283763Z [2024-03-21 01:50:09,038: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:50:09.038654332Z [2024-03-21 01:50:09,038: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:50:09.038818108Z [2024-03-21 01:50:09,038: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:50:09.147270774Z [2024-03-21 01:50:09,146: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T01:45:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:50:09.737937591Z [2024-03-21 01:50:09,737: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[687947cd-fb55-480d-9836-05e22aab4883] received
2024-03-21T01:50:09.747195433Z [2024-03-21 01:50:09,746: INFO/ForkPoolWorker-16] [687947cd-fb55-480d-9836-05e22aab4883] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:50:09.844873517Z [2024-03-21 01:50:09,844: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[daeaefea-8868-4a5a-aef2-6ee14acb7f0a] succeeded in 2.436104993999834s: None
2024-03-21T01:50:10.061571154Z [2024-03-21 01:50:10,058: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:50:11.196153881Z [2024-03-21 01:50:11,195: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:50:11.199585257Z [2024-03-21 01:50:11,199: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:50:11.218546283Z [2024-03-21 01:50:11,218: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:50:11.219734765Z [2024-03-21 01:50:11,219: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:50:11.219782163Z [2024-03-21 01:50:11,219: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:50:11.219860697Z [2024-03-21 01:50:11,219: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:50:11.219966374Z [2024-03-21 01:50:11,219: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:50:11.220461866Z [2024-03-21 01:50:11,220: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:50:11.220526246Z [2024-03-21 01:50:11,220: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:50:11.298193418Z [2024-03-21 01:50:11,297: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T01:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:50:11.795029990Z [2024-03-21 01:50:11,794: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[687947cd-fb55-480d-9836-05e22aab4883] succeeded in 2.0552388110008906s: None
2024-03-21T01:51:00.428765436Z [2024-03-21 01:51:00,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83faa290-bdc4-44a8-a30f-cb45daaed8bd] received
2024-03-21T01:51:00.432252027Z [2024-03-21 01:51:00,431: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85ab8994-0b4e-46bb-8214-d1435d0f8506] received
2024-03-21T01:51:00.435536477Z [2024-03-21 01:51:00,434: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2cb3b681-23f5-4ba1-a2c5-469e6cd6c0a4] received
2024-03-21T01:51:00.443013349Z [2024-03-21 01:51:00,442: INFO/ForkPoolWorker-1] [2cb3b681-23f5-4ba1-a2c5-469e6cd6c0a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:51:00.445502416Z [2024-03-21 01:51:00,445: INFO/ForkPoolWorker-16] [85ab8994-0b4e-46bb-8214-d1435d0f8506] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:51:00.445863607Z [2024-03-21 01:51:00,445: INFO/ForkPoolWorker-15] [83faa290-bdc4-44a8-a30f-cb45daaed8bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:51:00.742395942Z [2024-03-21 01:51:00,739: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:51:00.781050227Z [2024-03-21 01:51:00,776: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:51:00.787906058Z [2024-03-21 01:51:00,784: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:51:00.993838915Z [2024-03-21 01:51:00,993: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T01:51:00.997975809Z [2024-03-21 01:51:00,997: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:51:01.030003513Z [2024-03-21 01:51:01,029: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:51:01.031214341Z [2024-03-21 01:51:01,030: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:51:01.031427008Z [2024-03-21 01:51:01,031: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:51:01.031571382Z [2024-03-21 01:51:01,031: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T01:51:01.031853356Z [2024-03-21 01:51:01,031: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:51:01.131298556Z [2024-03-21 01:51:01,130: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:51:01.751522892Z [2024-03-21 01:51:01,751: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[85ab8994-0b4e-46bb-8214-d1435d0f8506] succeeded in 1.3141673980007909s: None
2024-03-21T01:51:02.117999718Z [2024-03-21 01:51:02,117: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:51:02.121674472Z [2024-03-21 01:51:02,121: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:51:02.149936640Z [2024-03-21 01:51:02,149: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:51:02.158096467Z [2024-03-21 01:51:02,157: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:51:02.158186033Z [2024-03-21 01:51:02,157: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:51:02.158540520Z [2024-03-21 01:51:02,158: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:51:02.158632459Z [2024-03-21 01:51:02,158: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:51:02.159066583Z [2024-03-21 01:51:02,158: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:51:02.159233799Z [2024-03-21 01:51:02,159: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:51:02.270612649Z [2024-03-21 01:51:02,270: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:51:02.274251616Z [2024-03-21 01:51:02,273: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:51:02.309929318Z [2024-03-21 01:51:02,309: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:51:02.369637239Z [2024-03-21 01:51:02,369: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:51:02.371154995Z [2024-03-21 01:51:02,370: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:51:02.371265466Z [2024-03-21 01:51:02,371: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:51:02.371592589Z [2024-03-21 01:51:02,371: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:51:02.371743626Z [2024-03-21 01:51:02,371: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:51:02.372068100Z [2024-03-21 01:51:02,371: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:51:02.372120322Z [2024-03-21 01:51:02,372: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:51:02.499536192Z [2024-03-21 01:51:02,499: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:51:04.117076286Z [2024-03-21 01:51:04,116: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2cb3b681-23f5-4ba1-a2c5-469e6cd6c0a4] succeeded in 3.6796887989985407s: None
2024-03-21T01:51:04.523506779Z [2024-03-21 01:51:04,523: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[83faa290-bdc4-44a8-a30f-cb45daaed8bd] succeeded in 4.08547627400003s: None
2024-03-21T01:52:00.681543460Z [2024-03-21 01:52:00,681: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea18cb66-efe3-4568-9f15-71e81429c642] received
2024-03-21T01:52:00.685848714Z [2024-03-21 01:52:00,685: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e275187-3a53-4448-9a49-1b642439281a] received
2024-03-21T01:52:00.692700173Z [2024-03-21 01:52:00,692: INFO/ForkPoolWorker-15] [ea18cb66-efe3-4568-9f15-71e81429c642] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:52:00.695069333Z [2024-03-21 01:52:00,694: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe884410-8d7e-4351-9a4f-975acc9676c0] received
2024-03-21T01:52:00.695788560Z [2024-03-21 01:52:00,695: INFO/ForkPoolWorker-16] [9e275187-3a53-4448-9a49-1b642439281a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:52:00.698233059Z [2024-03-21 01:52:00,698: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7a2b120-67c3-4d39-b244-2fc1078905ad] received
2024-03-21T01:52:00.709927831Z [2024-03-21 01:52:00,709: INFO/ForkPoolWorker-1] [fe884410-8d7e-4351-9a4f-975acc9676c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:52:00.710875947Z [2024-03-21 01:52:00,710: INFO/ForkPoolWorker-2] [f7a2b120-67c3-4d39-b244-2fc1078905ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:52:01.042560041Z [2024-03-21 01:52:01,039: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:52:01.063797246Z [2024-03-21 01:52:01,060: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:52:01.130959414Z [2024-03-21 01:52:01,127: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:52:01.139378019Z [2024-03-21 01:52:01,135: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:52:01.257778789Z [2024-03-21 01:52:01,257: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T01:52:01.262460336Z [2024-03-21 01:52:01,262: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:52:01.293537181Z [2024-03-21 01:52:01,293: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:52:01.294409206Z [2024-03-21 01:52:01,294: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:52:01.295032156Z [2024-03-21 01:52:01,294: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:52:01.295244370Z [2024-03-21 01:52:01,294: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:52:01.295394964Z [2024-03-21 01:52:01,295: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T01:52:01.295684362Z [2024-03-21 01:52:01,295: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:52:01.437572496Z [2024-03-21 01:52:01,437: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:52:01.860241078Z [2024-03-21 01:52:01,859: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ea18cb66-efe3-4568-9f15-71e81429c642] succeeded in 1.1765203009999823s: None
2024-03-21T01:52:02.099410297Z [2024-03-21 01:52:02,098: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f7a2b120-67c3-4d39-b244-2fc1078905ad] succeeded in 1.3992614639992098s: None
2024-03-21T01:52:02.569369745Z [2024-03-21 01:52:02,568: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:52:02.573150972Z [2024-03-21 01:52:02,572: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:52:02.592328445Z [2024-03-21 01:52:02,592: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:52:02.594412732Z [2024-03-21 01:52:02,594: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:52:02.594523025Z [2024-03-21 01:52:02,594: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:52:02.594764730Z [2024-03-21 01:52:02,594: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:52:02.594887404Z [2024-03-21 01:52:02,594: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:52:02.595315042Z [2024-03-21 01:52:02,595: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:52:02.595476720Z [2024-03-21 01:52:02,595: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:52:02.686611481Z [2024-03-21 01:52:02,686: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:52:02.787671136Z [2024-03-21 01:52:02,787: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:52:02.793689363Z [2024-03-21 01:52:02,793: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:52:02.828303223Z [2024-03-21 01:52:02,828: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:52:02.831184395Z [2024-03-21 01:52:02,830: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:52:02.831414739Z [2024-03-21 01:52:02,831: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:52:02.831623952Z [2024-03-21 01:52:02,831: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:52:02.831760078Z [2024-03-21 01:52:02,831: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:52:02.832172776Z [2024-03-21 01:52:02,831: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:52:02.832344788Z [2024-03-21 01:52:02,832: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:52:02.933478576Z [2024-03-21 01:52:02,933: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:52:04.869124100Z [2024-03-21 01:52:04,866: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fe884410-8d7e-4351-9a4f-975acc9676c0] succeeded in 4.1680152640001324s: None
2024-03-21T01:52:04.872439515Z [2024-03-21 01:52:04,871: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9e275187-3a53-4448-9a49-1b642439281a] succeeded in 4.183188106000671s: None
2024-03-21T01:53:00.918164054Z [2024-03-21 01:53:00,917: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44628354-2c45-4529-b90d-92161f5abde7] received
2024-03-21T01:53:00.928617676Z [2024-03-21 01:53:00,928: INFO/ForkPoolWorker-15] [44628354-2c45-4529-b90d-92161f5abde7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:53:00.929406875Z [2024-03-21 01:53:00,929: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3772370-5668-4686-8880-0064a9ad8ddc] received
2024-03-21T01:53:00.930906069Z [2024-03-21 01:53:00,930: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d883ed1f-65e1-4e31-8792-5b2c069b877e] received
2024-03-21T01:53:00.937584912Z [2024-03-21 01:53:00,937: INFO/ForkPoolWorker-1] [d883ed1f-65e1-4e31-8792-5b2c069b877e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:53:00.946504317Z [2024-03-21 01:53:00,946: INFO/ForkPoolWorker-16] [e3772370-5668-4686-8880-0064a9ad8ddc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:53:01.252990421Z [2024-03-21 01:53:01,249: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:53:01.277786286Z [2024-03-21 01:53:01,274: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:53:01.311537400Z [2024-03-21 01:53:01,307: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:53:01.470517654Z [2024-03-21 01:53:01,470: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T01:53:01.474795072Z [2024-03-21 01:53:01,474: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:53:01.514678159Z [2024-03-21 01:53:01,514: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:53:01.516043414Z [2024-03-21 01:53:01,515: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:53:01.516221313Z [2024-03-21 01:53:01,515: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:53:01.516400131Z [2024-03-21 01:53:01,516: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T01:53:01.516714985Z [2024-03-21 01:53:01,516: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:53:01.633538860Z [2024-03-21 01:53:01,633: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:53:02.322615892Z [2024-03-21 01:53:02,322: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d883ed1f-65e1-4e31-8792-5b2c069b877e] succeeded in 1.3901296160001948s: None
2024-03-21T01:53:02.662492716Z [2024-03-21 01:53:02,662: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:53:02.666018864Z [2024-03-21 01:53:02,665: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:53:02.692489316Z [2024-03-21 01:53:02,692: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:53:02.695266917Z [2024-03-21 01:53:02,694: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:53:02.695330104Z [2024-03-21 01:53:02,695: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:53:02.695625707Z [2024-03-21 01:53:02,695: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:53:02.695703104Z [2024-03-21 01:53:02,695: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:53:02.696075681Z [2024-03-21 01:53:02,695: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:53:02.696136996Z [2024-03-21 01:53:02,696: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:53:02.789861427Z [2024-03-21 01:53:02,789: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:53:02.801340366Z [2024-03-21 01:53:02,799: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:53:02.805485046Z [2024-03-21 01:53:02,805: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:53:02.825716563Z [2024-03-21 01:53:02,825: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:53:02.827188078Z [2024-03-21 01:53:02,826: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:53:02.827431606Z [2024-03-21 01:53:02,827: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:53:02.827671384Z [2024-03-21 01:53:02,827: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:53:02.827814700Z [2024-03-21 01:53:02,827: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:53:02.828145107Z [2024-03-21 01:53:02,828: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:53:02.828298119Z [2024-03-21 01:53:02,828: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:53:02.977640520Z [2024-03-21 01:53:02,977: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:53:05.070734375Z [2024-03-21 01:53:05,070: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e3772370-5668-4686-8880-0064a9ad8ddc] succeeded in 4.140001603998826s: None
2024-03-21T01:53:05.490033430Z [2024-03-21 01:53:05,489: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[44628354-2c45-4529-b90d-92161f5abde7] succeeded in 4.5691936559996975s: None
2024-03-21T01:54:01.162325758Z [2024-03-21 01:54:01,161: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0dcdd05f-60b1-4889-a0e0-75fe9d8e13d2] received
2024-03-21T01:54:01.166317103Z [2024-03-21 01:54:01,165: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3877b307-a403-4f3b-9c15-a9a7cc1add6a] received
2024-03-21T01:54:01.171825953Z [2024-03-21 01:54:01,171: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c6f7b2b-6acb-4d83-9e03-f6c9b57478e2] received
2024-03-21T01:54:01.173365883Z [2024-03-21 01:54:01,173: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4379566-c029-4a55-8819-337f65f35ffc] received
2024-03-21T01:54:01.175575743Z [2024-03-21 01:54:01,175: INFO/ForkPoolWorker-16] [3877b307-a403-4f3b-9c15-a9a7cc1add6a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:54:01.183502509Z [2024-03-21 01:54:01,183: INFO/ForkPoolWorker-15] [0dcdd05f-60b1-4889-a0e0-75fe9d8e13d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:54:01.185421963Z [2024-03-21 01:54:01,185: INFO/ForkPoolWorker-1] [0c6f7b2b-6acb-4d83-9e03-f6c9b57478e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:54:01.186187823Z [2024-03-21 01:54:01,185: INFO/ForkPoolWorker-2] [e4379566-c029-4a55-8819-337f65f35ffc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:54:01.507482886Z [2024-03-21 01:54:01,503: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:54:01.571206208Z [2024-03-21 01:54:01,567: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:54:01.616182063Z [2024-03-21 01:54:01,612: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:54:01.617218980Z [2024-03-21 01:54:01,613: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:54:01.752963810Z [2024-03-21 01:54:01,752: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:54:01.829690164Z [2024-03-21 01:54:01,829: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T01:54:01.834963275Z [2024-03-21 01:54:01,834: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:54:01.862311606Z [2024-03-21 01:54:01,862: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:54:01.863438756Z [2024-03-21 01:54:01,863: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:54:01.863494070Z [2024-03-21 01:54:01,863: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:54:01.863539098Z [2024-03-21 01:54:01,863: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T01:54:01.863767812Z [2024-03-21 01:54:01,863: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:54:01.966675803Z [2024-03-21 01:54:01,966: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:54:02.538371221Z [2024-03-21 01:54:02,537: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0c6f7b2b-6acb-4d83-9e03-f6c9b57478e2] succeeded in 1.3622716429999855s: None
2024-03-21T01:54:02.786064224Z [2024-03-21 01:54:02,785: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3877b307-a403-4f3b-9c15-a9a7cc1add6a] succeeded in 1.618551853000099s: None
2024-03-21T01:54:03.149024394Z [2024-03-21 01:54:03,148: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:54:03.154201840Z [2024-03-21 01:54:03,153: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:54:03.161594864Z [2024-03-21 01:54:03,161: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T01:54:03.165051310Z [2024-03-21 01:54:03,164: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:54:03.178780135Z [2024-03-21 01:54:03,178: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:54:03.180494595Z [2024-03-21 01:54:03,180: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:54:03.180862645Z [2024-03-21 01:54:03,180: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:54:03.181153336Z [2024-03-21 01:54:03,180: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:54:03.181204674Z [2024-03-21 01:54:03,181: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:54:03.181500710Z [2024-03-21 01:54:03,181: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:54:03.181992652Z [2024-03-21 01:54:03,181: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:54:03.189191956Z [2024-03-21 01:54:03,188: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:54:03.190335544Z [2024-03-21 01:54:03,190: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:54:03.190346669Z [2024-03-21 01:54:03,190: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:54:03.190467490Z [2024-03-21 01:54:03,190: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:54:03.190480592Z [2024-03-21 01:54:03,190: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T01:54:03.190714059Z [2024-03-21 01:54:03,190: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:54:03.190766484Z [2024-03-21 01:54:03,190: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:54:03.280373450Z [2024-03-21 01:54:03,280: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:54:03.296736947Z [2024-03-21 01:54:03,296: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:54:05.466147260Z [2024-03-21 01:54:05,465: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0dcdd05f-60b1-4889-a0e0-75fe9d8e13d2] succeeded in 4.3019548039992515s: None
2024-03-21T01:54:06.180813298Z [2024-03-21 01:54:06,179: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e4379566-c029-4a55-8819-337f65f35ffc] succeeded in 5.004232246999891s: None
2024-03-21T01:55:00.372062230Z [2024-03-21 01:55:00,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fdb3e84-a8df-4e14-9bf9-d5e72f074cd2] received
2024-03-21T01:55:00.376960919Z [2024-03-21 01:55:00,376: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2863cc1d-0898-4c54-b6a6-90d8ddbf73d9] received
2024-03-21T01:55:00.386204737Z [2024-03-21 01:55:00,385: INFO/ForkPoolWorker-16] [2863cc1d-0898-4c54-b6a6-90d8ddbf73d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:55:00.390061293Z [2024-03-21 01:55:00,389: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a94ccb5a-7fba-4969-abaf-c586df1bf34a] received
2024-03-21T01:55:00.390365349Z [2024-03-21 01:55:00,390: INFO/ForkPoolWorker-15] [8fdb3e84-a8df-4e14-9bf9-d5e72f074cd2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:55:00.398013367Z [2024-03-21 01:55:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5301c43a-923a-4c40-8db5-c4f17acd4d2c] received
2024-03-21T01:55:00.399703245Z [2024-03-21 01:55:00,399: INFO/ForkPoolWorker-1] [a94ccb5a-7fba-4969-abaf-c586df1bf34a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:55:00.409194707Z [2024-03-21 01:55:00,408: INFO/ForkPoolWorker-2] [5301c43a-923a-4c40-8db5-c4f17acd4d2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:55:00.695832166Z [2024-03-21 01:55:00,691: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:55:00.715959608Z [2024-03-21 01:55:00,712: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:55:00.716431948Z [2024-03-21 01:55:00,713: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:55:00.798813623Z [2024-03-21 01:55:00,795: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:55:00.929589451Z [2024-03-21 01:55:00,929: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T01:55:00.938013934Z [2024-03-21 01:55:00,937: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:55:00.959934608Z [2024-03-21 01:55:00,959: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:55:00.961224331Z [2024-03-21 01:55:00,961: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:55:00.961342138Z [2024-03-21 01:55:00,961: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:55:00.961418583Z [2024-03-21 01:55:00,961: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T01:55:00.961646263Z [2024-03-21 01:55:00,961: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:55:01.065839902Z [2024-03-21 01:55:01,065: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:55:01.745944399Z [2024-03-21 01:55:01,745: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5301c43a-923a-4c40-8db5-c4f17acd4d2c] succeeded in 1.3451068630001828s: None
2024-03-21T01:55:02.053154297Z [2024-03-21 01:55:02,052: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:55:02.057248139Z [2024-03-21 01:55:02,056: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:55:02.062402102Z [2024-03-21 01:55:02,062: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:55:02.065956634Z [2024-03-21 01:55:02,065: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:55:02.079320182Z [2024-03-21 01:55:02,079: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:55:02.083982257Z [2024-03-21 01:55:02,083: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:55:02.084067360Z [2024-03-21 01:55:02,083: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:55:02.084297226Z [2024-03-21 01:55:02,084: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:55:02.084487337Z [2024-03-21 01:55:02,084: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:55:02.084506141Z [2024-03-21 01:55:02,084: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:55:02.084894188Z [2024-03-21 01:55:02,084: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:55:02.084959546Z [2024-03-21 01:55:02,084: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:55:02.085969018Z [2024-03-21 01:55:02,085: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:55:02.086069595Z [2024-03-21 01:55:02,085: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:55:02.086199182Z [2024-03-21 01:55:02,086: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:55:02.086298514Z [2024-03-21 01:55:02,086: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:55:02.086513783Z [2024-03-21 01:55:02,086: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:55:02.086618390Z [2024-03-21 01:55:02,086: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:55:02.204001163Z [2024-03-21 01:55:02,203: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T01:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:55:02.204213818Z [2024-03-21 01:55:02,203: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:55:02.217621391Z [2024-03-21 01:55:02,217: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:55:02.222353771Z [2024-03-21 01:55:02,221: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:55:02.288541536Z [2024-03-21 01:55:02,287: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:55:02.290941952Z [2024-03-21 01:55:02,290: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:55:02.290974085Z [2024-03-21 01:55:02,290: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:55:02.290981347Z [2024-03-21 01:55:02,290: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:55:02.290988521Z [2024-03-21 01:55:02,290: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:55:02.291404123Z [2024-03-21 01:55:02,291: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:55:02.291418535Z [2024-03-21 01:55:02,291: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:55:02.398315457Z [2024-03-21 01:55:02,397: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:55:02.997536695Z [2024-03-21 01:55:02,996: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8fdb3e84-a8df-4e14-9bf9-d5e72f074cd2] succeeded in 2.6159880310005974s: None
2024-03-21T01:55:03.204985025Z [2024-03-21 01:55:03,204: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e48515b0-0dbc-4e07-b1ae-644788bef804] received
2024-03-21T01:55:03.214589681Z [2024-03-21 01:55:03,214: INFO/ForkPoolWorker-15] [e48515b0-0dbc-4e07-b1ae-644788bef804] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:55:03.626896681Z [2024-03-21 01:55:03,623: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:55:04.045052825Z [2024-03-21 01:55:04,044: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a94ccb5a-7fba-4969-abaf-c586df1bf34a] succeeded in 3.6532431810010166s: None
2024-03-21T01:55:04.802509250Z [2024-03-21 01:55:04,802: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:55:04.805860971Z [2024-03-21 01:55:04,805: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:55:04.832422001Z [2024-03-21 01:55:04,831: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:55:04.836643355Z [2024-03-21 01:55:04,833: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:55:04.836681950Z [2024-03-21 01:55:04,833: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:55:04.836702486Z [2024-03-21 01:55:04,833: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:55:04.836708735Z [2024-03-21 01:55:04,833: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:55:04.836713294Z [2024-03-21 01:55:04,834: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:55:04.836718292Z [2024-03-21 01:55:04,834: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:55:04.937022287Z [2024-03-21 01:55:04,936: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T01:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:55:04.961886495Z [2024-03-21 01:55:04,961: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2863cc1d-0898-4c54-b6a6-90d8ddbf73d9] succeeded in 4.582153557999845s: None
2024-03-21T01:55:05.582936563Z [2024-03-21 01:55:05,582: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e48515b0-0dbc-4e07-b1ae-644788bef804] succeeded in 2.376076700998965s: None
2024-03-21T01:55:05.635319314Z [2024-03-21 01:55:05,634: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[149959f8-c958-406d-9342-fb5aa4566248] received
2024-03-21T01:55:05.645538272Z [2024-03-21 01:55:05,645: INFO/ForkPoolWorker-15] [149959f8-c958-406d-9342-fb5aa4566248] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T01:55:05.925224861Z [2024-03-21 01:55:05,921: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:55:06.997809086Z [2024-03-21 01:55:06,997: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:55:07.000958941Z [2024-03-21 01:55:07,000: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:55:07.025397611Z [2024-03-21 01:55:07,025: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:55:07.026670623Z [2024-03-21 01:55:07,026: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:55:07.026695135Z [2024-03-21 01:55:07,026: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:55:07.026761308Z [2024-03-21 01:55:07,026: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:55:07.026773737Z [2024-03-21 01:55:07,026: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:55:07.026998359Z [2024-03-21 01:55:07,026: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:55:07.027026868Z [2024-03-21 01:55:07,026: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:55:07.122854177Z [2024-03-21 01:55:07,122: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T01:50:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:55:07.708682164Z [2024-03-21 01:55:07,708: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[149959f8-c958-406d-9342-fb5aa4566248] succeeded in 2.070882060999793s: None
2024-03-21T01:55:08.037059971Z [2024-03-21 01:55:08,036: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd43f25b-8475-42be-9397-38da2ac4a10a] received
2024-03-21T01:55:08.044050516Z [2024-03-21 01:55:08,043: INFO/ForkPoolWorker-15] [bd43f25b-8475-42be-9397-38da2ac4a10a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T01:55:08.322347472Z [2024-03-21 01:55:08,319: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T01:55:09.624630196Z [2024-03-21 01:55:09,624: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:55:09.627842409Z [2024-03-21 01:55:09,627: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:55:09.657615193Z [2024-03-21 01:55:09,657: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:55:09.659717205Z [2024-03-21 01:55:09,659: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:55:09.659878526Z [2024-03-21 01:55:09,659: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:55:09.660017606Z [2024-03-21 01:55:09,659: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:55:09.660147198Z [2024-03-21 01:55:09,659: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:55:09.661137435Z [2024-03-21 01:55:09,660: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T01:55:09.661163499Z [2024-03-21 01:55:09,660: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:55:09.761393235Z [2024-03-21 01:55:09,761: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T01:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:55:10.322498516Z [2024-03-21 01:55:10,322: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bd43f25b-8475-42be-9397-38da2ac4a10a] succeeded in 2.28371608100133s: None
2024-03-21T01:56:01.318024680Z [2024-03-21 01:56:01,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37488c80-a766-4c08-b308-e9e5c9e21cd4] received
2024-03-21T01:56:01.323552416Z [2024-03-21 01:56:01,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fccc661b-b47c-4b29-a278-711f5e9cba63] received
2024-03-21T01:56:01.325178726Z [2024-03-21 01:56:01,324: INFO/ForkPoolWorker-15] [37488c80-a766-4c08-b308-e9e5c9e21cd4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:56:01.331014320Z [2024-03-21 01:56:01,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83618ca1-23b5-4ba4-b0e4-c430a2d56212] received
2024-03-21T01:56:01.332201999Z [2024-03-21 01:56:01,331: INFO/ForkPoolWorker-16] [fccc661b-b47c-4b29-a278-711f5e9cba63] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:56:01.337415065Z [2024-03-21 01:56:01,337: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81d3002c-72c8-4de3-9d3f-ebc3c8e7af6f] received
2024-03-21T01:56:01.346623891Z [2024-03-21 01:56:01,346: INFO/ForkPoolWorker-2] [81d3002c-72c8-4de3-9d3f-ebc3c8e7af6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:56:01.347819963Z [2024-03-21 01:56:01,347: INFO/ForkPoolWorker-1] [83618ca1-23b5-4ba4-b0e4-c430a2d56212] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:56:01.654183765Z [2024-03-21 01:56:01,651: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:56:01.677790304Z [2024-03-21 01:56:01,674: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:56:01.699713961Z [2024-03-21 01:56:01,696: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:56:01.724684308Z [2024-03-21 01:56:01,719: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:56:01.899748015Z [2024-03-21 01:56:01,899: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T01:56:01.903655821Z [2024-03-21 01:56:01,903: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:56:01.931829212Z [2024-03-21 01:56:01,931: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:56:01.933081443Z [2024-03-21 01:56:01,932: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:56:01.933255051Z [2024-03-21 01:56:01,933: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:56:01.933393454Z [2024-03-21 01:56:01,933: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T01:56:01.933658590Z [2024-03-21 01:56:01,933: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:56:02.061633421Z [2024-03-21 01:56:02,061: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:56:02.075722576Z [2024-03-21 01:56:02,075: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:56:02.818111810Z [2024-03-21 01:56:02,817: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[37488c80-a766-4c08-b308-e9e5c9e21cd4] succeeded in 1.4981640779988084s: None
2024-03-21T01:56:02.838375896Z [2024-03-21 01:56:02,834: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[81d3002c-72c8-4de3-9d3f-ebc3c8e7af6f] succeeded in 1.4958596329997818s: None
2024-03-21T01:56:03.133066500Z [2024-03-21 01:56:03,132: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:56:03.137378647Z [2024-03-21 01:56:03,136: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:56:03.165348076Z [2024-03-21 01:56:03,165: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:56:03.167113986Z [2024-03-21 01:56:03,166: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:56:03.167156664Z [2024-03-21 01:56:03,167: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:56:03.167374099Z [2024-03-21 01:56:03,167: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:56:03.167494619Z [2024-03-21 01:56:03,167: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:56:03.167804723Z [2024-03-21 01:56:03,167: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:56:03.167889342Z [2024-03-21 01:56:03,167: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:56:03.267789783Z [2024-03-21 01:56:03,267: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:56:03.271091973Z [2024-03-21 01:56:03,270: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:56:03.287137983Z [2024-03-21 01:56:03,286: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:56:03.288211877Z [2024-03-21 01:56:03,288: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:56:03.288230771Z [2024-03-21 01:56:03,288: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:56:03.288443255Z [2024-03-21 01:56:03,288: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:56:03.288455638Z [2024-03-21 01:56:03,288: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:56:03.288998032Z [2024-03-21 01:56:03,288: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:56:03.289012994Z [2024-03-21 01:56:03,288: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:56:03.302922535Z [2024-03-21 01:56:03,302: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:56:03.369073251Z [2024-03-21 01:56:03,368: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:56:05.770107066Z [2024-03-21 01:56:05,769: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[83618ca1-23b5-4ba4-b0e4-c430a2d56212] succeeded in 4.436787736000042s: None
2024-03-21T01:56:06.618939721Z [2024-03-21 01:56:06,618: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fccc661b-b47c-4b29-a278-711f5e9cba63] succeeded in 5.293287811000482s: None
2024-03-21T01:57:00.417202194Z [2024-03-21 01:57:00,416: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ca5c59d-6572-4d78-8092-ed8106a5c534] received
2024-03-21T01:57:00.422655308Z [2024-03-21 01:57:00,421: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[367df3f4-ebad-4a3e-9dce-0fbc35fe3c55] received
2024-03-21T01:57:00.424097104Z [2024-03-21 01:57:00,423: INFO/ForkPoolWorker-15] [7ca5c59d-6572-4d78-8092-ed8106a5c534] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:57:00.431869161Z [2024-03-21 01:57:00,431: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60097e01-c4f3-43e1-8272-6987f8dad625] received
2024-03-21T01:57:00.439514766Z [2024-03-21 01:57:00,439: INFO/ForkPoolWorker-1] [60097e01-c4f3-43e1-8272-6987f8dad625] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:57:00.447996343Z [2024-03-21 01:57:00,446: INFO/ForkPoolWorker-16] [367df3f4-ebad-4a3e-9dce-0fbc35fe3c55] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:57:00.722169753Z [2024-03-21 01:57:00,719: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:57:00.735733605Z [2024-03-21 01:57:00,732: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:57:00.745400453Z [2024-03-21 01:57:00,741: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:57:00.945069555Z [2024-03-21 01:57:00,944: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T01:57:00.949070091Z [2024-03-21 01:57:00,948: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:57:00.974299061Z [2024-03-21 01:57:00,974: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:57:00.976613027Z [2024-03-21 01:57:00,976: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:57:00.976730129Z [2024-03-21 01:57:00,976: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:57:00.976747924Z [2024-03-21 01:57:00,976: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T01:57:00.977001645Z [2024-03-21 01:57:00,976: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:57:01.105393222Z [2024-03-21 01:57:01,104: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:57:01.762115303Z [2024-03-21 01:57:01,761: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[60097e01-c4f3-43e1-8272-6987f8dad625] succeeded in 1.3286546809995343s: None
2024-03-21T01:57:02.017916134Z [2024-03-21 01:57:02,017: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:57:02.021473713Z [2024-03-21 01:57:02,021: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:57:02.044906239Z [2024-03-21 01:57:02,044: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:57:02.046347858Z [2024-03-21 01:57:02,046: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:57:02.046395312Z [2024-03-21 01:57:02,046: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:57:02.046609489Z [2024-03-21 01:57:02,046: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:57:02.046666041Z [2024-03-21 01:57:02,046: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:57:02.046991536Z [2024-03-21 01:57:02,046: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:57:02.047035831Z [2024-03-21 01:57:02,046: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:57:02.135805603Z [2024-03-21 01:57:02,135: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:57:02.136553144Z [2024-03-21 01:57:02,136: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:57:02.140245120Z [2024-03-21 01:57:02,139: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:57:02.166844685Z [2024-03-21 01:57:02,166: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:57:02.168197372Z [2024-03-21 01:57:02,167: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:57:02.168351925Z [2024-03-21 01:57:02,168: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:57:02.168557784Z [2024-03-21 01:57:02,168: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:57:02.168752253Z [2024-03-21 01:57:02,168: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:57:02.169088856Z [2024-03-21 01:57:02,168: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:57:02.169100729Z [2024-03-21 01:57:02,168: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:57:02.276450205Z [2024-03-21 01:57:02,275: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:57:04.394810190Z [2024-03-21 01:57:04,394: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7ca5c59d-6572-4d78-8092-ed8106a5c534] succeeded in 3.9759914460009895s: None
2024-03-21T01:57:04.691190315Z [2024-03-21 01:57:04,690: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[367df3f4-ebad-4a3e-9dce-0fbc35fe3c55] succeeded in 4.265281257999959s: None
2024-03-21T01:58:00.511313165Z [2024-03-21 01:58:00,510: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[096fb184-699d-4eb5-9f3d-7204b9ddea83] received
2024-03-21T01:58:00.512777398Z [2024-03-21 01:58:00,512: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd0e51d3-ba75-4f3f-b5f5-3ccedd87ea31] received
2024-03-21T01:58:00.521430620Z [2024-03-21 01:58:00,520: INFO/ForkPoolWorker-15] [096fb184-699d-4eb5-9f3d-7204b9ddea83] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T01:58:00.524149931Z [2024-03-21 01:58:00,523: INFO/ForkPoolWorker-16] [dd0e51d3-ba75-4f3f-b5f5-3ccedd87ea31] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:58:00.527893979Z [2024-03-21 01:58:00,527: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0cc65972-6df3-40c2-b45f-abab320eef9a] received
2024-03-21T01:58:00.535686515Z [2024-03-21 01:58:00,535: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b92169d-9ccc-4871-bdf0-e96772ef8f68] received
2024-03-21T01:58:00.542499208Z [2024-03-21 01:58:00,542: INFO/ForkPoolWorker-1] [0cc65972-6df3-40c2-b45f-abab320eef9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:58:00.552850427Z [2024-03-21 01:58:00,552: INFO/ForkPoolWorker-2] [2b92169d-9ccc-4871-bdf0-e96772ef8f68] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:58:00.894683255Z [2024-03-21 01:58:00,891: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T01:58:00.906623022Z [2024-03-21 01:58:00,902: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:58:01.018149494Z [2024-03-21 01:58:01,013: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:58:01.045695978Z [2024-03-21 01:58:01,041: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:58:01.130481285Z [2024-03-21 01:58:01,130: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:58:01.214835363Z [2024-03-21 01:58:01,214: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T01:58:01.219118272Z [2024-03-21 01:58:01,218: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:58:01.256945155Z [2024-03-21 01:58:01,256: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T01:58:01.258449478Z [2024-03-21 01:58:01,258: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:58:01.258585433Z [2024-03-21 01:58:01,258: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:58:01.258663904Z [2024-03-21 01:58:01,258: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T01:58:01.259073417Z [2024-03-21 01:58:01,258: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:58:01.357631825Z [2024-03-21 01:58:01,357: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:58:01.772797787Z [2024-03-21 01:58:01,772: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[096fb184-699d-4eb5-9f3d-7204b9ddea83] succeeded in 1.2589557270002842s: None
2024-03-21T01:58:02.076952653Z [2024-03-21 01:58:02,076: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2b92169d-9ccc-4871-bdf0-e96772ef8f68] succeeded in 1.5334292659990751s: None
2024-03-21T01:58:02.577489789Z [2024-03-21 01:58:02,576: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T01:58:02.583171054Z [2024-03-21 01:58:02,582: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:58:02.594644825Z [2024-03-21 01:58:02,594: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:58:02.598646746Z [2024-03-21 01:58:02,598: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:58:02.614560734Z [2024-03-21 01:58:02,614: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:58:02.617506474Z [2024-03-21 01:58:02,617: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:58:02.617563677Z [2024-03-21 01:58:02,617: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:58:02.617775395Z [2024-03-21 01:58:02,617: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:58:02.617804249Z [2024-03-21 01:58:02,617: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T01:58:02.618139284Z [2024-03-21 01:58:02,617: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:58:02.618385420Z [2024-03-21 01:58:02,618: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:58:02.635548571Z [2024-03-21 01:58:02,635: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:58:02.637179932Z [2024-03-21 01:58:02,636: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:58:02.637302068Z [2024-03-21 01:58:02,637: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:58:02.637481927Z [2024-03-21 01:58:02,637: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:58:02.637549188Z [2024-03-21 01:58:02,637: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:58:02.638089295Z [2024-03-21 01:58:02,637: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:58:02.638412859Z [2024-03-21 01:58:02,638: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:58:02.743721506Z [2024-03-21 01:58:02,743: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:58:02.785099277Z [2024-03-21 01:58:02,784: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:58:04.500668163Z [2024-03-21 01:58:04,499: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0cc65972-6df3-40c2-b45f-abab320eef9a] succeeded in 3.9691755200001353s: None
2024-03-21T01:58:04.687391858Z [2024-03-21 01:58:04,686: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dd0e51d3-ba75-4f3f-b5f5-3ccedd87ea31] succeeded in 4.171593027000199s: None
2024-03-21T01:59:00.618864976Z [2024-03-21 01:59:00,618: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a600365b-8a8c-4380-9d07-26322ed69ccb] received
2024-03-21T01:59:00.626953982Z [2024-03-21 01:59:00,626: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f696f336-81bb-440f-8355-2f6ad4f3e5b8] received
2024-03-21T01:59:00.627889765Z [2024-03-21 01:59:00,627: INFO/ForkPoolWorker-15] [a600365b-8a8c-4380-9d07-26322ed69ccb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T01:59:00.631386870Z [2024-03-21 01:59:00,631: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b9988a7-2ac4-44b9-a4fe-82aa592d986c] received
2024-03-21T01:59:00.634676682Z [2024-03-21 01:59:00,634: INFO/ForkPoolWorker-16] [f696f336-81bb-440f-8355-2f6ad4f3e5b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T01:59:00.656419657Z [2024-03-21 01:59:00,655: INFO/ForkPoolWorker-1] [5b9988a7-2ac4-44b9-a4fe-82aa592d986c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T01:59:00.937739985Z [2024-03-21 01:59:00,934: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T01:59:00.964622852Z [2024-03-21 01:59:00,961: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T01:59:00.980893239Z [2024-03-21 01:59:00,977: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T01:59:01.155103636Z [2024-03-21 01:59:01,154: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T01:59:01.159434679Z [2024-03-21 01:59:01,158: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:59:01.198796971Z [2024-03-21 01:59:01,198: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T01:59:01.200352070Z [2024-03-21 01:59:01,200: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T01:59:01.200627899Z [2024-03-21 01:59:01,200: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T01:59:01.200801329Z [2024-03-21 01:59:01,200: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T01:59:01.201049189Z [2024-03-21 01:59:01,200: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T01:59:01.304417358Z [2024-03-21 01:59:01,304: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:59:01.951856899Z [2024-03-21 01:59:01,951: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5b9988a7-2ac4-44b9-a4fe-82aa592d986c] succeeded in 1.3190593690014794s: None
2024-03-21T01:59:02.052037785Z [2024-03-21 01:59:02,051: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T01:59:02.055389097Z [2024-03-21 01:59:02,054: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:59:02.073983640Z [2024-03-21 01:59:02,073: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T01:59:02.075173695Z [2024-03-21 01:59:02,074: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:59:02.075194806Z [2024-03-21 01:59:02,075: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:59:02.075377776Z [2024-03-21 01:59:02,075: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:59:02.075435035Z [2024-03-21 01:59:02,075: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T01:59:02.075685547Z [2024-03-21 01:59:02,075: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T01:59:02.075732047Z [2024-03-21 01:59:02,075: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:59:02.174601645Z [2024-03-21 01:59:02,174: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T01:59:02.178402846Z [2024-03-21 01:59:02,177: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T01:59:02.179983533Z [2024-03-21 01:59:02,179: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:59:02.211489735Z [2024-03-21 01:59:02,211: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T01:59:02.213724004Z [2024-03-21 01:59:02,213: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T01:59:02.213919180Z [2024-03-21 01:59:02,213: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T01:59:02.214147981Z [2024-03-21 01:59:02,213: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T01:59:02.214256123Z [2024-03-21 01:59:02,214: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T01:59:02.214615944Z [2024-03-21 01:59:02,214: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T01:59:02.214825846Z [2024-03-21 01:59:02,214: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T01:59:02.361053302Z [2024-03-21 01:59:02,360: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T01:59:04.250429104Z [2024-03-21 01:59:04,250: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f696f336-81bb-440f-8355-2f6ad4f3e5b8] succeeded in 3.6218773529999453s: None
2024-03-21T01:59:04.498149757Z [2024-03-21 01:59:04,497: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a600365b-8a8c-4380-9d07-26322ed69ccb] succeeded in 3.8758163590009644s: None
2024-03-21T02:00:00.549568228Z [2024-03-21 02:00:00,549: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf9eefd6-ca3c-47f7-9c34-287166c82a37] received
2024-03-21T02:00:00.552128242Z [2024-03-21 02:00:00,551: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16a92514-55bd-42ab-b07c-3e4716464d30] received
2024-03-21T02:00:00.554695148Z [2024-03-21 02:00:00,554: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b1a7ffd-7bd6-418a-9c1c-b1783dab9d7b] received
2024-03-21T02:00:00.558862948Z [2024-03-21 02:00:00,558: INFO/ForkPoolWorker-15] [bf9eefd6-ca3c-47f7-9c34-287166c82a37] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:00:00.563008033Z [2024-03-21 02:00:00,562: INFO/ForkPoolWorker-1] [4b1a7ffd-7bd6-418a-9c1c-b1783dab9d7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:00:00.563688264Z [2024-03-21 02:00:00,563: INFO/ForkPoolWorker-16] [16a92514-55bd-42ab-b07c-3e4716464d30] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:00:00.565632397Z [2024-03-21 02:00:00,565: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[036249a3-91db-4230-8dec-3daff66d8e15] received
2024-03-21T02:00:00.567943529Z [2024-03-21 02:00:00,567: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[968ff1b2-680f-4d2e-98bb-7a27cf4e499b] received
2024-03-21T02:00:00.580232047Z [2024-03-21 02:00:00,579: INFO/ForkPoolWorker-2] [036249a3-91db-4230-8dec-3daff66d8e15] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:00:00.582754917Z [2024-03-21 02:00:00,582: INFO/ForkPoolWorker-3] [968ff1b2-680f-4d2e-98bb-7a27cf4e499b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:00:00.923066838Z [2024-03-21 02:00:00,919: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:00:00.952803109Z [2024-03-21 02:00:00,949: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:00:00.961270296Z [2024-03-21 02:00:00,957: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:00:01.121721259Z [2024-03-21 02:00:01,117: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:00:01.206277986Z [2024-03-21 02:00:01,198: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:00:01.410342358Z [2024-03-21 02:00:01,410: INFO/ForkPoolWorker-2] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T01:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:00:01.591942960Z [2024-03-21 02:00:01,591: INFO/ForkPoolWorker-3] Getting SDNC list
2024-03-21T02:00:01.597729461Z [2024-03-21 02:00:01,597: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:00:01.648370381Z [2024-03-21 02:00:01,648: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-21T02:00:01.653930080Z [2024-03-21 02:00:01,653: INFO/ForkPoolWorker-3] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:00:01.653959163Z [2024-03-21 02:00:01,653: INFO/ForkPoolWorker-3] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:00:01.654024745Z [2024-03-21 02:00:01,653: INFO/ForkPoolWorker-3] Getting SDNC list OK
2024-03-21T02:00:01.654242479Z [2024-03-21 02:00:01,654: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:00:01.820378874Z [2024-03-21 02:00:01,820: INFO/ForkPoolWorker-3] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T01:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:00:02.391721181Z [2024-03-21 02:00:02,389: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[036249a3-91db-4230-8dec-3daff66d8e15] succeeded in 1.8226693980013806s: None
2024-03-21T02:00:02.884011310Z [2024-03-21 02:00:02,883: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[968ff1b2-680f-4d2e-98bb-7a27cf4e499b] succeeded in 2.312209220001023s: None
2024-03-21T02:00:02.966816996Z [2024-03-21 02:00:02,966: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:00:02.972224036Z [2024-03-21 02:00:02,971: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:00:03.040587529Z [2024-03-21 02:00:03,037: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:00:03.045454913Z [2024-03-21 02:00:03,045: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:00:03.045489870Z [2024-03-21 02:00:03,045: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:00:03.045788954Z [2024-03-21 02:00:03,045: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:00:03.046322961Z [2024-03-21 02:00:03,045: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:00:03.047595722Z [2024-03-21 02:00:03,047: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:00:03.047625836Z [2024-03-21 02:00:03,047: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:00:03.213758223Z [2024-03-21 02:00:03,213: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:00:03.217679516Z [2024-03-21 02:00:03,217: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:00:03.270831676Z [2024-03-21 02:00:03,270: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:00:03.276330331Z [2024-03-21 02:00:03,272: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:00:03.276359918Z [2024-03-21 02:00:03,275: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:00:03.276374620Z [2024-03-21 02:00:03,276: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:00:03.276493427Z [2024-03-21 02:00:03,276: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:00:03.276837651Z [2024-03-21 02:00:03,276: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:00:03.277276261Z [2024-03-21 02:00:03,277: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:00:03.295926510Z [2024-03-21 02:00:03,295: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T01:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:00:03.446536431Z [2024-03-21 02:00:03,446: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T01:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:00:03.827629148Z [2024-03-21 02:00:03,827: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:00:03.831817709Z [2024-03-21 02:00:03,831: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:00:03.866004146Z [2024-03-21 02:00:03,865: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:00:03.873948506Z [2024-03-21 02:00:03,873: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:00:03.874099857Z [2024-03-21 02:00:03,873: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:00:03.874314021Z [2024-03-21 02:00:03,874: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:00:03.874396348Z [2024-03-21 02:00:03,874: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:00:03.874784033Z [2024-03-21 02:00:03,874: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:00:03.874929821Z [2024-03-21 02:00:03,874: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:00:04.028912287Z [2024-03-21 02:00:04,028: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T01:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:00:04.248105988Z [2024-03-21 02:00:04,247: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4b1a7ffd-7bd6-418a-9c1c-b1783dab9d7b] succeeded in 3.6905438359990512s: None
2024-03-21T02:00:04.440855020Z [2024-03-21 02:00:04,440: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17077f3f-5025-4409-bac5-65ff786f41cb] received
2024-03-21T02:00:04.466905225Z [2024-03-21 02:00:04,465: INFO/ForkPoolWorker-1] [17077f3f-5025-4409-bac5-65ff786f41cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:00:04.809755722Z [2024-03-21 02:00:04,806: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:00:05.534054297Z [2024-03-21 02:00:05,533: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bf9eefd6-ca3c-47f7-9c34-287166c82a37] succeeded in 4.982369034998555s: None
2024-03-21T02:00:06.003370205Z [2024-03-21 02:00:06,002: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[16a92514-55bd-42ab-b07c-3e4716464d30] succeeded in 5.44726629699835s: None
2024-03-21T02:00:06.102733844Z [2024-03-21 02:00:06,102: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:00:06.106179733Z [2024-03-21 02:00:06,105: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:00:06.130391115Z [2024-03-21 02:00:06,130: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:00:06.132141594Z [2024-03-21 02:00:06,131: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:00:06.132414830Z [2024-03-21 02:00:06,132: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:00:06.132881883Z [2024-03-21 02:00:06,132: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:00:06.133182020Z [2024-03-21 02:00:06,132: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:00:06.133678912Z [2024-03-21 02:00:06,133: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:00:06.134185077Z [2024-03-21 02:00:06,133: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:00:06.220392163Z [2024-03-21 02:00:06,220: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T01:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:00:06.821364803Z [2024-03-21 02:00:06,821: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5e69f1c-fc61-4cb1-9803-c942a30be2a9] received
2024-03-21T02:00:06.832617089Z [2024-03-21 02:00:06,831: INFO/ForkPoolWorker-15] [e5e69f1c-fc61-4cb1-9803-c942a30be2a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T02:00:06.871905169Z [2024-03-21 02:00:06,871: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[17077f3f-5025-4409-bac5-65ff786f41cb] succeeded in 2.4277764879989263s: None
2024-03-21T02:00:07.200953581Z [2024-03-21 02:00:07,197: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:00:08.441726027Z [2024-03-21 02:00:08,440: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:00:08.445514565Z [2024-03-21 02:00:08,444: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:00:08.469261898Z [2024-03-21 02:00:08,469: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:00:08.480745887Z [2024-03-21 02:00:08,476: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:00:08.480757698Z [2024-03-21 02:00:08,477: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:00:08.480762304Z [2024-03-21 02:00:08,477: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:00:08.480766957Z [2024-03-21 02:00:08,477: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:00:08.480770923Z [2024-03-21 02:00:08,477: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:00:08.480774812Z [2024-03-21 02:00:08,477: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:00:08.583264112Z [2024-03-21 02:00:08,582: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T01:55:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:00:09.155322026Z [2024-03-21 02:00:09,154: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e5e69f1c-fc61-4cb1-9803-c942a30be2a9] succeeded in 2.3317198419990746s: None
2024-03-21T02:00:09.219977900Z [2024-03-21 02:00:09,219: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a03f165-c31a-42b1-b557-d1c92efba739] received
2024-03-21T02:00:09.234222326Z [2024-03-21 02:00:09,233: INFO/ForkPoolWorker-15] [8a03f165-c31a-42b1-b557-d1c92efba739] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:00:09.583219670Z [2024-03-21 02:00:09,579: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:00:10.831326217Z [2024-03-21 02:00:10,830: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:00:10.834664367Z [2024-03-21 02:00:10,834: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:00:10.857379603Z [2024-03-21 02:00:10,857: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:00:10.858643672Z [2024-03-21 02:00:10,858: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:00:10.858659532Z [2024-03-21 02:00:10,858: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:00:10.858792516Z [2024-03-21 02:00:10,858: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:00:10.858837775Z [2024-03-21 02:00:10,858: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:00:10.859049977Z [2024-03-21 02:00:10,858: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:00:10.859098141Z [2024-03-21 02:00:10,859: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:00:10.965599664Z [2024-03-21 02:00:10,965: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T01:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:00:11.495126083Z [2024-03-21 02:00:11,494: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8a03f165-c31a-42b1-b557-d1c92efba739] succeeded in 2.2704485729991575s: None
2024-03-21T02:01:00.411325424Z [2024-03-21 02:01:00,411: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e18e04e1-6af3-4ad3-8e6e-93331edbb9dc] received
2024-03-21T02:01:00.413933705Z [2024-03-21 02:01:00,413: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b232c486-a897-401e-a2ff-7dce6eddf519] received
2024-03-21T02:01:00.418339599Z [2024-03-21 02:01:00,418: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3cc673e8-7a87-49e5-b547-f056ab24fbc1] received
2024-03-21T02:01:00.420618136Z [2024-03-21 02:01:00,420: INFO/ForkPoolWorker-15] [e18e04e1-6af3-4ad3-8e6e-93331edbb9dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:01:00.421123298Z [2024-03-21 02:01:00,420: INFO/ForkPoolWorker-16] [b232c486-a897-401e-a2ff-7dce6eddf519] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:01:00.433093734Z [2024-03-21 02:01:00,432: INFO/ForkPoolWorker-1] [3cc673e8-7a87-49e5-b547-f056ab24fbc1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:01:00.686197357Z [2024-03-21 02:01:00,683: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:01:00.731054012Z [2024-03-21 02:01:00,727: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:01:00.731092057Z [2024-03-21 02:01:00,727: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:01:00.902650411Z [2024-03-21 02:01:00,902: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T02:01:00.906829025Z [2024-03-21 02:01:00,906: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:01:00.933000802Z [2024-03-21 02:01:00,932: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:01:00.934119318Z [2024-03-21 02:01:00,933: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:01:00.934293010Z [2024-03-21 02:01:00,934: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:01:00.934427615Z [2024-03-21 02:01:00,934: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T02:01:00.934740913Z [2024-03-21 02:01:00,934: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:01:01.016791472Z [2024-03-21 02:01:01,016: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:01:01.683718786Z [2024-03-21 02:01:01,683: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3cc673e8-7a87-49e5-b547-f056ab24fbc1] succeeded in 1.2633767229999648s: None
2024-03-21T02:01:01.825437207Z [2024-03-21 02:01:01,825: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:01:01.829239075Z [2024-03-21 02:01:01,828: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:01:01.849894421Z [2024-03-21 02:01:01,849: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:01:01.851818453Z [2024-03-21 02:01:01,851: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:01:01.852009413Z [2024-03-21 02:01:01,851: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:01:01.852247189Z [2024-03-21 02:01:01,852: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:01:01.852410166Z [2024-03-21 02:01:01,852: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:01:01.852797190Z [2024-03-21 02:01:01,852: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:01:01.852990871Z [2024-03-21 02:01:01,852: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:01:01.932059447Z [2024-03-21 02:01:01,931: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:01:02.093050084Z [2024-03-21 02:01:02,092: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:01:02.097845418Z [2024-03-21 02:01:02,097: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:01:02.122090690Z [2024-03-21 02:01:02,121: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:01:02.124175744Z [2024-03-21 02:01:02,123: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:01:02.124276692Z [2024-03-21 02:01:02,124: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:01:02.124509031Z [2024-03-21 02:01:02,124: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:01:02.124632527Z [2024-03-21 02:01:02,124: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:01:02.124973696Z [2024-03-21 02:01:02,124: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:01:02.125056254Z [2024-03-21 02:01:02,124: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:01:02.251584221Z [2024-03-21 02:01:02,251: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:01:03.697491972Z [2024-03-21 02:01:03,696: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e18e04e1-6af3-4ad3-8e6e-93331edbb9dc] succeeded in 3.2822667010004807s: None
2024-03-21T02:01:04.350111485Z [2024-03-21 02:01:04,349: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b232c486-a897-401e-a2ff-7dce6eddf519] succeeded in 3.933799337999517s: None
2024-03-21T02:02:00.925967639Z [2024-03-21 02:02:00,925: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e1035794-68fb-4d3e-9ae4-af2688c13066] received
2024-03-21T02:02:00.929423593Z [2024-03-21 02:02:00,929: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30762865-96e3-4ad4-be3e-1df09a25ab17] received
2024-03-21T02:02:00.938564014Z [2024-03-21 02:02:00,938: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c5212ea-37be-4e54-b3c2-553f1794f81c] received
2024-03-21T02:02:00.939402051Z [2024-03-21 02:02:00,939: INFO/ForkPoolWorker-16] [30762865-96e3-4ad4-be3e-1df09a25ab17] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:02:00.941563305Z [2024-03-21 02:02:00,941: INFO/ForkPoolWorker-15] [e1035794-68fb-4d3e-9ae4-af2688c13066] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:02:00.947465454Z [2024-03-21 02:02:00,947: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6feab06-a76d-4863-b2d1-356409fb7fc0] received
2024-03-21T02:02:00.953461438Z [2024-03-21 02:02:00,953: INFO/ForkPoolWorker-1] [7c5212ea-37be-4e54-b3c2-553f1794f81c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:02:00.972993589Z [2024-03-21 02:02:00,972: INFO/ForkPoolWorker-2] [a6feab06-a76d-4863-b2d1-356409fb7fc0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:02:01.214983988Z [2024-03-21 02:02:01,211: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:02:01.304375003Z [2024-03-21 02:02:01,300: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:02:01.305830692Z [2024-03-21 02:02:01,302: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:02:01.347629860Z [2024-03-21 02:02:01,344: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:02:01.535695185Z [2024-03-21 02:02:01,535: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T02:02:01.540018082Z [2024-03-21 02:02:01,539: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:02:01.585512617Z [2024-03-21 02:02:01,585: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:02:01.589706430Z [2024-03-21 02:02:01,589: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:02:01.589741813Z [2024-03-21 02:02:01,589: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:02:01.589846764Z [2024-03-21 02:02:01,589: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T02:02:01.590103769Z [2024-03-21 02:02:01,589: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:02:01.640611566Z [2024-03-21 02:02:01,640: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:02:01.734072620Z [2024-03-21 02:02:01,733: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:02:02.476859135Z [2024-03-21 02:02:02,474: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e1035794-68fb-4d3e-9ae4-af2688c13066] succeeded in 1.5413742189994082s: None
2024-03-21T02:02:02.538646333Z [2024-03-21 02:02:02,538: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a6feab06-a76d-4863-b2d1-356409fb7fc0] succeeded in 1.5865423119994375s: None
2024-03-21T02:02:02.801507490Z [2024-03-21 02:02:02,800: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:02:02.805783604Z [2024-03-21 02:02:02,805: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:02:02.849761292Z [2024-03-21 02:02:02,849: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:02:02.855176207Z [2024-03-21 02:02:02,854: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:02:02.856218482Z [2024-03-21 02:02:02,855: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:02:02.856621126Z [2024-03-21 02:02:02,856: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:02:02.858688663Z [2024-03-21 02:02:02,856: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:02:02.860030409Z [2024-03-21 02:02:02,859: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:02:02.860141831Z [2024-03-21 02:02:02,859: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:02:02.973767634Z [2024-03-21 02:02:02,973: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:02:03.238928864Z [2024-03-21 02:02:03,238: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:02:03.242371707Z [2024-03-21 02:02:03,241: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:02:03.268429601Z [2024-03-21 02:02:03,267: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:02:03.269909301Z [2024-03-21 02:02:03,269: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:02:03.269921899Z [2024-03-21 02:02:03,269: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:02:03.270021936Z [2024-03-21 02:02:03,269: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:02:03.270030832Z [2024-03-21 02:02:03,269: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:02:03.270358320Z [2024-03-21 02:02:03,270: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:02:03.270363982Z [2024-03-21 02:02:03,270: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:02:03.356459424Z [2024-03-21 02:02:03,355: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:02:05.308157370Z [2024-03-21 02:02:05,307: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[30762865-96e3-4ad4-be3e-1df09a25ab17] succeeded in 4.374566579999737s: None
2024-03-21T02:02:05.726287126Z [2024-03-21 02:02:05,725: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7c5212ea-37be-4e54-b3c2-553f1794f81c] succeeded in 4.777345258000423s: None
2024-03-21T02:03:01.253970297Z [2024-03-21 02:03:01,253: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e5ed065-35de-46ce-8ecb-5fca56c3667d] received
2024-03-21T02:03:01.259775027Z [2024-03-21 02:03:01,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6690192e-ef4b-4328-81d4-d3bdf203c082] received
2024-03-21T02:03:01.261797446Z [2024-03-21 02:03:01,261: INFO/ForkPoolWorker-15] [4e5ed065-35de-46ce-8ecb-5fca56c3667d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:03:01.274720577Z [2024-03-21 02:03:01,274: INFO/ForkPoolWorker-16] [6690192e-ef4b-4328-81d4-d3bdf203c082] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:03:01.277394456Z [2024-03-21 02:03:01,277: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5af885a-d750-4132-9d87-f34c54f02e94] received
2024-03-21T02:03:01.291324086Z [2024-03-21 02:03:01,290: INFO/ForkPoolWorker-1] [d5af885a-d750-4132-9d87-f34c54f02e94] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:03:01.605305607Z [2024-03-21 02:03:01,601: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:03:01.657081862Z [2024-03-21 02:03:01,652: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:03:01.675809994Z [2024-03-21 02:03:01,672: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:03:01.890262360Z [2024-03-21 02:03:01,889: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T02:03:01.895129530Z [2024-03-21 02:03:01,894: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:03:01.933563960Z [2024-03-21 02:03:01,933: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:03:01.937964967Z [2024-03-21 02:03:01,937: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:03:01.938247563Z [2024-03-21 02:03:01,937: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:03:01.938586335Z [2024-03-21 02:03:01,938: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T02:03:01.938920228Z [2024-03-21 02:03:01,938: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:03:02.047211896Z [2024-03-21 02:03:02,046: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:03:02.752583543Z [2024-03-21 02:03:02,751: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d5af885a-d750-4132-9d87-f34c54f02e94] succeeded in 1.4724803079989215s: None
2024-03-21T02:03:02.974538991Z [2024-03-21 02:03:02,974: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:03:02.978168324Z [2024-03-21 02:03:02,977: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:03:03.020894260Z [2024-03-21 02:03:03,020: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:03:03.023208356Z [2024-03-21 02:03:03,022: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:03:03.023234937Z [2024-03-21 02:03:03,023: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:03:03.023331145Z [2024-03-21 02:03:03,023: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:03:03.023366889Z [2024-03-21 02:03:03,023: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:03:03.024886554Z [2024-03-21 02:03:03,023: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:03:03.024949130Z [2024-03-21 02:03:03,024: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:03:03.142538214Z [2024-03-21 02:03:03,142: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:03:03.193950664Z [2024-03-21 02:03:03,193: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:03:03.197529501Z [2024-03-21 02:03:03,196: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:03:03.224712582Z [2024-03-21 02:03:03,224: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:03:03.227740946Z [2024-03-21 02:03:03,227: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:03:03.227754884Z [2024-03-21 02:03:03,227: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:03:03.227854484Z [2024-03-21 02:03:03,227: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:03:03.227887237Z [2024-03-21 02:03:03,227: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:03:03.228181270Z [2024-03-21 02:03:03,228: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:03:03.228389390Z [2024-03-21 02:03:03,228: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:03:03.339219690Z [2024-03-21 02:03:03,338: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:03:05.447358968Z [2024-03-21 02:03:05,446: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4e5ed065-35de-46ce-8ecb-5fca56c3667d] succeeded in 4.1915721540008235s: None
2024-03-21T02:03:05.946121370Z [2024-03-21 02:03:05,945: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6690192e-ef4b-4328-81d4-d3bdf203c082] succeeded in 4.6811036840008455s: None
2024-03-21T02:04:00.603886336Z [2024-03-21 02:04:00,603: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6859203c-95ce-41bf-b12c-c47a774bf2b3] received
2024-03-21T02:04:00.607387669Z [2024-03-21 02:04:00,607: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15616089-f9ee-4fdd-be2b-3917ae92ee4a] received
2024-03-21T02:04:00.609612285Z [2024-03-21 02:04:00,609: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e761ea9-2b82-4f6c-b092-ec6399f34442] received
2024-03-21T02:04:00.614759548Z [2024-03-21 02:04:00,614: INFO/ForkPoolWorker-15] [6859203c-95ce-41bf-b12c-c47a774bf2b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:04:00.617202196Z [2024-03-21 02:04:00,616: INFO/ForkPoolWorker-1] [5e761ea9-2b82-4f6c-b092-ec6399f34442] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:04:00.622658194Z [2024-03-21 02:04:00,622: INFO/ForkPoolWorker-16] [15616089-f9ee-4fdd-be2b-3917ae92ee4a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:04:00.624435324Z [2024-03-21 02:04:00,624: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef2bb17e-48b2-4283-b9f7-2e0d42bb76db] received
2024-03-21T02:04:00.631656100Z [2024-03-21 02:04:00,631: INFO/ForkPoolWorker-2] [ef2bb17e-48b2-4283-b9f7-2e0d42bb76db] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:04:00.999452260Z [2024-03-21 02:04:00,996: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:04:01.012328431Z [2024-03-21 02:04:01,009: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:04:01.032445440Z [2024-03-21 02:04:01,028: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:04:01.077904308Z [2024-03-21 02:04:01,074: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:04:01.247239535Z [2024-03-21 02:04:01,246: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T02:04:01.251539387Z [2024-03-21 02:04:01,251: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:04:01.291169234Z [2024-03-21 02:04:01,290: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:04:01.293596917Z [2024-03-21 02:04:01,293: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:04:01.293736738Z [2024-03-21 02:04:01,293: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:04:01.293794142Z [2024-03-21 02:04:01,293: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T02:04:01.294109887Z [2024-03-21 02:04:01,293: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:04:01.352148908Z [2024-03-21 02:04:01,351: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:04:01.455530815Z [2024-03-21 02:04:01,455: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:04:02.107554897Z [2024-03-21 02:04:02,107: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6859203c-95ce-41bf-b12c-c47a774bf2b3] succeeded in 1.5017895429991768s: None
2024-03-21T02:04:02.153598809Z [2024-03-21 02:04:02,153: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ef2bb17e-48b2-4283-b9f7-2e0d42bb76db] succeeded in 1.527458923001177s: None
2024-03-21T02:04:02.631956304Z [2024-03-21 02:04:02,631: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:04:02.635852535Z [2024-03-21 02:04:02,635: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:04:02.659586843Z [2024-03-21 02:04:02,659: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:04:02.661036853Z [2024-03-21 02:04:02,660: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:04:02.661256306Z [2024-03-21 02:04:02,661: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:04:02.661477796Z [2024-03-21 02:04:02,661: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:04:02.661598744Z [2024-03-21 02:04:02,661: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:04:02.661925713Z [2024-03-21 02:04:02,661: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:04:02.662503949Z [2024-03-21 02:04:02,662: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:04:02.699837672Z [2024-03-21 02:04:02,699: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:04:02.703670230Z [2024-03-21 02:04:02,703: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:04:02.725228868Z [2024-03-21 02:04:02,725: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:04:02.726855654Z [2024-03-21 02:04:02,726: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:04:02.726984453Z [2024-03-21 02:04:02,726: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:04:02.727220709Z [2024-03-21 02:04:02,726: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:04:02.727353617Z [2024-03-21 02:04:02,727: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:04:02.728194028Z [2024-03-21 02:04:02,728: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:04:02.728376753Z [2024-03-21 02:04:02,728: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:04:02.751504071Z [2024-03-21 02:04:02,751: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:04:02.831927257Z [2024-03-21 02:04:02,831: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:04:04.441599661Z [2024-03-21 02:04:04,441: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[15616089-f9ee-4fdd-be2b-3917ae92ee4a] succeeded in 3.832630541000981s: None
2024-03-21T02:04:05.479022253Z [2024-03-21 02:04:05,478: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5e761ea9-2b82-4f6c-b092-ec6399f34442] succeeded in 4.867078949999268s: None
2024-03-21T02:05:00.296429052Z [2024-03-21 02:05:00,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c00a15f-a3c3-41a2-aadb-df49630ace50] received
2024-03-21T02:05:00.298698883Z [2024-03-21 02:05:00,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0216921a-6c72-41ee-b53c-0c140164a259] received
2024-03-21T02:05:00.304446156Z [2024-03-21 02:05:00,304: INFO/ForkPoolWorker-15] [3c00a15f-a3c3-41a2-aadb-df49630ace50] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:05:00.304787488Z [2024-03-21 02:05:00,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ba2769d-5195-4292-be84-ba16b1791e2e] received
2024-03-21T02:05:00.305377026Z [2024-03-21 02:05:00,305: INFO/ForkPoolWorker-16] [0216921a-6c72-41ee-b53c-0c140164a259] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:05:00.309795507Z [2024-03-21 02:05:00,309: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d835416-05c8-4ec7-bfbc-571788bf7fcd] received
2024-03-21T02:05:00.317041954Z [2024-03-21 02:05:00,316: INFO/ForkPoolWorker-1] [5ba2769d-5195-4292-be84-ba16b1791e2e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:05:00.318882875Z [2024-03-21 02:05:00,318: INFO/ForkPoolWorker-2] [3d835416-05c8-4ec7-bfbc-571788bf7fcd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:05:00.612951349Z [2024-03-21 02:05:00,610: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:05:00.615464634Z [2024-03-21 02:05:00,611: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:05:00.633093001Z [2024-03-21 02:05:00,630: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:05:00.653226228Z [2024-03-21 02:05:00,650: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:05:00.770474934Z [2024-03-21 02:05:00,770: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T02:05:00.774405349Z [2024-03-21 02:05:00,774: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:05:00.808720314Z [2024-03-21 02:05:00,808: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:05:00.809740512Z [2024-03-21 02:05:00,809: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:05:00.809922806Z [2024-03-21 02:05:00,809: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:05:00.809995032Z [2024-03-21 02:05:00,809: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T02:05:00.810174771Z [2024-03-21 02:05:00,810: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:05:00.905221448Z [2024-03-21 02:05:00,904: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:05:01.678412797Z [2024-03-21 02:05:01,677: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5ba2769d-5195-4292-be84-ba16b1791e2e] succeeded in 1.3719463300003554s: None
2024-03-21T02:05:01.970140022Z [2024-03-21 02:05:01,969: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T02:05:01.973651308Z [2024-03-21 02:05:01,973: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:05:01.990912503Z [2024-03-21 02:05:01,990: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:05:01.995473930Z [2024-03-21 02:05:01,995: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:05:02.015822199Z [2024-03-21 02:05:02,015: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:05:02.020266240Z [2024-03-21 02:05:02,020: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:05:02.020300895Z [2024-03-21 02:05:02,020: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:05:02.020522732Z [2024-03-21 02:05:02,020: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:05:02.020547485Z [2024-03-21 02:05:02,020: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T02:05:02.020713188Z [2024-03-21 02:05:02,020: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:05:02.020727390Z [2024-03-21 02:05:02,020: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:05:02.029214500Z [2024-03-21 02:05:02,028: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:05:02.030870640Z [2024-03-21 02:05:02,030: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:05:02.031060001Z [2024-03-21 02:05:02,030: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:05:02.031268479Z [2024-03-21 02:05:02,031: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:05:02.031466940Z [2024-03-21 02:05:02,031: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:05:02.031818159Z [2024-03-21 02:05:02,031: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:05:02.032020730Z [2024-03-21 02:05:02,031: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:05:02.035921791Z [2024-03-21 02:05:02,035: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:05:02.039723565Z [2024-03-21 02:05:02,039: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:05:02.066274111Z [2024-03-21 02:05:02,066: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:05:02.068380033Z [2024-03-21 02:05:02,068: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:05:02.068742567Z [2024-03-21 02:05:02,068: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:05:02.068958652Z [2024-03-21 02:05:02,068: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:05:02.069104218Z [2024-03-21 02:05:02,068: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:05:02.069396021Z [2024-03-21 02:05:02,069: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:05:02.069592719Z [2024-03-21 02:05:02,069: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:05:02.121433359Z [2024-03-21 02:05:02,121: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T02:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:05:02.150797620Z [2024-03-21 02:05:02,150: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:05:02.174620181Z [2024-03-21 02:05:02,174: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:05:02.872737959Z [2024-03-21 02:05:02,871: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3c00a15f-a3c3-41a2-aadb-df49630ace50] succeeded in 2.572626000999662s: None
2024-03-21T02:05:03.385914765Z [2024-03-21 02:05:03,385: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[351e9c8c-ccda-41b6-8557-7ad6cbbd1c87] received
2024-03-21T02:05:03.397006842Z [2024-03-21 02:05:03,396: INFO/ForkPoolWorker-15] [351e9c8c-ccda-41b6-8557-7ad6cbbd1c87] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:05:03.707319844Z [2024-03-21 02:05:03,702: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:05:03.773378637Z [2024-03-21 02:05:03,772: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0216921a-6c72-41ee-b53c-0c140164a259] succeeded in 3.473630806000074s: None
2024-03-21T02:05:04.291194997Z [2024-03-21 02:05:04,290: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3d835416-05c8-4ec7-bfbc-571788bf7fcd] succeeded in 3.9789179119998153s: None
2024-03-21T02:05:05.024540177Z [2024-03-21 02:05:05,024: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:05:05.027848121Z [2024-03-21 02:05:05,027: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:05:05.068541630Z [2024-03-21 02:05:05,064: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:05:05.068563802Z [2024-03-21 02:05:05,066: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:05:05.068569119Z [2024-03-21 02:05:05,066: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:05:05.068573653Z [2024-03-21 02:05:05,066: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:05:05.068578960Z [2024-03-21 02:05:05,066: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:05:05.068582394Z [2024-03-21 02:05:05,067: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:05:05.068585875Z [2024-03-21 02:05:05,067: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:05:05.175232102Z [2024-03-21 02:05:05,174: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T02:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:05:05.827898950Z [2024-03-21 02:05:05,826: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[351e9c8c-ccda-41b6-8557-7ad6cbbd1c87] succeeded in 2.4394367980003153s: None
2024-03-21T02:05:06.204396886Z [2024-03-21 02:05:06,204: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d98b96b-182e-4048-9a09-7b9c9418b1e7] received
2024-03-21T02:05:06.216582138Z [2024-03-21 02:05:06,216: INFO/ForkPoolWorker-15] [4d98b96b-182e-4048-9a09-7b9c9418b1e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T02:05:06.537219948Z [2024-03-21 02:05:06,534: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:05:07.650934483Z [2024-03-21 02:05:07,650: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:05:07.654201236Z [2024-03-21 02:05:07,653: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:05:07.675729646Z [2024-03-21 02:05:07,675: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:05:07.677128365Z [2024-03-21 02:05:07,676: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:05:07.677195748Z [2024-03-21 02:05:07,677: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:05:07.677399833Z [2024-03-21 02:05:07,677: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:05:07.677473847Z [2024-03-21 02:05:07,677: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:05:07.677799672Z [2024-03-21 02:05:07,677: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:05:07.677878448Z [2024-03-21 02:05:07,677: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:05:07.772383433Z [2024-03-21 02:05:07,771: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T02:00:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:05:08.372374228Z [2024-03-21 02:05:08,371: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4d98b96b-182e-4048-9a09-7b9c9418b1e7] succeeded in 2.1656555730005493s: None
2024-03-21T02:05:08.534903471Z [2024-03-21 02:05:08,534: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13462741-b070-41d0-937b-3f57e19a3e82] received
2024-03-21T02:05:08.542672722Z [2024-03-21 02:05:08,542: INFO/ForkPoolWorker-15] [13462741-b070-41d0-937b-3f57e19a3e82] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:05:08.818815433Z [2024-03-21 02:05:08,815: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:05:10.040362752Z [2024-03-21 02:05:10,039: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:05:10.043896859Z [2024-03-21 02:05:10,043: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:05:10.068254945Z [2024-03-21 02:05:10,068: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:05:10.069880345Z [2024-03-21 02:05:10,069: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:05:10.069894901Z [2024-03-21 02:05:10,069: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:05:10.069995282Z [2024-03-21 02:05:10,069: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:05:10.070030289Z [2024-03-21 02:05:10,069: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:05:10.070267234Z [2024-03-21 02:05:10,070: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:05:10.070303911Z [2024-03-21 02:05:10,070: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:05:10.153762872Z [2024-03-21 02:05:10,153: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T02:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:05:10.880263787Z [2024-03-21 02:05:10,879: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[13462741-b070-41d0-937b-3f57e19a3e82] succeeded in 2.344066155999826s: None
2024-03-21T02:06:00.194042959Z [2024-03-21 02:06:00,193: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21710319-affe-4e7b-ab69-18f01d45e8a3] received
2024-03-21T02:06:00.196389600Z [2024-03-21 02:06:00,196: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ea959c2-cee8-4a20-a4a4-99260c4586e5] received
2024-03-21T02:06:00.206646740Z [2024-03-21 02:06:00,206: INFO/ForkPoolWorker-15] [21710319-affe-4e7b-ab69-18f01d45e8a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:06:00.215180933Z [2024-03-21 02:06:00,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5de95976-cf60-4483-898e-5dde157688e5] received
2024-03-21T02:06:00.218518384Z [2024-03-21 02:06:00,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7badcca7-4328-4483-a766-79ab2bc926d3] received
2024-03-21T02:06:00.219765172Z [2024-03-21 02:06:00,219: INFO/ForkPoolWorker-16] [6ea959c2-cee8-4a20-a4a4-99260c4586e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:06:00.227936473Z [2024-03-21 02:06:00,225: INFO/ForkPoolWorker-2] [7badcca7-4328-4483-a766-79ab2bc926d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:06:00.229535019Z [2024-03-21 02:06:00,229: INFO/ForkPoolWorker-1] [5de95976-cf60-4483-898e-5dde157688e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:06:00.547266533Z [2024-03-21 02:06:00,544: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:06:00.562526953Z [2024-03-21 02:06:00,559: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:06:00.596260511Z [2024-03-21 02:06:00,593: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:06:00.638088426Z [2024-03-21 02:06:00,634: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:06:00.777740786Z [2024-03-21 02:06:00,777: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T02:06:00.781489635Z [2024-03-21 02:06:00,781: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:06:00.815894484Z [2024-03-21 02:06:00,815: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:06:00.817920656Z [2024-03-21 02:06:00,817: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:06:00.818291546Z [2024-03-21 02:06:00,817: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:06:00.818487222Z [2024-03-21 02:06:00,818: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T02:06:00.818920798Z [2024-03-21 02:06:00,818: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:06:00.920881208Z [2024-03-21 02:06:00,920: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:06:00.940479173Z [2024-03-21 02:06:00,940: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:06:01.709024477Z [2024-03-21 02:06:01,708: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[21710319-affe-4e7b-ab69-18f01d45e8a3] succeeded in 1.511302627999612s: None
2024-03-21T02:06:01.853389985Z [2024-03-21 02:06:01,852: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7badcca7-4328-4483-a766-79ab2bc926d3] succeeded in 1.632756626999253s: None
2024-03-21T02:06:02.129524435Z [2024-03-21 02:06:02,129: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:06:02.134710866Z [2024-03-21 02:06:02,134: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:06:02.156733490Z [2024-03-21 02:06:02,156: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:06:02.158616074Z [2024-03-21 02:06:02,158: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:06:02.158633473Z [2024-03-21 02:06:02,158: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:06:02.158769505Z [2024-03-21 02:06:02,158: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:06:02.158845556Z [2024-03-21 02:06:02,158: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:06:02.159338848Z [2024-03-21 02:06:02,159: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:06:02.159957074Z [2024-03-21 02:06:02,159: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:06:02.200377016Z [2024-03-21 02:06:02,199: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:06:02.204176121Z [2024-03-21 02:06:02,203: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:06:02.224416428Z [2024-03-21 02:06:02,224: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:06:02.225899687Z [2024-03-21 02:06:02,225: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:06:02.225944659Z [2024-03-21 02:06:02,225: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:06:02.226213152Z [2024-03-21 02:06:02,225: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:06:02.226241934Z [2024-03-21 02:06:02,226: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:06:02.226557487Z [2024-03-21 02:06:02,226: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:06:02.226656140Z [2024-03-21 02:06:02,226: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:06:02.278874952Z [2024-03-21 02:06:02,278: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:06:02.336493856Z [2024-03-21 02:06:02,335: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:06:04.369635373Z [2024-03-21 02:06:04,369: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5de95976-cf60-4483-898e-5dde157688e5] succeeded in 4.152670528999806s: None
2024-03-21T02:06:05.211835732Z [2024-03-21 02:06:05,211: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6ea959c2-cee8-4a20-a4a4-99260c4586e5] succeeded in 4.998422352000489s: None
2024-03-21T02:07:00.543671097Z [2024-03-21 02:07:00,543: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8c28376-0fbf-4a15-b0a5-63fd6d7b21d1] received
2024-03-21T02:07:00.553267635Z [2024-03-21 02:07:00,552: INFO/ForkPoolWorker-15] [e8c28376-0fbf-4a15-b0a5-63fd6d7b21d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:07:00.554670071Z [2024-03-21 02:07:00,554: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fcea0062-34c5-40db-b842-1bcba46cdbfd] received
2024-03-21T02:07:00.561158963Z [2024-03-21 02:07:00,560: INFO/ForkPoolWorker-16] [fcea0062-34c5-40db-b842-1bcba46cdbfd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:07:00.563312717Z [2024-03-21 02:07:00,563: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3cb25176-9b89-47c9-bd6e-e54d4e0051b5] received
2024-03-21T02:07:00.573066292Z [2024-03-21 02:07:00,572: INFO/ForkPoolWorker-1] [3cb25176-9b89-47c9-bd6e-e54d4e0051b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:07:00.877411366Z [2024-03-21 02:07:00,874: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:07:00.915966676Z [2024-03-21 02:07:00,912: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:07:00.978085927Z [2024-03-21 02:07:00,974: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:07:01.082858311Z [2024-03-21 02:07:01,082: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T02:07:01.086908664Z [2024-03-21 02:07:01,086: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:07:01.118170371Z [2024-03-21 02:07:01,116: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:07:01.119738426Z [2024-03-21 02:07:01,119: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:07:01.119959777Z [2024-03-21 02:07:01,119: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:07:01.120067678Z [2024-03-21 02:07:01,119: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T02:07:01.120678445Z [2024-03-21 02:07:01,120: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:07:01.210656800Z [2024-03-21 02:07:01,210: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:07:01.839384195Z [2024-03-21 02:07:01,838: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fcea0062-34c5-40db-b842-1bcba46cdbfd] succeeded in 1.2828750659991783s: None
2024-03-21T02:07:02.089096029Z [2024-03-21 02:07:02,088: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:07:02.089940258Z [2024-03-21 02:07:02,089: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:07:02.092799315Z [2024-03-21 02:07:02,092: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:07:02.093075818Z [2024-03-21 02:07:02,092: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:07:02.110232150Z [2024-03-21 02:07:02,109: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:07:02.112263327Z [2024-03-21 02:07:02,112: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:07:02.112278996Z [2024-03-21 02:07:02,112: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:07:02.112458416Z [2024-03-21 02:07:02,112: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:07:02.112472236Z [2024-03-21 02:07:02,112: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:07:02.112727858Z [2024-03-21 02:07:02,112: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:07:02.112757697Z [2024-03-21 02:07:02,112: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:07:02.114449056Z [2024-03-21 02:07:02,114: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:07:02.115642263Z [2024-03-21 02:07:02,115: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:07:02.115666637Z [2024-03-21 02:07:02,115: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:07:02.115827167Z [2024-03-21 02:07:02,115: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:07:02.115893235Z [2024-03-21 02:07:02,115: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:07:02.116106813Z [2024-03-21 02:07:02,115: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:07:02.116177699Z [2024-03-21 02:07:02,116: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:07:02.218358554Z [2024-03-21 02:07:02,218: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:07:02.237530164Z [2024-03-21 02:07:02,237: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:07:03.878706837Z [2024-03-21 02:07:03,878: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3cb25176-9b89-47c9-bd6e-e54d4e0051b5] succeeded in 3.3128779050002777s: None
2024-03-21T02:07:04.366049783Z [2024-03-21 02:07:04,365: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e8c28376-0fbf-4a15-b0a5-63fd6d7b21d1] succeeded in 3.8198285279995616s: None
2024-03-21T02:08:01.000074555Z [2024-03-21 02:08:00,999: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[866488ed-bd13-4b74-9bad-517376ce0df9] received
2024-03-21T02:08:01.003138900Z [2024-03-21 02:08:01,002: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cacdbf6a-d7d7-40cb-9ab1-3e7d0aab8951] received
2024-03-21T02:08:01.012401764Z [2024-03-21 02:08:01,012: INFO/ForkPoolWorker-16] [cacdbf6a-d7d7-40cb-9ab1-3e7d0aab8951] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:08:01.013629751Z [2024-03-21 02:08:01,013: INFO/ForkPoolWorker-15] [866488ed-bd13-4b74-9bad-517376ce0df9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:08:01.015681404Z [2024-03-21 02:08:01,015: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bbef6753-3ded-4dfa-b8b6-1d13befb0726] received
2024-03-21T02:08:01.023127441Z [2024-03-21 02:08:01,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c820681-8444-4c19-80c7-9ccef6b7a7c4] received
2024-03-21T02:08:01.026852593Z [2024-03-21 02:08:01,024: INFO/ForkPoolWorker-1] [bbef6753-3ded-4dfa-b8b6-1d13befb0726] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:08:01.041874382Z [2024-03-21 02:08:01,041: INFO/ForkPoolWorker-2] [3c820681-8444-4c19-80c7-9ccef6b7a7c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:08:01.325318753Z [2024-03-21 02:08:01,322: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:08:01.346015508Z [2024-03-21 02:08:01,343: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:08:01.403273241Z [2024-03-21 02:08:01,399: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:08:01.450864230Z [2024-03-21 02:08:01,447: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:08:01.586640841Z [2024-03-21 02:08:01,586: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T02:08:01.592257559Z [2024-03-21 02:08:01,591: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:08:01.643716238Z [2024-03-21 02:08:01,643: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:08:01.645514722Z [2024-03-21 02:08:01,645: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:08:01.647646824Z [2024-03-21 02:08:01,647: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:08:01.647847130Z [2024-03-21 02:08:01,647: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:08:01.648056251Z [2024-03-21 02:08:01,647: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T02:08:01.648501627Z [2024-03-21 02:08:01,648: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:08:01.839055926Z [2024-03-21 02:08:01,838: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:08:02.612228499Z [2024-03-21 02:08:02,611: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[866488ed-bd13-4b74-9bad-517376ce0df9] succeeded in 1.6080898059990432s: None
2024-03-21T02:08:02.868578845Z [2024-03-21 02:08:02,868: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3c820681-8444-4c19-80c7-9ccef6b7a7c4] succeeded in 1.842946695000137s: None
2024-03-21T02:08:03.280248381Z [2024-03-21 02:08:03,279: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:08:03.284707611Z [2024-03-21 02:08:03,284: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:08:03.310613099Z [2024-03-21 02:08:03,310: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:08:03.313151034Z [2024-03-21 02:08:03,312: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:08:03.313221877Z [2024-03-21 02:08:03,313: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:08:03.313700987Z [2024-03-21 02:08:03,313: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:08:03.313794867Z [2024-03-21 02:08:03,313: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:08:03.314210501Z [2024-03-21 02:08:03,314: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:08:03.314375503Z [2024-03-21 02:08:03,314: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:08:03.436013267Z [2024-03-21 02:08:03,435: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:08:03.462983881Z [2024-03-21 02:08:03,462: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:08:03.467831420Z [2024-03-21 02:08:03,467: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:08:03.496432087Z [2024-03-21 02:08:03,496: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:08:03.498486826Z [2024-03-21 02:08:03,498: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:08:03.499087862Z [2024-03-21 02:08:03,498: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:08:03.499281609Z [2024-03-21 02:08:03,499: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:08:03.499361011Z [2024-03-21 02:08:03,499: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:08:03.499691776Z [2024-03-21 02:08:03,499: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:08:03.500336436Z [2024-03-21 02:08:03,500: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:08:03.598088227Z [2024-03-21 02:08:03,597: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:08:05.653101816Z [2024-03-21 02:08:05,652: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bbef6753-3ded-4dfa-b8b6-1d13befb0726] succeeded in 4.635529625000345s: None
2024-03-21T02:08:06.007242804Z [2024-03-21 02:08:06,006: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cacdbf6a-d7d7-40cb-9ab1-3e7d0aab8951] succeeded in 5.00000551300036s: None
2024-03-21T02:09:00.214941636Z [2024-03-21 02:09:00,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f35862cb-f0cc-4479-b268-ab738ae13988] received
2024-03-21T02:09:00.221764105Z [2024-03-21 02:09:00,221: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec8e9f8d-1a1b-4430-8c76-2b631868521f] received
2024-03-21T02:09:00.227775041Z [2024-03-21 02:09:00,227: INFO/ForkPoolWorker-16] [ec8e9f8d-1a1b-4430-8c76-2b631868521f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:09:00.229167665Z [2024-03-21 02:09:00,228: INFO/ForkPoolWorker-15] [f35862cb-f0cc-4479-b268-ab738ae13988] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:09:00.242265094Z [2024-03-21 02:09:00,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a71d9789-7af9-4835-b70b-b73be63806e8] received
2024-03-21T02:09:00.252712635Z [2024-03-21 02:09:00,252: INFO/ForkPoolWorker-1] [a71d9789-7af9-4835-b70b-b73be63806e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:09:00.562437557Z [2024-03-21 02:09:00,559: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:09:00.599603164Z [2024-03-21 02:09:00,595: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:09:00.618244200Z [2024-03-21 02:09:00,615: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:09:00.787278552Z [2024-03-21 02:09:00,786: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T02:09:00.791480926Z [2024-03-21 02:09:00,791: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:09:00.810096989Z [2024-03-21 02:09:00,809: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:09:00.813091933Z [2024-03-21 02:09:00,812: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:09:00.813218727Z [2024-03-21 02:09:00,813: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:09:00.813285959Z [2024-03-21 02:09:00,813: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T02:09:00.813534054Z [2024-03-21 02:09:00,813: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:09:00.924390468Z [2024-03-21 02:09:00,924: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:09:01.516255660Z [2024-03-21 02:09:01,515: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a71d9789-7af9-4835-b70b-b73be63806e8] succeeded in 1.2724814969988074s: None
2024-03-21T02:09:01.801927090Z [2024-03-21 02:09:01,801: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:09:01.805718789Z [2024-03-21 02:09:01,805: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:09:01.826589815Z [2024-03-21 02:09:01,826: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:09:01.828198217Z [2024-03-21 02:09:01,827: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:09:01.828244529Z [2024-03-21 02:09:01,827: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:09:01.828513962Z [2024-03-21 02:09:01,828: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:09:01.828555972Z [2024-03-21 02:09:01,828: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:09:01.828979792Z [2024-03-21 02:09:01,828: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:09:01.828999224Z [2024-03-21 02:09:01,828: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:09:01.917858477Z [2024-03-21 02:09:01,917: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:09:01.921157839Z [2024-03-21 02:09:01,920: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:09:01.923266540Z [2024-03-21 02:09:01,923: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:09:01.938809345Z [2024-03-21 02:09:01,938: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:09:01.940077012Z [2024-03-21 02:09:01,939: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:09:01.940120513Z [2024-03-21 02:09:01,939: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:09:01.940301228Z [2024-03-21 02:09:01,940: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:09:01.940349445Z [2024-03-21 02:09:01,940: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:09:01.940812605Z [2024-03-21 02:09:01,940: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:09:01.941027726Z [2024-03-21 02:09:01,940: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:09:02.027732628Z [2024-03-21 02:09:02,027: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:09:03.697217745Z [2024-03-21 02:09:03,696: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ec8e9f8d-1a1b-4430-8c76-2b631868521f] succeeded in 3.473925706000955s: None
2024-03-21T02:09:04.261555076Z [2024-03-21 02:09:04,261: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f35862cb-f0cc-4479-b268-ab738ae13988] succeeded in 4.044058779998522s: None
2024-03-21T02:10:01.077062726Z [2024-03-21 02:10:01,076: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8089db3-2140-48ca-af28-7f586d5fb5cc] received
2024-03-21T02:10:01.080616561Z [2024-03-21 02:10:01,080: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf1a897f-bb54-4e74-9213-15b5e911400a] received
2024-03-21T02:10:01.086032603Z [2024-03-21 02:10:01,085: INFO/ForkPoolWorker-15] [d8089db3-2140-48ca-af28-7f586d5fb5cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:10:01.087093502Z [2024-03-21 02:10:01,086: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9cc53011-11ae-4e4d-a55d-08cf90799836] received
2024-03-21T02:10:01.088757256Z [2024-03-21 02:10:01,088: INFO/ForkPoolWorker-16] [bf1a897f-bb54-4e74-9213-15b5e911400a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:10:01.091491249Z [2024-03-21 02:10:01,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4adafc5d-caca-459b-a5be-0363dc6ffabf] received
2024-03-21T02:10:01.103094829Z [2024-03-21 02:10:01,102: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2f5d78d-4090-4be2-99d1-cf181293e12d] received
2024-03-21T02:10:01.107365243Z [2024-03-21 02:10:01,107: INFO/ForkPoolWorker-2] [4adafc5d-caca-459b-a5be-0363dc6ffabf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:10:01.112877188Z [2024-03-21 02:10:01,112: INFO/ForkPoolWorker-1] [9cc53011-11ae-4e4d-a55d-08cf90799836] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:10:01.116824304Z [2024-03-21 02:10:01,116: INFO/ForkPoolWorker-3] [a2f5d78d-4090-4be2-99d1-cf181293e12d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:10:01.494644264Z [2024-03-21 02:10:01,490: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:10:01.500464153Z [2024-03-21 02:10:01,492: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:10:01.564043272Z [2024-03-21 02:10:01,560: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:10:01.643036002Z [2024-03-21 02:10:01,639: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:10:01.803923130Z [2024-03-21 02:10:01,799: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:10:01.910651573Z [2024-03-21 02:10:01,910: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T02:10:01.937190272Z [2024-03-21 02:10:01,936: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:10:01.986185443Z [2024-03-21 02:10:01,985: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:10:01.990705931Z [2024-03-21 02:10:01,990: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:10:01.990768969Z [2024-03-21 02:10:01,990: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:10:01.990850348Z [2024-03-21 02:10:01,990: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T02:10:01.991374122Z [2024-03-21 02:10:01,991: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:10:02.015560143Z [2024-03-21 02:10:02,015: INFO/ForkPoolWorker-3] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:10:02.142310979Z [2024-03-21 02:10:02,141: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:10:02.964052647Z [2024-03-21 02:10:02,963: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[a2f5d78d-4090-4be2-99d1-cf181293e12d] succeeded in 1.8578968340007123s: None
2024-03-21T02:10:03.121020646Z [2024-03-21 02:10:03,120: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d8089db3-2140-48ca-af28-7f586d5fb5cc] succeeded in 2.0422281460014347s: None
2024-03-21T02:10:03.536083869Z [2024-03-21 02:10:03,535: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:10:03.540060598Z [2024-03-21 02:10:03,539: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:10:03.565158022Z [2024-03-21 02:10:03,564: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:10:03.567346442Z [2024-03-21 02:10:03,566: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:10:03.567653447Z [2024-03-21 02:10:03,567: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:10:03.568050420Z [2024-03-21 02:10:03,567: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:10:03.568279631Z [2024-03-21 02:10:03,568: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:10:03.569092112Z [2024-03-21 02:10:03,568: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:10:03.569377989Z [2024-03-21 02:10:03,569: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:10:03.677465172Z [2024-03-21 02:10:03,677: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T02:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:10:03.679392704Z [2024-03-21 02:10:03,679: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T02:10:03.683549980Z [2024-03-21 02:10:03,683: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:10:03.710091759Z [2024-03-21 02:10:03,709: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:10:03.711499036Z [2024-03-21 02:10:03,711: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:10:03.711688421Z [2024-03-21 02:10:03,711: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:10:03.711924756Z [2024-03-21 02:10:03,711: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:10:03.712097188Z [2024-03-21 02:10:03,711: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T02:10:03.712473250Z [2024-03-21 02:10:03,712: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:10:03.712701262Z [2024-03-21 02:10:03,712: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:10:03.838070986Z [2024-03-21 02:10:03,837: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:10:04.221297052Z [2024-03-21 02:10:04,220: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:10:04.233077623Z [2024-03-21 02:10:04,232: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:10:04.277749438Z [2024-03-21 02:10:04,277: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:10:04.279288800Z [2024-03-21 02:10:04,279: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:10:04.279302384Z [2024-03-21 02:10:04,279: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:10:04.279570518Z [2024-03-21 02:10:04,279: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:10:04.279648444Z [2024-03-21 02:10:04,279: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:10:04.280020436Z [2024-03-21 02:10:04,279: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:10:04.280100401Z [2024-03-21 02:10:04,279: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:10:04.387090387Z [2024-03-21 02:10:04,386: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bf1a897f-bb54-4e74-9213-15b5e911400a] succeeded in 3.3046204120000766s: None
2024-03-21T02:10:04.413967114Z [2024-03-21 02:10:04,413: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:10:05.372927867Z [2024-03-21 02:10:05,372: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2f82718-c5ef-4d01-b825-52286aad81f1] received
2024-03-21T02:10:05.381324353Z [2024-03-21 02:10:05,381: INFO/ForkPoolWorker-15] [a2f82718-c5ef-4d01-b825-52286aad81f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:10:05.423058657Z [2024-03-21 02:10:05,422: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4adafc5d-caca-459b-a5be-0363dc6ffabf] succeeded in 4.324449834000916s: None
2024-03-21T02:10:05.730986793Z [2024-03-21 02:10:05,727: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:10:06.543089920Z [2024-03-21 02:10:06,542: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9cc53011-11ae-4e4d-a55d-08cf90799836] succeeded in 5.453433484000925s: None
2024-03-21T02:10:07.017285687Z [2024-03-21 02:10:07,016: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:10:07.021403323Z [2024-03-21 02:10:07,020: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:10:07.046433053Z [2024-03-21 02:10:07,045: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:10:07.048494663Z [2024-03-21 02:10:07,048: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:10:07.048645746Z [2024-03-21 02:10:07,048: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:10:07.048855888Z [2024-03-21 02:10:07,048: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:10:07.048985018Z [2024-03-21 02:10:07,048: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:10:07.049310340Z [2024-03-21 02:10:07,049: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:10:07.049439553Z [2024-03-21 02:10:07,049: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:10:07.145187835Z [2024-03-21 02:10:07,144: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T02:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:10:07.972532065Z [2024-03-21 02:10:07,971: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a2f82718-c5ef-4d01-b825-52286aad81f1] succeeded in 2.5978787320000265s: None
2024-03-21T02:10:08.647822984Z [2024-03-21 02:10:08,647: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0babdb10-bd9b-4fed-b52d-88829373213b] received
2024-03-21T02:10:08.657177470Z [2024-03-21 02:10:08,656: INFO/ForkPoolWorker-15] [0babdb10-bd9b-4fed-b52d-88829373213b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T02:10:08.956362029Z [2024-03-21 02:10:08,953: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:10:10.157790989Z [2024-03-21 02:10:10,157: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:10:10.161093957Z [2024-03-21 02:10:10,160: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:10:10.191409306Z [2024-03-21 02:10:10,191: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:10:10.193125386Z [2024-03-21 02:10:10,192: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:10:10.193316606Z [2024-03-21 02:10:10,193: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:10:10.193468634Z [2024-03-21 02:10:10,193: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:10:10.193568153Z [2024-03-21 02:10:10,193: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:10:10.194023790Z [2024-03-21 02:10:10,193: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:10:10.194269939Z [2024-03-21 02:10:10,194: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:10:10.324276873Z [2024-03-21 02:10:10,323: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T02:05:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:10:10.957692329Z [2024-03-21 02:10:10,957: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0babdb10-bd9b-4fed-b52d-88829373213b] succeeded in 2.30752236599983s: None
2024-03-21T02:10:11.582747948Z [2024-03-21 02:10:11,582: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35eb9ace-a6ba-4181-a8e2-ac57e0ed0a65] received
2024-03-21T02:10:11.592177805Z [2024-03-21 02:10:11,591: INFO/ForkPoolWorker-15] [35eb9ace-a6ba-4181-a8e2-ac57e0ed0a65] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:10:11.870571884Z [2024-03-21 02:10:11,867: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:10:13.008654254Z [2024-03-21 02:10:13,008: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:10:13.011994976Z [2024-03-21 02:10:13,011: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:10:13.030490652Z [2024-03-21 02:10:13,030: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:10:13.031665360Z [2024-03-21 02:10:13,031: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:10:13.031678035Z [2024-03-21 02:10:13,031: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:10:13.031768342Z [2024-03-21 02:10:13,031: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:10:13.031777227Z [2024-03-21 02:10:13,031: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:10:13.032033649Z [2024-03-21 02:10:13,031: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:10:13.032042851Z [2024-03-21 02:10:13,031: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:10:13.146909310Z [2024-03-21 02:10:13,146: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T02:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:10:13.735635232Z [2024-03-21 02:10:13,735: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[35eb9ace-a6ba-4181-a8e2-ac57e0ed0a65] succeeded in 2.1495869739992486s: None
2024-03-21T02:11:00.321042346Z [2024-03-21 02:11:00,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2e95a17-5927-4e76-8717-b7cceee49249] received
2024-03-21T02:11:00.328946113Z [2024-03-21 02:11:00,328: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d0f0594-7fa6-4ebf-8b63-d606e4ba4ee6] received
2024-03-21T02:11:00.334139698Z [2024-03-21 02:11:00,333: INFO/ForkPoolWorker-15] [b2e95a17-5927-4e76-8717-b7cceee49249] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:11:00.339739142Z [2024-03-21 02:11:00,339: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5cf15c49-1ca4-4974-8db8-d77168eeaa67] received
2024-03-21T02:11:00.342103391Z [2024-03-21 02:11:00,341: INFO/ForkPoolWorker-16] [8d0f0594-7fa6-4ebf-8b63-d606e4ba4ee6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:11:00.347573750Z [2024-03-21 02:11:00,347: INFO/ForkPoolWorker-1] [5cf15c49-1ca4-4974-8db8-d77168eeaa67] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:11:00.620191060Z [2024-03-21 02:11:00,617: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:11:00.630342033Z [2024-03-21 02:11:00,627: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:11:00.707619051Z [2024-03-21 02:11:00,703: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:11:00.882545226Z [2024-03-21 02:11:00,882: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T02:11:00.886862407Z [2024-03-21 02:11:00,886: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:11:00.906023108Z [2024-03-21 02:11:00,905: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:11:00.907071412Z [2024-03-21 02:11:00,906: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:11:00.907183721Z [2024-03-21 02:11:00,906: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:11:00.907309976Z [2024-03-21 02:11:00,907: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T02:11:00.907560685Z [2024-03-21 02:11:00,907: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:11:01.025073136Z [2024-03-21 02:11:01,024: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:11:01.786723383Z [2024-03-21 02:11:01,786: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5cf15c49-1ca4-4974-8db8-d77168eeaa67] succeeded in 1.445080894000057s: None
2024-03-21T02:11:01.788737286Z [2024-03-21 02:11:01,788: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:11:01.789893386Z [2024-03-21 02:11:01,789: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:11:01.792278623Z [2024-03-21 02:11:01,791: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:11:01.793554007Z [2024-03-21 02:11:01,793: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:11:01.818775962Z [2024-03-21 02:11:01,818: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:11:01.822341773Z [2024-03-21 02:11:01,822: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:11:01.822415032Z [2024-03-21 02:11:01,822: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:11:01.822621010Z [2024-03-21 02:11:01,822: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:11:01.822665793Z [2024-03-21 02:11:01,822: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:11:01.822893852Z [2024-03-21 02:11:01,822: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:11:01.823032420Z [2024-03-21 02:11:01,822: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:11:01.826781868Z [2024-03-21 02:11:01,826: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:11:01.828097368Z [2024-03-21 02:11:01,827: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:11:01.828125314Z [2024-03-21 02:11:01,828: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:11:01.828264196Z [2024-03-21 02:11:01,828: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:11:01.828383946Z [2024-03-21 02:11:01,828: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:11:01.828601317Z [2024-03-21 02:11:01,828: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:11:01.829159996Z [2024-03-21 02:11:01,828: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:11:01.916640844Z [2024-03-21 02:11:01,916: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:11:01.945398485Z [2024-03-21 02:11:01,945: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:11:03.617897396Z [2024-03-21 02:11:03,617: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8d0f0594-7fa6-4ebf-8b63-d606e4ba4ee6] succeeded in 3.28683160699984s: None
2024-03-21T02:11:04.691752171Z [2024-03-21 02:11:04,691: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b2e95a17-5927-4e76-8717-b7cceee49249] succeeded in 4.367592087999583s: None
2024-03-21T02:12:00.918642554Z [2024-03-21 02:12:00,918: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d7487a6-d383-43fe-9c52-e5d7b26e4fa1] received
2024-03-21T02:12:00.919923663Z [2024-03-21 02:12:00,919: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a8afcc0c-680c-46da-b640-208268ed5a60] received
2024-03-21T02:12:00.922723117Z [2024-03-21 02:12:00,922: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77d9e6cb-8dc0-4f23-96ae-5bef82f45b00] received
2024-03-21T02:12:00.925679098Z [2024-03-21 02:12:00,925: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2006990c-08a6-426d-b4a8-738b477b2f64] received
2024-03-21T02:12:00.933627392Z [2024-03-21 02:12:00,933: INFO/ForkPoolWorker-16] [a8afcc0c-680c-46da-b640-208268ed5a60] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:12:00.936188133Z [2024-03-21 02:12:00,935: INFO/ForkPoolWorker-15] [4d7487a6-d383-43fe-9c52-e5d7b26e4fa1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:12:00.947081826Z [2024-03-21 02:12:00,946: INFO/ForkPoolWorker-1] [77d9e6cb-8dc0-4f23-96ae-5bef82f45b00] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:12:00.953336340Z [2024-03-21 02:12:00,952: INFO/ForkPoolWorker-2] [2006990c-08a6-426d-b4a8-738b477b2f64] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:12:01.270173670Z [2024-03-21 02:12:01,266: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:12:01.353363268Z [2024-03-21 02:12:01,350: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:12:01.378169334Z [2024-03-21 02:12:01,374: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:12:01.488240389Z [2024-03-21 02:12:01,485: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:12:01.521659210Z [2024-03-21 02:12:01,521: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T02:12:01.526564747Z [2024-03-21 02:12:01,526: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:12:01.573098091Z [2024-03-21 02:12:01,572: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:12:01.580134082Z [2024-03-21 02:12:01,579: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:12:01.581257419Z [2024-03-21 02:12:01,580: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:12:01.584933279Z [2024-03-21 02:12:01,584: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T02:12:01.585486493Z [2024-03-21 02:12:01,585: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:12:01.690028097Z [2024-03-21 02:12:01,689: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:12:01.796669398Z [2024-03-21 02:12:01,796: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:12:02.445104164Z [2024-03-21 02:12:02,444: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[77d9e6cb-8dc0-4f23-96ae-5bef82f45b00] succeeded in 1.5208200359993498s: None
2024-03-21T02:12:02.637344948Z [2024-03-21 02:12:02,636: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a8afcc0c-680c-46da-b640-208268ed5a60] succeeded in 1.7151672410000174s: None
2024-03-21T02:12:02.672563407Z [2024-03-21 02:12:02,672: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:12:02.675860485Z [2024-03-21 02:12:02,675: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:12:02.699263399Z [2024-03-21 02:12:02,699: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:12:02.700600224Z [2024-03-21 02:12:02,700: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:12:02.700734889Z [2024-03-21 02:12:02,700: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:12:02.700934147Z [2024-03-21 02:12:02,700: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:12:02.701009660Z [2024-03-21 02:12:02,700: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:12:02.701307227Z [2024-03-21 02:12:02,701: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:12:02.701390003Z [2024-03-21 02:12:02,701: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:12:02.804084595Z [2024-03-21 02:12:02,802: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:12:02.812332080Z [2024-03-21 02:12:02,811: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T02:12:02.815749072Z [2024-03-21 02:12:02,815: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:12:02.833471929Z [2024-03-21 02:12:02,833: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:12:02.834647260Z [2024-03-21 02:12:02,834: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:12:02.834664144Z [2024-03-21 02:12:02,834: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:12:02.834746186Z [2024-03-21 02:12:02,834: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:12:02.834758412Z [2024-03-21 02:12:02,834: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T02:12:02.835084726Z [2024-03-21 02:12:02,834: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:12:02.835182162Z [2024-03-21 02:12:02,834: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:12:02.918284489Z [2024-03-21 02:12:02,917: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:12:04.573531659Z [2024-03-21 02:12:04,572: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4d7487a6-d383-43fe-9c52-e5d7b26e4fa1] succeeded in 3.6521292880006513s: None
2024-03-21T02:12:04.915265241Z [2024-03-21 02:12:04,914: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2006990c-08a6-426d-b4a8-738b477b2f64] succeeded in 3.986829919000229s: None
2024-03-21T02:13:00.872713144Z [2024-03-21 02:13:00,872: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97b6d7ca-31e3-4e16-afe3-51b3ba457e77] received
2024-03-21T02:13:00.874541944Z [2024-03-21 02:13:00,874: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a597ebc3-8672-4ed7-b607-6b3e5769194b] received
2024-03-21T02:13:00.877674831Z [2024-03-21 02:13:00,877: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2edf468-80f4-4a37-8180-a8cc057bad24] received
2024-03-21T02:13:00.884661701Z [2024-03-21 02:13:00,884: INFO/ForkPoolWorker-15] [97b6d7ca-31e3-4e16-afe3-51b3ba457e77] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:13:00.886195271Z [2024-03-21 02:13:00,885: INFO/ForkPoolWorker-1] [a2edf468-80f4-4a37-8180-a8cc057bad24] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:13:00.886857883Z [2024-03-21 02:13:00,886: INFO/ForkPoolWorker-16] [a597ebc3-8672-4ed7-b607-6b3e5769194b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:13:01.191213163Z [2024-03-21 02:13:01,188: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:13:01.211119469Z [2024-03-21 02:13:01,208: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:13:01.294661371Z [2024-03-21 02:13:01,291: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:13:01.368386282Z [2024-03-21 02:13:01,367: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T02:13:01.372402125Z [2024-03-21 02:13:01,371: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:13:01.413365934Z [2024-03-21 02:13:01,413: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:13:01.414746018Z [2024-03-21 02:13:01,414: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:13:01.414932983Z [2024-03-21 02:13:01,414: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:13:01.415063666Z [2024-03-21 02:13:01,414: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T02:13:01.415373558Z [2024-03-21 02:13:01,415: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:13:01.565343715Z [2024-03-21 02:13:01,565: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:13:02.166221512Z [2024-03-21 02:13:02,165: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a597ebc3-8672-4ed7-b607-6b3e5769194b] succeeded in 1.2895577119998052s: None
2024-03-21T02:13:02.493773787Z [2024-03-21 02:13:02,493: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:13:02.498945490Z [2024-03-21 02:13:02,498: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:13:02.526822656Z [2024-03-21 02:13:02,526: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:13:02.528219254Z [2024-03-21 02:13:02,527: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:13:02.528405809Z [2024-03-21 02:13:02,528: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:13:02.528615562Z [2024-03-21 02:13:02,528: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:13:02.528829423Z [2024-03-21 02:13:02,528: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:13:02.529340085Z [2024-03-21 02:13:02,529: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:13:02.529536957Z [2024-03-21 02:13:02,529: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:13:02.604424766Z [2024-03-21 02:13:02,603: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:13:02.609186634Z [2024-03-21 02:13:02,608: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:13:02.635545350Z [2024-03-21 02:13:02,635: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:13:02.642964514Z [2024-03-21 02:13:02,642: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:13:02.646352271Z [2024-03-21 02:13:02,645: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:13:02.646383575Z [2024-03-21 02:13:02,646: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:13:02.646872450Z [2024-03-21 02:13:02,646: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:13:02.646964848Z [2024-03-21 02:13:02,646: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:13:02.650707297Z [2024-03-21 02:13:02,650: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:13:02.651590747Z [2024-03-21 02:13:02,650: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:13:02.765759929Z [2024-03-21 02:13:02,765: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:13:04.922685390Z [2024-03-21 02:13:04,921: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a2edf468-80f4-4a37-8180-a8cc057bad24] succeeded in 4.041624661000242s: None
2024-03-21T02:13:04.996586317Z [2024-03-21 02:13:04,996: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[97b6d7ca-31e3-4e16-afe3-51b3ba457e77] succeeded in 4.121443264000845s: None
2024-03-21T02:13:38.225414440Z [2024-03-21 02:13:38,225: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b54d09e-6fa1-432b-81fd-ca3205c5bfe2] received
2024-03-21T02:13:38.239470239Z [2024-03-21 02:13:38,239: INFO/ForkPoolWorker-15] [0b54d09e-6fa1-432b-81fd-ca3205c5bfe2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240321021337_286208', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py']
2024-03-21T02:13:38.540135298Z [2024-03-21 02:13:38,537: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py
2024-03-21T02:13:38.890536956Z [2024-03-21 02:13:38,890: INFO/ForkPoolWorker-15] Running <TaskInstance: vdu_down.main_task vdu_down_20240321021337_286208 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:13:39.517343503Z [2024-03-21 02:13:39,516: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0b54d09e-6fa1-432b-81fd-ca3205c5bfe2] succeeded in 1.2893272469991643s: None
2024-03-21T02:14:00.926111251Z [2024-03-21 02:14:00,924: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2be9cdcd-6e12-4845-8dec-26dcbfb0f1de] received
2024-03-21T02:14:00.932074740Z [2024-03-21 02:14:00,931: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[817f14ac-738c-41d4-9d5d-0e83f4b878c9] received
2024-03-21T02:14:00.936301002Z [2024-03-21 02:14:00,936: INFO/ForkPoolWorker-15] [2be9cdcd-6e12-4845-8dec-26dcbfb0f1de] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:14:00.940658938Z [2024-03-21 02:14:00,940: INFO/ForkPoolWorker-16] [817f14ac-738c-41d4-9d5d-0e83f4b878c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:14:00.941342138Z [2024-03-21 02:14:00,941: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53e56685-dcb4-4595-8455-26e73987ac62] received
2024-03-21T02:14:00.948520997Z [2024-03-21 02:14:00,948: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c48c7b6c-10bd-46e2-bd38-a92df98bbfab] received
2024-03-21T02:14:00.956164301Z [2024-03-21 02:14:00,955: INFO/ForkPoolWorker-1] [53e56685-dcb4-4595-8455-26e73987ac62] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:14:00.959866236Z [2024-03-21 02:14:00,959: INFO/ForkPoolWorker-2] [c48c7b6c-10bd-46e2-bd38-a92df98bbfab] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:14:01.258817146Z [2024-03-21 02:14:01,251: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:14:01.269054117Z [2024-03-21 02:14:01,263: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:14:01.273415813Z [2024-03-21 02:14:01,270: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:14:01.284041507Z [2024-03-21 02:14:01,280: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:14:01.439929620Z [2024-03-21 02:14:01,439: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T02:14:01.453101321Z [2024-03-21 02:14:01,452: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:14:01.511441446Z [2024-03-21 02:14:01,511: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:14:01.513017406Z [2024-03-21 02:14:01,512: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:14:01.513037830Z [2024-03-21 02:14:01,512: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:14:01.513096501Z [2024-03-21 02:14:01,513: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T02:14:01.513269418Z [2024-03-21 02:14:01,513: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:14:01.523107565Z [2024-03-21 02:14:01,522: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:14:01.611392614Z [2024-03-21 02:14:01,611: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:14:02.132575639Z [2024-03-21 02:14:02,132: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2be9cdcd-6e12-4845-8dec-26dcbfb0f1de] succeeded in 1.2039544780000142s: None
2024-03-21T02:14:02.189544093Z [2024-03-21 02:14:02,189: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c48c7b6c-10bd-46e2-bd38-a92df98bbfab] succeeded in 1.2383245309993072s: None
2024-03-21T02:14:02.626340019Z [2024-03-21 02:14:02,625: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:14:02.631940384Z [2024-03-21 02:14:02,631: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:14:02.659102985Z [2024-03-21 02:14:02,658: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:14:02.660849750Z [2024-03-21 02:14:02,660: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:14:02.660885788Z [2024-03-21 02:14:02,660: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:14:02.661054081Z [2024-03-21 02:14:02,660: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:14:02.661154372Z [2024-03-21 02:14:02,661: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:14:02.661444458Z [2024-03-21 02:14:02,661: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:14:02.661840535Z [2024-03-21 02:14:02,661: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:14:02.734433166Z [2024-03-21 02:14:02,734: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:14:02.738178538Z [2024-03-21 02:14:02,737: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:14:02.760748720Z [2024-03-21 02:14:02,760: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:14:02.762136212Z [2024-03-21 02:14:02,761: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:14:02.762143331Z [2024-03-21 02:14:02,762: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:14:02.762252622Z [2024-03-21 02:14:02,762: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:14:02.762258857Z [2024-03-21 02:14:02,762: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:14:02.762493183Z [2024-03-21 02:14:02,762: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:14:02.762498750Z [2024-03-21 02:14:02,762: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:14:02.784547874Z [2024-03-21 02:14:02,784: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:14:02.849647330Z [2024-03-21 02:14:02,849: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:14:05.358775046Z [2024-03-21 02:14:05,358: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[53e56685-dcb4-4595-8455-26e73987ac62] succeeded in 4.41577031000088s: None
2024-03-21T02:14:05.504490456Z [2024-03-21 02:14:05,503: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[817f14ac-738c-41d4-9d5d-0e83f4b878c9] succeeded in 4.568910038999093s: None
2024-03-21T02:15:00.664955657Z [2024-03-21 02:15:00,664: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41f50f3f-ce06-4f23-b6a5-f9ae9b9a1323] received
2024-03-21T02:15:00.671095171Z [2024-03-21 02:15:00,670: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bdb4dbea-e3ad-485d-90c6-b7f105265695] received
2024-03-21T02:15:00.673664008Z [2024-03-21 02:15:00,673: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dcf03641-9554-4d42-8183-d5f1f3583f73] received
2024-03-21T02:15:00.677521541Z [2024-03-21 02:15:00,677: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a15648b0-bc6d-4ab9-b7ac-3cc176835929] received
2024-03-21T02:15:00.684958211Z [2024-03-21 02:15:00,684: INFO/ForkPoolWorker-16] [bdb4dbea-e3ad-485d-90c6-b7f105265695] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:15:00.687047302Z [2024-03-21 02:15:00,686: INFO/ForkPoolWorker-15] [41f50f3f-ce06-4f23-b6a5-f9ae9b9a1323] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:15:00.694660776Z [2024-03-21 02:15:00,694: INFO/ForkPoolWorker-1] [dcf03641-9554-4d42-8183-d5f1f3583f73] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:15:00.708901224Z [2024-03-21 02:15:00,708: INFO/ForkPoolWorker-2] [a15648b0-bc6d-4ab9-b7ac-3cc176835929] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:15:01.055124452Z [2024-03-21 02:15:01,051: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:15:01.117876394Z [2024-03-21 02:15:01,113: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:15:01.175073925Z [2024-03-21 02:15:01,170: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:15:01.178930564Z [2024-03-21 02:15:01,174: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:15:01.398188376Z [2024-03-21 02:15:01,397: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T02:15:01.403150765Z [2024-03-21 02:15:01,402: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:15:01.449552169Z [2024-03-21 02:15:01,449: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:15:01.453471054Z [2024-03-21 02:15:01,453: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:15:01.453626235Z [2024-03-21 02:15:01,453: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:15:01.453795069Z [2024-03-21 02:15:01,453: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T02:15:01.454160817Z [2024-03-21 02:15:01,454: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:15:01.593804423Z [2024-03-21 02:15:01,593: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:15:02.899870734Z [2024-03-21 02:15:02,899: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a15648b0-bc6d-4ab9-b7ac-3cc176835929] succeeded in 2.2173307289995137s: None
2024-03-21T02:15:03.022164926Z [2024-03-21 02:15:03,021: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:15:03.027578869Z [2024-03-21 02:15:03,027: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:15:03.071195730Z [2024-03-21 02:15:03,070: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:15:03.073778696Z [2024-03-21 02:15:03,073: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:15:03.073800816Z [2024-03-21 02:15:03,073: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:15:03.073804959Z [2024-03-21 02:15:03,073: INFO/ForkPoolWorker-16] Read VIM e359c9f2-3d20-44f3-a1e8-ccbbb001c520 (basic01_624953)
2024-03-21T02:15:03.074165707Z [2024-03-21 02:15:03,073: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'name': 'basic01_624953', 'vim_type': 'openstack'}]
2024-03-21T02:15:03.074451330Z [2024-03-21 02:15:03,074: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:15:03.075342499Z [2024-03-21 02:15:03,075: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:15:03.075751094Z [2024-03-21 02:15:03,075: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:15:03.083456240Z [2024-03-21 02:15:03,083: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520
2024-03-21T02:15:03.201359682Z [2024-03-21 02:15:03,200: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:15:03.205161400Z [2024-03-21 02:15:03,204: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:15:03.257237666Z [2024-03-21 02:15:03,256: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:15:03.262274312Z [2024-03-21 02:15:03,261: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:15:03.271265054Z [2024-03-21 02:15:03,270: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:15:03.291221837Z [2024-03-21 02:15:03,290: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:15:03.293471347Z [2024-03-21 02:15:03,293: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:15:03.293573502Z [2024-03-21 02:15:03,293: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:15:03.293730637Z [2024-03-21 02:15:03,293: INFO/ForkPoolWorker-1] Read VIM e359c9f2-3d20-44f3-a1e8-ccbbb001c520 (basic01_624953)
2024-03-21T02:15:03.294136357Z [2024-03-21 02:15:03,293: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'name': 'basic01_624953', 'vim_type': 'openstack'}]
2024-03-21T02:15:03.294440613Z [2024-03-21 02:15:03,294: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:15:03.294811190Z [2024-03-21 02:15:03,294: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:15:03.294976128Z [2024-03-21 02:15:03,294: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:15:03.300211275Z [2024-03-21 02:15:03,298: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:15:03.302001329Z [2024-03-21 02:15:03,301: INFO/ForkPoolWorker-1] Creating DAG vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520
2024-03-21T02:15:03.324926740Z [2024-03-21 02:15:03,324: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:15:03.325105402Z [2024-03-21 02:15:03,324: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:15:03.325231300Z [2024-03-21 02:15:03,325: INFO/ForkPoolWorker-15] Read VIM e359c9f2-3d20-44f3-a1e8-ccbbb001c520 (basic01_624953)
2024-03-21T02:15:03.325419154Z [2024-03-21 02:15:03,325: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'name': 'basic01_624953', 'vim_type': 'openstack'}]
2024-03-21T02:15:03.325497840Z [2024-03-21 02:15:03,325: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:15:03.325837394Z [2024-03-21 02:15:03,325: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:15:03.325931958Z [2024-03-21 02:15:03,325: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:15:03.336495221Z [2024-03-21 02:15:03,336: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520
2024-03-21T02:15:03.440945259Z [2024-03-21 02:15:03,440: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:15:03.503508758Z [2024-03-21 02:15:03,502: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T02:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:15:04.964447042Z [2024-03-21 02:15:04,963: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[41f50f3f-ce06-4f23-b6a5-f9ae9b9a1323] succeeded in 4.294442610998885s: None
2024-03-21T02:15:05.826705847Z [2024-03-21 02:15:05,826: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33b2709b-7a80-44b1-9ae3-4dd1a9001bfe] received
2024-03-21T02:15:05.846205391Z [2024-03-21 02:15:05,845: INFO/ForkPoolWorker-15] [33b2709b-7a80-44b1-9ae3-4dd1a9001bfe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:15:05.943602555Z [2024-03-21 02:15:05,939: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bdb4dbea-e3ad-485d-90c6-b7f105265695] succeeded in 5.262950947999343s: None
2024-03-21T02:15:06.089450359Z [2024-03-21 02:15:06,088: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dcf03641-9554-4d42-8183-d5f1f3583f73] succeeded in 5.412130893999347s: None
2024-03-21T02:15:06.279437539Z [2024-03-21 02:15:06,275: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:15:07.706084765Z [2024-03-21 02:15:07,705: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:15:07.709834009Z [2024-03-21 02:15:07,709: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:15:07.730344253Z [2024-03-21 02:15:07,730: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:15:07.731875442Z [2024-03-21 02:15:07,731: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:15:07.731893258Z [2024-03-21 02:15:07,731: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:15:07.732001692Z [2024-03-21 02:15:07,731: INFO/ForkPoolWorker-15] Read VIM e359c9f2-3d20-44f3-a1e8-ccbbb001c520 (basic01_624953)
2024-03-21T02:15:07.732242047Z [2024-03-21 02:15:07,731: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'name': 'basic01_624953', 'vim_type': 'openstack'}]
2024-03-21T02:15:07.732392729Z [2024-03-21 02:15:07,732: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:15:07.732658003Z [2024-03-21 02:15:07,732: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:15:07.732704376Z [2024-03-21 02:15:07,732: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:15:07.739782343Z [2024-03-21 02:15:07,739: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520
2024-03-21T02:15:07.845957418Z [2024-03-21 02:15:07,845: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T02:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:15:08.557329470Z [2024-03-21 02:15:08,556: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[33b2709b-7a80-44b1-9ae3-4dd1a9001bfe] succeeded in 2.726267893000113s: None
2024-03-21T02:15:08.884809114Z [2024-03-21 02:15:08,884: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[622df95e-e39b-420f-b0ee-479897691e12] received
2024-03-21T02:15:08.893104490Z [2024-03-21 02:15:08,892: INFO/ForkPoolWorker-15] [622df95e-e39b-420f-b0ee-479897691e12] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T02:15:09.245121329Z [2024-03-21 02:15:09,241: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:15:10.751815610Z [2024-03-21 02:15:10,751: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:15:10.755334736Z [2024-03-21 02:15:10,754: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:15:10.792604292Z [2024-03-21 02:15:10,792: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:15:10.794890123Z [2024-03-21 02:15:10,794: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:15:10.794935256Z [2024-03-21 02:15:10,794: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:15:10.794995622Z [2024-03-21 02:15:10,794: INFO/ForkPoolWorker-15] Read VIM e359c9f2-3d20-44f3-a1e8-ccbbb001c520 (basic01_624953)
2024-03-21T02:15:10.795351520Z [2024-03-21 02:15:10,794: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'name': 'basic01_624953', 'vim_type': 'openstack'}]
2024-03-21T02:15:10.795373872Z [2024-03-21 02:15:10,795: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:15:10.795545890Z [2024-03-21 02:15:10,795: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:15:10.795563608Z [2024-03-21 02:15:10,795: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:15:10.802773781Z [2024-03-21 02:15:10,802: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520
2024-03-21T02:15:10.909706306Z [2024-03-21 02:15:10,909: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T02:10:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:15:11.554273322Z [2024-03-21 02:15:11,553: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[622df95e-e39b-420f-b0ee-479897691e12] succeeded in 2.6662308310005756s: None
2024-03-21T02:15:12.036468050Z [2024-03-21 02:15:12,035: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e57a135d-a450-4c3a-8225-30d8018698bc] received
2024-03-21T02:15:12.047451419Z [2024-03-21 02:15:12,046: INFO/ForkPoolWorker-15] [e57a135d-a450-4c3a-8225-30d8018698bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:15:12.356096941Z [2024-03-21 02:15:12,352: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:15:13.588185971Z [2024-03-21 02:15:13,587: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:15:13.591618603Z [2024-03-21 02:15:13,591: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:15:13.610347770Z [2024-03-21 02:15:13,610: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:15:13.611934176Z [2024-03-21 02:15:13,611: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:15:13.612082924Z [2024-03-21 02:15:13,611: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:15:13.612228372Z [2024-03-21 02:15:13,612: INFO/ForkPoolWorker-15] Read VIM e359c9f2-3d20-44f3-a1e8-ccbbb001c520 (basic01_624953)
2024-03-21T02:15:13.612646456Z [2024-03-21 02:15:13,612: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'name': 'basic01_624953', 'vim_type': 'openstack'}]
2024-03-21T02:15:13.612789725Z [2024-03-21 02:15:13,612: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:15:13.613093054Z [2024-03-21 02:15:13,612: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:15:13.613520639Z [2024-03-21 02:15:13,613: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:15:13.620830668Z [2024-03-21 02:15:13,620: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520
2024-03-21T02:15:13.710047359Z [2024-03-21 02:15:13,709: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T02:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:15:14.219962889Z [2024-03-21 02:15:14,219: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e57a135d-a450-4c3a-8225-30d8018698bc] succeeded in 2.1793352410004445s: None
2024-03-21T02:15:26.081646900Z [2024-03-21 02:15:26,081: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6813542-7de9-4e65-8b0a-0c191d6b32f5] received
2024-03-21T02:15:26.093259699Z [2024-03-21 02:15:26,092: INFO/ForkPoolWorker-15] [a6813542-7de9-4e65-8b0a-0c191d6b32f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:15:26.252457378Z [2024-03-21 02:15:26,252: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d112efe7-a219-4fc2-a262-75c2d7e6e531] received
2024-03-21T02:15:26.260074880Z [2024-03-21 02:15:26,259: INFO/ForkPoolWorker-16] [d112efe7-a219-4fc2-a262-75c2d7e6e531] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:15:26.407304550Z [2024-03-21 02:15:26,403: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:15:26.532032470Z [2024-03-21 02:15:26,528: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:15:27.508426976Z [2024-03-21 02:15:27,508: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:15:27.511865971Z [2024-03-21 02:15:27,511: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:15:27.534430762Z [2024-03-21 02:15:27,534: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:15:27.536023090Z [2024-03-21 02:15:27,535: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:15:27.536217011Z [2024-03-21 02:15:27,536: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:15:27.536357160Z [2024-03-21 02:15:27,536: INFO/ForkPoolWorker-15] Read VIM e359c9f2-3d20-44f3-a1e8-ccbbb001c520 (basic01_624953)
2024-03-21T02:15:27.536512021Z [2024-03-21 02:15:27,536: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'name': 'basic01_624953', 'vim_type': 'openstack'}]
2024-03-21T02:15:27.536651408Z [2024-03-21 02:15:27,536: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:15:27.536991513Z [2024-03-21 02:15:27,536: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:15:27.537415715Z [2024-03-21 02:15:27,537: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:15:27.541789485Z [2024-03-21 02:15:27,541: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520
2024-03-21T02:15:27.619413586Z [2024-03-21 02:15:27,619: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:15:27.622822840Z [2024-03-21 02:15:27,622: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:15:27.626471826Z [2024-03-21 02:15:27,626: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:15:27.649165163Z [2024-03-21 02:15:27,648: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:15:27.650989128Z [2024-03-21 02:15:27,650: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:15:27.651229095Z [2024-03-21 02:15:27,650: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:15:27.651470331Z [2024-03-21 02:15:27,651: INFO/ForkPoolWorker-16] Read VIM e359c9f2-3d20-44f3-a1e8-ccbbb001c520 (basic01_624953)
2024-03-21T02:15:27.651744566Z [2024-03-21 02:15:27,651: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'name': 'basic01_624953', 'vim_type': 'openstack'}]
2024-03-21T02:15:27.651901932Z [2024-03-21 02:15:27,651: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:15:27.652278257Z [2024-03-21 02:15:27,652: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:15:27.652488593Z [2024-03-21 02:15:27,652: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:15:27.657443624Z [2024-03-21 02:15:27,657: INFO/ForkPoolWorker-16] Creating DAG vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520
2024-03-21T02:15:27.741241368Z [2024-03-21 02:15:27,740: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:15:29.135017919Z [2024-03-21 02:15:29,134: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d112efe7-a219-4fc2-a262-75c2d7e6e531] succeeded in 2.880708365000828s: None
2024-03-21T02:15:29.515837832Z [2024-03-21 02:15:29,515: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a6813542-7de9-4e65-8b0a-0c191d6b32f5] succeeded in 3.430691179999485s: None
2024-03-21T02:15:31.163888620Z [2024-03-21 02:15:31,162: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5690925a-b273-4614-9cce-3f6cb0c1d2ac] received
2024-03-21T02:15:31.172376810Z [2024-03-21 02:15:31,172: INFO/ForkPoolWorker-15] [5690925a-b273-4614-9cce-3f6cb0c1d2ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:15:31.467102728Z [2024-03-21 02:15:31,463: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:15:32.779186852Z [2024-03-21 02:15:32,778: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:15:32.782664100Z [2024-03-21 02:15:32,782: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:15:32.806328876Z [2024-03-21 02:15:32,806: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:15:32.807983290Z [2024-03-21 02:15:32,807: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:15:32.808045535Z [2024-03-21 02:15:32,807: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:15:32.808166006Z [2024-03-21 02:15:32,808: INFO/ForkPoolWorker-15] Read VIM e359c9f2-3d20-44f3-a1e8-ccbbb001c520 (basic01_624953)
2024-03-21T02:15:32.808395525Z [2024-03-21 02:15:32,808: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'name': 'basic01_624953', 'vim_type': 'openstack'}]
2024-03-21T02:15:32.808496205Z [2024-03-21 02:15:32,808: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:15:32.808969085Z [2024-03-21 02:15:32,808: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:15:32.809657309Z [2024-03-21 02:15:32,808: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:15:32.817425575Z [2024-03-21 02:15:32,817: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520
2024-03-21T02:15:32.900030801Z [2024-03-21 02:15:32,899: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.extract_metrics_from_vnfrs scheduled__2024-03-21T02:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:15:33.497710887Z [2024-03-21 02:15:33,497: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[891f0c34-f516-4641-9b4d-3c9305f0f952] received
2024-03-21T02:15:33.507855630Z [2024-03-21 02:15:33,507: INFO/ForkPoolWorker-16] [891f0c34-f516-4641-9b4d-3c9305f0f952] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'split_metrics', 'scheduled__2024-03-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:15:33.512923214Z [2024-03-21 02:15:33,512: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5690925a-b273-4614-9cce-3f6cb0c1d2ac] succeeded in 2.3468745430000126s: None
2024-03-21T02:15:33.778537386Z [2024-03-21 02:15:33,775: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:15:34.851356815Z [2024-03-21 02:15:34,850: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:15:34.855101539Z [2024-03-21 02:15:34,854: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:15:34.872296708Z [2024-03-21 02:15:34,871: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:15:34.872820671Z [2024-03-21 02:15:34,872: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:15:34.872890598Z [2024-03-21 02:15:34,872: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:15:34.872943059Z [2024-03-21 02:15:34,872: INFO/ForkPoolWorker-16] Read VIM e359c9f2-3d20-44f3-a1e8-ccbbb001c520 (basic01_624953)
2024-03-21T02:15:34.873086349Z [2024-03-21 02:15:34,872: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'name': 'basic01_624953', 'vim_type': 'openstack'}]
2024-03-21T02:15:34.873105851Z [2024-03-21 02:15:34,873: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:15:34.873289926Z [2024-03-21 02:15:34,873: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:15:34.873329131Z [2024-03-21 02:15:34,873: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:15:34.879073115Z [2024-03-21 02:15:34,878: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520
2024-03-21T02:15:34.946563880Z [2024-03-21 02:15:34,946: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.split_metrics scheduled__2024-03-21T02:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:15:35.521869372Z [2024-03-21 02:15:35,521: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[891f0c34-f516-4641-9b4d-3c9305f0f952] succeeded in 2.019986544999483s: None
2024-03-21T02:15:36.196428004Z [2024-03-21 02:15:36,196: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0658ce0-0b14-49f1-b78a-927f54a2461b] received
2024-03-21T02:15:36.203763808Z [2024-03-21 02:15:36,203: INFO/ForkPoolWorker-15] [a0658ce0-0b14-49f1-b78a-927f54a2461b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'collect_metrics', 'scheduled__2024-03-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T02:15:36.479595883Z [2024-03-21 02:15:36,476: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:15:37.507657659Z [2024-03-21 02:15:37,507: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:15:37.511029732Z [2024-03-21 02:15:37,510: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:15:37.548844834Z [2024-03-21 02:15:37,548: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:15:37.550134435Z [2024-03-21 02:15:37,549: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:15:37.550151308Z [2024-03-21 02:15:37,550: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:15:37.550247382Z [2024-03-21 02:15:37,550: INFO/ForkPoolWorker-15] Read VIM e359c9f2-3d20-44f3-a1e8-ccbbb001c520 (basic01_624953)
2024-03-21T02:15:37.550391512Z [2024-03-21 02:15:37,550: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'name': 'basic01_624953', 'vim_type': 'openstack'}]
2024-03-21T02:15:37.550429530Z [2024-03-21 02:15:37,550: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:15:37.550692304Z [2024-03-21 02:15:37,550: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:15:37.550702596Z [2024-03-21 02:15:37,550: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:15:37.557405393Z [2024-03-21 02:15:37,557: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520
2024-03-21T02:15:37.619620805Z [2024-03-21 02:15:37,619: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.collect_metrics scheduled__2024-03-21T02:10:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:15:38.121102878Z [2024-03-21 02:15:38,120: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a0658ce0-0b14-49f1-b78a-927f54a2461b] succeeded in 1.9220466639999358s: None
2024-03-21T02:15:39.089417450Z [2024-03-21 02:15:39,088: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a36cf9f-6a58-43c2-a4b4-c8d3f6ff1bbd] received
2024-03-21T02:15:39.097043456Z [2024-03-21 02:15:39,096: INFO/ForkPoolWorker-15] [9a36cf9f-6a58-43c2-a4b4-c8d3f6ff1bbd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'send_prometheus', 'scheduled__2024-03-21T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:15:39.097518807Z [2024-03-21 02:15:39,097: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9458e29d-5905-42c8-81c6-f6bf84fa64f3] received
2024-03-21T02:15:39.108841758Z [2024-03-21 02:15:39,108: INFO/ForkPoolWorker-16] [9458e29d-5905-42c8-81c6-f6bf84fa64f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240321021537_636933', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py']
2024-03-21T02:15:39.407558234Z [2024-03-21 02:15:39,404: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:15:39.458887420Z [2024-03-21 02:15:39,455: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py
2024-03-21T02:15:39.785587267Z [2024-03-21 02:15:39,785: INFO/ForkPoolWorker-16] Running <TaskInstance: vdu_down.main_task vdu_down_20240321021537_636933 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:15:40.378433316Z [2024-03-21 02:15:40,378: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9458e29d-5905-42c8-81c6-f6bf84fa64f3] succeeded in 1.279327917000046s: None
2024-03-21T02:15:40.503241440Z [2024-03-21 02:15:40,502: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:15:40.506402025Z [2024-03-21 02:15:40,506: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:15:40.522917986Z [2024-03-21 02:15:40,522: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:15:40.524408121Z [2024-03-21 02:15:40,524: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:15:40.524429516Z [2024-03-21 02:15:40,524: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:15:40.524467582Z [2024-03-21 02:15:40,524: INFO/ForkPoolWorker-15] Read VIM e359c9f2-3d20-44f3-a1e8-ccbbb001c520 (basic01_624953)
2024-03-21T02:15:40.524610703Z [2024-03-21 02:15:40,524: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'name': 'basic01_624953', 'vim_type': 'openstack'}]
2024-03-21T02:15:40.524627481Z [2024-03-21 02:15:40,524: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:15:40.525282987Z [2024-03-21 02:15:40,525: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:15:40.525303288Z [2024-03-21 02:15:40,525: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:15:40.531074757Z [2024-03-21 02:15:40,530: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520
2024-03-21T02:15:40.600667650Z [2024-03-21 02:15:40,600: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520.send_prometheus scheduled__2024-03-21T02:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:15:41.183456874Z [2024-03-21 02:15:41,182: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9a36cf9f-6a58-43c2-a4b4-c8d3f6ff1bbd] succeeded in 2.092003271000067s: None
2024-03-21T02:16:00.721369752Z [2024-03-21 02:16:00,720: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f45ed5b0-e525-47ac-a370-2d6fb067d578] received
2024-03-21T02:16:00.726912919Z [2024-03-21 02:16:00,726: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f0c5dfc-c18f-4fb0-a98f-8372e329e05a] received
2024-03-21T02:16:00.729297649Z [2024-03-21 02:16:00,729: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d19da46-980a-4bfd-b06f-52be4e94a55f] received
2024-03-21T02:16:00.731208073Z [2024-03-21 02:16:00,731: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11cd36c5-006b-4a02-bd6c-90a406b07154] received
2024-03-21T02:16:00.731223532Z [2024-03-21 02:16:00,731: INFO/ForkPoolWorker-15] [f45ed5b0-e525-47ac-a370-2d6fb067d578] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:16:00.733022155Z [2024-03-21 02:16:00,732: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a919d50-a47e-45dd-8a39-ebee614d85e2] received
2024-03-21T02:16:00.736089209Z [2024-03-21 02:16:00,735: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63ddf681-35e7-4935-ba8b-928713004dd8] received
2024-03-21T02:16:00.739405373Z [2024-03-21 02:16:00,739: INFO/ForkPoolWorker-16] [0f0c5dfc-c18f-4fb0-a98f-8372e329e05a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:16:00.756236227Z [2024-03-21 02:16:00,755: INFO/ForkPoolWorker-4] [63ddf681-35e7-4935-ba8b-928713004dd8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:16:00.760599792Z [2024-03-21 02:16:00,760: INFO/ForkPoolWorker-1] [6d19da46-980a-4bfd-b06f-52be4e94a55f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:16:00.763055231Z [2024-03-21 02:16:00,762: INFO/ForkPoolWorker-2] [11cd36c5-006b-4a02-bd6c-90a406b07154] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:16:00.770288623Z [2024-03-21 02:16:00,769: INFO/ForkPoolWorker-3] [1a919d50-a47e-45dd-8a39-ebee614d85e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:16:01.136824865Z [2024-03-21 02:16:01,133: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:16:01.233300487Z [2024-03-21 02:16:01,229: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:16:01.402285889Z [2024-03-21 02:16:01,398: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:16:01.656124344Z [2024-03-21 02:16:01,655: INFO/ForkPoolWorker-4] Getting SDNC list
2024-03-21T02:16:01.660487208Z [2024-03-21 02:16:01,659: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:16:01.693367193Z [2024-03-21 02:16:01,687: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:16:01.706917204Z [2024-03-21 02:16:01,706: INFO/ForkPoolWorker-4] Connected to database osm version 1.2
2024-03-21T02:16:01.710512778Z [2024-03-21 02:16:01,710: INFO/ForkPoolWorker-4] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:16:01.710701328Z [2024-03-21 02:16:01,710: INFO/ForkPoolWorker-4] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:16:01.710916706Z [2024-03-21 02:16:01,710: INFO/ForkPoolWorker-4] Getting SDNC list OK
2024-03-21T02:16:01.713055109Z [2024-03-21 02:16:01,712: INFO/ForkPoolWorker-4] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:16:01.726705443Z [2024-03-21 02:16:01,718: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:16:01.830369670Z [2024-03-21 02:16:01,830: INFO/ForkPoolWorker-4] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:16:01.851654378Z [2024-03-21 02:16:01,851: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:16:01.926125341Z [2024-03-21 02:16:01,922: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:16:03.286285227Z [2024-03-21 02:16:03,285: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f45ed5b0-e525-47ac-a370-2d6fb067d578] succeeded in 2.5627232850001747s: None
2024-03-21T02:16:03.293418331Z [2024-03-21 02:16:03,293: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[63ddf681-35e7-4935-ba8b-928713004dd8] succeeded in 2.553123948000575s: None
2024-03-21T02:16:03.894948945Z [2024-03-21 02:16:03,894: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:16:03.899011359Z [2024-03-21 02:16:03,898: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:16:03.933325317Z [2024-03-21 02:16:03,933: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:16:03.936089028Z [2024-03-21 02:16:03,935: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:16:03.936388600Z [2024-03-21 02:16:03,936: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:16:03.936725776Z [2024-03-21 02:16:03,936: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:16:03.936972476Z [2024-03-21 02:16:03,936: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:16:03.937374326Z [2024-03-21 02:16:03,937: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:16:03.937693974Z [2024-03-21 02:16:03,937: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:16:03.945140367Z [2024-03-21 02:16:03,944: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:16:03.946828800Z [2024-03-21 02:16:03,945: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:16:03.948223478Z [2024-03-21 02:16:03,948: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:16:03.951227488Z [2024-03-21 02:16:03,950: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:16:03.979118711Z [2024-03-21 02:16:03,978: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:16:03.981894343Z [2024-03-21 02:16:03,981: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:16:03.982092638Z [2024-03-21 02:16:03,981: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:16:03.982301288Z [2024-03-21 02:16:03,982: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:16:03.982428180Z [2024-03-21 02:16:03,982: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:16:03.982810909Z [2024-03-21 02:16:03,982: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:16:03.982992723Z [2024-03-21 02:16:03,982: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:16:03.987011512Z [2024-03-21 02:16:03,986: ERROR/ForkPoolWorker-16] [0f0c5dfc-c18f-4fb0-a98f-8372e329e05a] Failed to execute task Dag 'vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520' could not be found; either it does not exist or it failed to parse..
2024-03-21T02:16:03.987029322Z Traceback (most recent call last):
2024-03-21T02:16:03.987033722Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-21T02:16:03.987037736Z     args.func(args)
2024-03-21T02:16:03.987041846Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-21T02:16:03.987045861Z     return func(*args, **kwargs)
2024-03-21T02:16:03.987049383Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-21T02:16:03.987052863Z     return f(*args, **kwargs)
2024-03-21T02:16:03.987055982Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-21T02:16:03.987058960Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-21T02:16:03.987062097Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-21T02:16:03.987065086Z     raise AirflowException(
2024-03-21T02:16:03.987069131Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520' could not be found; either it does not exist or it failed to parse.
2024-03-21T02:16:04.136997123Z [2024-03-21 02:16:04,131: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0f0c5dfc-c18f-4fb0-a98f-8372e329e05a] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0f0c5dfc-c18f-4fb0-a98f-8372e329e05a')
2024-03-21T02:16:04.137045626Z Traceback (most recent call last):
2024-03-21T02:16:04.137050258Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-21T02:16:04.137053572Z     R = retval = fun(*args, **kwargs)
2024-03-21T02:16:04.137056810Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-21T02:16:04.137059918Z     return self.run(*args, **kwargs)
2024-03-21T02:16:04.137064369Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-21T02:16:04.137074763Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-21T02:16:04.137078065Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-21T02:16:04.137082155Z     raise AirflowException(msg)
2024-03-21T02:16:04.137086737Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0f0c5dfc-c18f-4fb0-a98f-8372e329e05a
2024-03-21T02:16:04.137287607Z [2024-03-21 02:16:04,136: INFO/ForkPoolWorker-3] Getting VIM list
2024-03-21T02:16:04.140997575Z [2024-03-21 02:16:04,140: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:16:04.186843238Z [2024-03-21 02:16:04,186: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T02:16:04.191134288Z [2024-03-21 02:16:04,190: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:16:04.203500658Z [2024-03-21 02:16:04,203: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-21T02:16:04.207177362Z [2024-03-21 02:16:04,206: INFO/ForkPoolWorker-3] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:16:04.214350112Z [2024-03-21 02:16:04,214: INFO/ForkPoolWorker-3] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:16:04.215840595Z [2024-03-21 02:16:04,214: INFO/ForkPoolWorker-3] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:16:04.216795280Z [2024-03-21 02:16:04,216: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-03-21T02:16:04.217432233Z [2024-03-21 02:16:04,217: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:16:04.220303762Z [2024-03-21 02:16:04,220: INFO/ForkPoolWorker-3] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:16:04.241634044Z [2024-03-21 02:16:04,241: WARNING/ForkPoolWorker-3] Dag 'vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:16:04.254322619Z [2024-03-21 02:16:04,249: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:16:04.256942665Z [2024-03-21 02:16:04,256: INFO/ForkPoolWorker-3] Getting VIM list
2024-03-21T02:16:04.260464787Z [2024-03-21 02:16:04,260: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:16:04.272261656Z [2024-03-21 02:16:04,271: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:16:04.277334142Z [2024-03-21 02:16:04,276: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:16:04.277578262Z [2024-03-21 02:16:04,277: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:16:04.277821639Z [2024-03-21 02:16:04,277: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:16:04.277952011Z [2024-03-21 02:16:04,277: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T02:16:04.278302041Z [2024-03-21 02:16:04,278: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:16:04.278442589Z [2024-03-21 02:16:04,278: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:16:04.310952290Z [2024-03-21 02:16:04,310: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-21T02:16:04.317890685Z [2024-03-21 02:16:04,317: INFO/ForkPoolWorker-3] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:16:04.319505809Z [2024-03-21 02:16:04,317: INFO/ForkPoolWorker-3] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:16:04.321441852Z [2024-03-21 02:16:04,319: INFO/ForkPoolWorker-3] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:16:04.321567247Z [2024-03-21 02:16:04,321: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-03-21T02:16:04.321921764Z [2024-03-21 02:16:04,321: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:16:04.323536218Z [2024-03-21 02:16:04,323: INFO/ForkPoolWorker-3] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:16:04.331661596Z [2024-03-21 02:16:04,327: ERROR/ForkPoolWorker-3] [1a919d50-a47e-45dd-8a39-ebee614d85e2] Failed to execute task Dag 'vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520' could not be found; either it does not exist or it failed to parse..
2024-03-21T02:16:04.331699911Z Traceback (most recent call last):
2024-03-21T02:16:04.331704372Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-21T02:16:04.331708545Z     args.func(args)
2024-03-21T02:16:04.331712292Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-21T02:16:04.331715879Z     return func(*args, **kwargs)
2024-03-21T02:16:04.331718896Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-21T02:16:04.331722047Z     return f(*args, **kwargs)
2024-03-21T02:16:04.331725304Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-21T02:16:04.331728354Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-21T02:16:04.331731338Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-21T02:16:04.331734519Z     raise AirflowException(
2024-03-21T02:16:04.331753302Z airflow.exceptions.AirflowException: Dag 'vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520' could not be found; either it does not exist or it failed to parse.
2024-03-21T02:16:04.351225339Z [2024-03-21 02:16:04,350: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:16:04.357487199Z [2024-03-21 02:16:04,356: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:16:04.389223662Z [2024-03-21 02:16:04,388: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[1a919d50-a47e-45dd-8a39-ebee614d85e2] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1a919d50-a47e-45dd-8a39-ebee614d85e2')
2024-03-21T02:16:04.389251929Z Traceback (most recent call last):
2024-03-21T02:16:04.389256289Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-21T02:16:04.389259402Z     R = retval = fun(*args, **kwargs)
2024-03-21T02:16:04.389262608Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-21T02:16:04.389266098Z     return self.run(*args, **kwargs)
2024-03-21T02:16:04.389270033Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-21T02:16:04.389274179Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-21T02:16:04.389277630Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-21T02:16:04.389281877Z     raise AirflowException(msg)
2024-03-21T02:16:04.389286536Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1a919d50-a47e-45dd-8a39-ebee614d85e2
2024-03-21T02:16:04.420001977Z [2024-03-21 02:16:04,419: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:16:04.423397439Z [2024-03-21 02:16:04,423: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:16:04.424244951Z [2024-03-21 02:16:04,423: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:16:04.424550304Z [2024-03-21 02:16:04,424: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:16:04.424761771Z [2024-03-21 02:16:04,424: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:16:04.425185804Z [2024-03-21 02:16:04,425: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:16:04.425345823Z [2024-03-21 02:16:04,425: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:16:04.440224015Z [2024-03-21 02:16:04,439: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:16:04.549684656Z [2024-03-21 02:16:04,549: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:16:08.419110230Z [2024-03-21 02:16:08,418: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[11cd36c5-006b-4a02-bd6c-90a406b07154] succeeded in 7.686046806000377s: None
2024-03-21T02:16:09.305787870Z [2024-03-21 02:16:09,305: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6d19da46-980a-4bfd-b06f-52be4e94a55f] succeeded in 8.573053194999375s: None
2024-03-21T02:16:14.946336164Z [2024-03-21 02:16:14,946: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7115796e-10e5-4122-8118-4c0c2d7a656d] received
2024-03-21T02:16:14.959049680Z [2024-03-21 02:16:14,958: INFO/ForkPoolWorker-15] [7115796e-10e5-4122-8118-4c0c2d7a656d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:16:15.058245152Z [2024-03-21 02:16:15,057: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48c5bab4-a3ae-42d7-83c6-ca0af123d69f] received
2024-03-21T02:16:15.067552070Z [2024-03-21 02:16:15,067: INFO/ForkPoolWorker-16] [48c5bab4-a3ae-42d7-83c6-ca0af123d69f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:16:15.248160380Z [2024-03-21 02:16:15,245: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:16:15.348046148Z [2024-03-21 02:16:15,345: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:16:16.355091023Z [2024-03-21 02:16:16,354: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:16:16.358590270Z [2024-03-21 02:16:16,358: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:16:16.378787231Z [2024-03-21 02:16:16,378: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:16:16.380216959Z [2024-03-21 02:16:16,379: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:16:16.380372920Z [2024-03-21 02:16:16,380: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:16:16.380623572Z [2024-03-21 02:16:16,380: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:16:16.380842491Z [2024-03-21 02:16:16,380: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:16:16.381346525Z [2024-03-21 02:16:16,381: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:16:16.381535166Z [2024-03-21 02:16:16,381: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:16:16.388090999Z [2024-03-21 02:16:16,387: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:16:16.388844487Z [2024-03-21 02:16:16,388: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:16:16.389633372Z [2024-03-21 02:16:16,389: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:16:16.392237247Z [2024-03-21 02:16:16,392: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:16:16.405680500Z [2024-03-21 02:16:16,405: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:16:16.407467018Z [2024-03-21 02:16:16,407: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:16:16.407668417Z [2024-03-21 02:16:16,407: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:16:16.407929650Z [2024-03-21 02:16:16,407: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:16:16.408128546Z [2024-03-21 02:16:16,407: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:16:16.408734981Z [2024-03-21 02:16:16,408: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:16:16.409072541Z [2024-03-21 02:16:16,408: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:16:16.416810104Z [2024-03-21 02:16:16,415: ERROR/ForkPoolWorker-15] [7115796e-10e5-4122-8118-4c0c2d7a656d] Failed to execute task Dag 'vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520' could not be found; either it does not exist or it failed to parse..
2024-03-21T02:16:16.416835810Z Traceback (most recent call last):
2024-03-21T02:16:16.416843002Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-21T02:16:16.416849990Z     args.func(args)
2024-03-21T02:16:16.416857980Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-21T02:16:16.416863956Z     return func(*args, **kwargs)
2024-03-21T02:16:16.416869254Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-21T02:16:16.416875014Z     return f(*args, **kwargs)
2024-03-21T02:16:16.416880461Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-21T02:16:16.416885865Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-21T02:16:16.416890855Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-21T02:16:16.416894803Z     raise AirflowException(
2024-03-21T02:16:16.416899861Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520' could not be found; either it does not exist or it failed to parse.
2024-03-21T02:16:16.439014354Z [2024-03-21 02:16:16,438: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:16:16.450221680Z [2024-03-21 02:16:16,449: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7115796e-10e5-4122-8118-4c0c2d7a656d] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7115796e-10e5-4122-8118-4c0c2d7a656d')
2024-03-21T02:16:16.450248428Z Traceback (most recent call last):
2024-03-21T02:16:16.450255757Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-21T02:16:16.450262282Z     R = retval = fun(*args, **kwargs)
2024-03-21T02:16:16.450268296Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-21T02:16:16.450290537Z     return self.run(*args, **kwargs)
2024-03-21T02:16:16.450297348Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-21T02:16:16.450304016Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-21T02:16:16.450309920Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-21T02:16:16.450316431Z     raise AirflowException(msg)
2024-03-21T02:16:16.450323271Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7115796e-10e5-4122-8118-4c0c2d7a656d
2024-03-21T02:16:16.450863094Z [2024-03-21 02:16:16,448: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:16:16.474589141Z [2024-03-21 02:16:16,474: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:16:16.476856884Z [2024-03-21 02:16:16,476: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:16:16.477198190Z [2024-03-21 02:16:16,476: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:16:16.477541903Z [2024-03-21 02:16:16,477: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:16:16.477691975Z [2024-03-21 02:16:16,477: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:16:16.478166696Z [2024-03-21 02:16:16,477: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:16:16.478386798Z [2024-03-21 02:16:16,478: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:16:16.489904181Z [2024-03-21 02:16:16,489: WARNING/ForkPoolWorker-16] Dag 'vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:16:16.490640638Z [2024-03-21 02:16:16,490: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:16:16.491678116Z [2024-03-21 02:16:16,491: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:16:16.495750794Z [2024-03-21 02:16:16,495: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:16:16.519154943Z [2024-03-21 02:16:16,518: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:16:16.520684643Z [2024-03-21 02:16:16,520: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:16:16.520730325Z [2024-03-21 02:16:16,520: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:16:16.520791452Z [2024-03-21 02:16:16,520: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:16:16.520965187Z [2024-03-21 02:16:16,520: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:16:16.521139450Z [2024-03-21 02:16:16,521: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:16:16.521165430Z [2024-03-21 02:16:16,521: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:16:16.524852755Z [2024-03-21 02:16:16,524: ERROR/ForkPoolWorker-16] [48c5bab4-a3ae-42d7-83c6-ca0af123d69f] Failed to execute task Dag 'vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520' could not be found; either it does not exist or it failed to parse..
2024-03-21T02:16:16.524885482Z Traceback (most recent call last):
2024-03-21T02:16:16.524894630Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-21T02:16:16.524903224Z     args.func(args)
2024-03-21T02:16:16.524912110Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-21T02:16:16.524931780Z     return func(*args, **kwargs)
2024-03-21T02:16:16.524939443Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-21T02:16:16.524946699Z     return f(*args, **kwargs)
2024-03-21T02:16:16.524953899Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-21T02:16:16.524991175Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-21T02:16:16.524999626Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-21T02:16:16.525007462Z     raise AirflowException(
2024-03-21T02:16:16.525017593Z airflow.exceptions.AirflowException: Dag 'vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520' could not be found; either it does not exist or it failed to parse.
2024-03-21T02:16:16.560480063Z [2024-03-21 02:16:16,559: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[48c5bab4-a3ae-42d7-83c6-ca0af123d69f] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 48c5bab4-a3ae-42d7-83c6-ca0af123d69f')
2024-03-21T02:16:16.560540124Z Traceback (most recent call last):
2024-03-21T02:16:16.560545201Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-21T02:16:16.560548906Z     R = retval = fun(*args, **kwargs)
2024-03-21T02:16:16.560552579Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-21T02:16:16.560556686Z     return self.run(*args, **kwargs)
2024-03-21T02:16:16.560560704Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-21T02:16:16.560564811Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-21T02:16:16.560568310Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-21T02:16:16.560572698Z     raise AirflowException(msg)
2024-03-21T02:16:16.560576827Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 48c5bab4-a3ae-42d7-83c6-ca0af123d69f
2024-03-21T02:17:00.692215027Z [2024-03-21 02:17:00,691: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ada309e8-197b-48c0-87d6-f1830d8e4a8c] received
2024-03-21T02:17:00.695158419Z [2024-03-21 02:17:00,694: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1b63eb0-2757-45a9-95db-ea1ac67df992] received
2024-03-21T02:17:00.697097631Z [2024-03-21 02:17:00,696: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3fbe0593-7bfa-4fc4-884c-4b006638c7c2] received
2024-03-21T02:17:00.698742776Z [2024-03-21 02:17:00,698: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec14b987-a9ab-410a-bf3f-a73147124965] received
2024-03-21T02:17:00.699984122Z [2024-03-21 02:17:00,699: INFO/ForkPoolWorker-15] [ada309e8-197b-48c0-87d6-f1830d8e4a8c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:17:00.700186613Z [2024-03-21 02:17:00,700: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cce5ac76-4080-4068-ac79-96c28fe3969d] received
2024-03-21T02:17:00.708481399Z [2024-03-21 02:17:00,708: INFO/ForkPoolWorker-1] [3fbe0593-7bfa-4fc4-884c-4b006638c7c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:17:00.709420367Z [2024-03-21 02:17:00,708: INFO/ForkPoolWorker-2] [ec14b987-a9ab-410a-bf3f-a73147124965] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:17:00.710009171Z [2024-03-21 02:17:00,709: INFO/ForkPoolWorker-16] [d1b63eb0-2757-45a9-95db-ea1ac67df992] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:17:00.711581859Z [2024-03-21 02:17:00,711: INFO/ForkPoolWorker-3] [cce5ac76-4080-4068-ac79-96c28fe3969d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:17:01.123325725Z [2024-03-21 02:17:01,119: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:17:01.163746623Z [2024-03-21 02:17:01,160: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:17:01.190862774Z [2024-03-21 02:17:01,186: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:17:01.203408395Z [2024-03-21 02:17:01,199: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:17:01.292642094Z [2024-03-21 02:17:01,281: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:17:01.352072710Z [2024-03-21 02:17:01,351: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T02:17:01.356140485Z [2024-03-21 02:17:01,355: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:17:01.408279274Z [2024-03-21 02:17:01,407: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:17:01.410084066Z [2024-03-21 02:17:01,409: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:17:01.410300815Z [2024-03-21 02:17:01,410: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:17:01.410380934Z [2024-03-21 02:17:01,410: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T02:17:01.410710035Z [2024-03-21 02:17:01,410: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:17:01.542646153Z [2024-03-21 02:17:01,542: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:17:02.357932375Z [2024-03-21 02:17:02,357: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ada309e8-197b-48c0-87d6-f1830d8e4a8c] succeeded in 1.662716499000453s: None
2024-03-21T02:17:03.076159660Z [2024-03-21 02:17:03,075: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T02:17:03.085872889Z [2024-03-21 02:17:03,085: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:17:03.152137212Z [2024-03-21 02:17:03,151: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:17:03.154326677Z [2024-03-21 02:17:03,154: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:17:03.154413118Z [2024-03-21 02:17:03,154: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:17:03.154787994Z [2024-03-21 02:17:03,154: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:17:03.154872176Z [2024-03-21 02:17:03,154: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T02:17:03.155300725Z [2024-03-21 02:17:03,155: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:17:03.155568756Z [2024-03-21 02:17:03,155: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:17:03.235136333Z [2024-03-21 02:17:03,234: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:17:03.238868700Z [2024-03-21 02:17:03,238: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:17:03.271838758Z [2024-03-21 02:17:03,270: INFO/ForkPoolWorker-3] Getting VIM list
2024-03-21T02:17:03.281545483Z [2024-03-21 02:17:03,281: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:17:03.282828621Z [2024-03-21 02:17:03,282: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:17:03.285715959Z [2024-03-21 02:17:03,285: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:17:03.288056143Z [2024-03-21 02:17:03,285: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:17:03.288063164Z [2024-03-21 02:17:03,287: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:17:03.288100381Z [2024-03-21 02:17:03,287: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:17:03.288104178Z [2024-03-21 02:17:03,287: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:17:03.288107757Z [2024-03-21 02:17:03,287: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:17:03.297625764Z [2024-03-21 02:17:03,296: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:17:03.303089277Z [2024-03-21 02:17:03,301: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:17:03.303122753Z [2024-03-21 02:17:03,302: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:17:03.304593905Z [2024-03-21 02:17:03,304: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:17:03.318572384Z [2024-03-21 02:17:03,317: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:17:03.362225095Z [2024-03-21 02:17:03,361: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-21T02:17:03.380453451Z [2024-03-21 02:17:03,377: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:17:03.380493226Z [2024-03-21 02:17:03,379: INFO/ForkPoolWorker-3] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:17:03.380499248Z [2024-03-21 02:17:03,379: INFO/ForkPoolWorker-3] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:17:03.380505655Z [2024-03-21 02:17:03,379: INFO/ForkPoolWorker-3] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:17:03.380512481Z [2024-03-21 02:17:03,379: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-03-21T02:17:03.380517409Z [2024-03-21 02:17:03,379: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:17:03.380521907Z [2024-03-21 02:17:03,380: INFO/ForkPoolWorker-3] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:17:03.387600724Z [2024-03-21 02:17:03,387: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:17:03.387871813Z [2024-03-21 02:17:03,387: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:17:03.388074742Z [2024-03-21 02:17:03,387: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:17:03.388206254Z [2024-03-21 02:17:03,388: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:17:03.388830449Z [2024-03-21 02:17:03,388: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:17:03.388844035Z [2024-03-21 02:17:03,388: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:17:03.396382933Z [2024-03-21 02:17:03,395: ERROR/ForkPoolWorker-16] [d1b63eb0-2757-45a9-95db-ea1ac67df992] Failed to execute task Dag 'vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520' could not be found; either it does not exist or it failed to parse..
2024-03-21T02:17:03.396416527Z Traceback (most recent call last):
2024-03-21T02:17:03.396421264Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-21T02:17:03.396425627Z     args.func(args)
2024-03-21T02:17:03.396429698Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-21T02:17:03.396433623Z     return func(*args, **kwargs)
2024-03-21T02:17:03.396437345Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-21T02:17:03.396440660Z     return f(*args, **kwargs)
2024-03-21T02:17:03.396444079Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-21T02:17:03.396447484Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-21T02:17:03.396450714Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-21T02:17:03.396453894Z     raise AirflowException(
2024-03-21T02:17:03.396458139Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520' could not be found; either it does not exist or it failed to parse.
2024-03-21T02:17:03.444130907Z [2024-03-21 02:17:03,443: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d1b63eb0-2757-45a9-95db-ea1ac67df992] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d1b63eb0-2757-45a9-95db-ea1ac67df992')
2024-03-21T02:17:03.444154072Z Traceback (most recent call last):
2024-03-21T02:17:03.444159409Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-21T02:17:03.444163380Z     R = retval = fun(*args, **kwargs)
2024-03-21T02:17:03.444167297Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-21T02:17:03.444171225Z     return self.run(*args, **kwargs)
2024-03-21T02:17:03.444176329Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-21T02:17:03.444180767Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-21T02:17:03.444184747Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-21T02:17:03.444189328Z     raise AirflowException(msg)
2024-03-21T02:17:03.444194064Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d1b63eb0-2757-45a9-95db-ea1ac67df992
2024-03-21T02:17:03.504904558Z [2024-03-21 02:17:03,504: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:17:03.508344548Z [2024-03-21 02:17:03,507: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:17:03.508373204Z [2024-03-21 02:17:03,508: INFO/ForkPoolWorker-3] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:17:03.536714947Z [2024-03-21 02:17:03,536: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:17:03.537976593Z [2024-03-21 02:17:03,537: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:17:03.537988453Z [2024-03-21 02:17:03,537: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:17:03.538095313Z [2024-03-21 02:17:03,537: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:17:03.538122669Z [2024-03-21 02:17:03,538: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:17:03.538340054Z [2024-03-21 02:17:03,538: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:17:03.538365755Z [2024-03-21 02:17:03,538: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:17:03.546591914Z [2024-03-21 02:17:03,546: WARNING/ForkPoolWorker-1] Dag 'vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:17:03.547384071Z [2024-03-21 02:17:03,546: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:17:03.548184148Z [2024-03-21 02:17:03,548: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:17:03.556344831Z [2024-03-21 02:17:03,555: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:17:03.576586398Z [2024-03-21 02:17:03,576: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:17:03.579816822Z [2024-03-21 02:17:03,579: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:17:03.580052106Z [2024-03-21 02:17:03,579: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:17:03.580445271Z [2024-03-21 02:17:03,580: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:17:03.580685630Z [2024-03-21 02:17:03,580: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:17:03.581146980Z [2024-03-21 02:17:03,580: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:17:03.581413771Z [2024-03-21 02:17:03,581: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:17:03.589050162Z [2024-03-21 02:17:03,588: ERROR/ForkPoolWorker-1] [3fbe0593-7bfa-4fc4-884c-4b006638c7c2] Failed to execute task Dag 'vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520' could not be found; either it does not exist or it failed to parse..
2024-03-21T02:17:03.589072877Z Traceback (most recent call last):
2024-03-21T02:17:03.589077210Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-21T02:17:03.589081551Z     args.func(args)
2024-03-21T02:17:03.589085858Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-21T02:17:03.589089660Z     return func(*args, **kwargs)
2024-03-21T02:17:03.589093071Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-21T02:17:03.589096307Z     return f(*args, **kwargs)
2024-03-21T02:17:03.589115016Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-21T02:17:03.589118308Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-21T02:17:03.589121697Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-21T02:17:03.589124862Z     raise AirflowException(
2024-03-21T02:17:03.589129432Z airflow.exceptions.AirflowException: Dag 'vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520' could not be found; either it does not exist or it failed to parse.
2024-03-21T02:17:03.625003518Z [2024-03-21 02:17:03,624: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3fbe0593-7bfa-4fc4-884c-4b006638c7c2] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 3fbe0593-7bfa-4fc4-884c-4b006638c7c2')
2024-03-21T02:17:03.625025699Z Traceback (most recent call last):
2024-03-21T02:17:03.625030248Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-21T02:17:03.625033463Z     R = retval = fun(*args, **kwargs)
2024-03-21T02:17:03.625036808Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-21T02:17:03.625040238Z     return self.run(*args, **kwargs)
2024-03-21T02:17:03.625044156Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-21T02:17:03.625048623Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-21T02:17:03.625051792Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-21T02:17:03.625056136Z     raise AirflowException(msg)
2024-03-21T02:17:03.625060211Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 3fbe0593-7bfa-4fc4-884c-4b006638c7c2
2024-03-21T02:17:04.951418801Z [2024-03-21 02:17:04,950: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[cce5ac76-4080-4068-ac79-96c28fe3969d] succeeded in 4.249623529998644s: None
2024-03-21T02:17:05.324571590Z [2024-03-21 02:17:05,324: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ec14b987-a9ab-410a-bf3f-a73147124965] succeeded in 4.623332898001536s: None
2024-03-21T02:17:14.872828691Z [2024-03-21 02:17:14,870: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[660a659c-04d9-46b7-9589-b5f8f79c9f85] received
2024-03-21T02:17:14.872874799Z [2024-03-21 02:17:14,871: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ac4c7e6-703b-4df5-9963-c2bfd0488d65] received
2024-03-21T02:17:14.885787653Z [2024-03-21 02:17:14,881: INFO/ForkPoolWorker-15] [660a659c-04d9-46b7-9589-b5f8f79c9f85] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:17:14.885954805Z [2024-03-21 02:17:14,884: INFO/ForkPoolWorker-16] [6ac4c7e6-703b-4df5-9963-c2bfd0488d65] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:17:15.173601330Z [2024-03-21 02:17:15,170: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:17:15.211102280Z [2024-03-21 02:17:15,208: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:17:16.296050063Z [2024-03-21 02:17:16,295: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:17:16.299281721Z [2024-03-21 02:17:16,298: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:17:16.321270384Z [2024-03-21 02:17:16,320: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:17:16.322256975Z [2024-03-21 02:17:16,322: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:17:16.323861426Z [2024-03-21 02:17:16,323: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:17:16.323908491Z [2024-03-21 02:17:16,323: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:17:16.324119037Z [2024-03-21 02:17:16,323: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:17:16.324270896Z [2024-03-21 02:17:16,324: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:17:16.324917428Z [2024-03-21 02:17:16,324: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:17:16.324951521Z [2024-03-21 02:17:16,324: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:17:16.324978106Z [2024-03-21 02:17:16,324: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:17:16.332630473Z [2024-03-21 02:17:16,332: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:17:16.333663457Z [2024-03-21 02:17:16,332: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:17:16.334644419Z [2024-03-21 02:17:16,334: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:17:16.337895162Z [2024-03-21 02:17:16,337: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:17:16.346954241Z [2024-03-21 02:17:16,346: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:17:16.348263666Z [2024-03-21 02:17:16,348: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:17:16.348304924Z [2024-03-21 02:17:16,348: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:17:16.348632265Z [2024-03-21 02:17:16,348: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:17:16.348677937Z [2024-03-21 02:17:16,348: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:17:16.348952148Z [2024-03-21 02:17:16,348: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:17:16.348983371Z [2024-03-21 02:17:16,348: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:17:16.352661859Z [2024-03-21 02:17:16,352: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:17:16.353993957Z [2024-03-21 02:17:16,353: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:17:16.354187451Z [2024-03-21 02:17:16,354: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:17:16.354492784Z [2024-03-21 02:17:16,354: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:17:16.354717138Z [2024-03-21 02:17:16,354: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:17:16.355232367Z [2024-03-21 02:17:16,354: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:17:16.355525778Z [2024-03-21 02:17:16,355: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:17:16.357061690Z [2024-03-21 02:17:16,356: WARNING/ForkPoolWorker-16] Dag 'vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:17:16.357972713Z [2024-03-21 02:17:16,357: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:17:16.358791943Z [2024-03-21 02:17:16,358: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:17:16.359976460Z [2024-03-21 02:17:16,359: ERROR/ForkPoolWorker-15] [660a659c-04d9-46b7-9589-b5f8f79c9f85] Failed to execute task Dag 'vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520' could not be found; either it does not exist or it failed to parse..
2024-03-21T02:17:16.359989635Z Traceback (most recent call last):
2024-03-21T02:17:16.359994076Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-21T02:17:16.359998223Z     args.func(args)
2024-03-21T02:17:16.360001989Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-21T02:17:16.360007161Z     return func(*args, **kwargs)
2024-03-21T02:17:16.360010225Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-21T02:17:16.360013423Z     return f(*args, **kwargs)
2024-03-21T02:17:16.360016504Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-21T02:17:16.360019620Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-21T02:17:16.360022976Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-21T02:17:16.360026108Z     raise AirflowException(
2024-03-21T02:17:16.360029598Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_e359c9f2-3d20-44f3-a1e8-ccbbb001c520' could not be found; either it does not exist or it failed to parse.
2024-03-21T02:17:16.361903321Z [2024-03-21 02:17:16,361: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:17:16.377308487Z [2024-03-21 02:17:16,377: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:17:16.378678601Z [2024-03-21 02:17:16,378: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:17:16.378700540Z [2024-03-21 02:17:16,378: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:17:16.378854746Z [2024-03-21 02:17:16,378: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:17:16.378872620Z [2024-03-21 02:17:16,378: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:17:16.379197685Z [2024-03-21 02:17:16,379: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:17:16.379339314Z [2024-03-21 02:17:16,379: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:17:16.383541996Z [2024-03-21 02:17:16,382: ERROR/ForkPoolWorker-16] [6ac4c7e6-703b-4df5-9963-c2bfd0488d65] Failed to execute task Dag 'vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520' could not be found; either it does not exist or it failed to parse..
2024-03-21T02:17:16.383561368Z Traceback (most recent call last):
2024-03-21T02:17:16.383567042Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-03-21T02:17:16.383571517Z     args.func(args)
2024-03-21T02:17:16.383576309Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-03-21T02:17:16.383581775Z     return func(*args, **kwargs)
2024-03-21T02:17:16.383585804Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-03-21T02:17:16.383589709Z     return f(*args, **kwargs)
2024-03-21T02:17:16.383593289Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-03-21T02:17:16.383596840Z     dag = get_dag(args.subdir, args.dag_id)
2024-03-21T02:17:16.383600404Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-03-21T02:17:16.383603922Z     raise AirflowException(
2024-03-21T02:17:16.383611664Z airflow.exceptions.AirflowException: Dag 'vim_status_e359c9f2-3d20-44f3-a1e8-ccbbb001c520' could not be found; either it does not exist or it failed to parse.
2024-03-21T02:17:16.404377813Z [2024-03-21 02:17:16,401: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[660a659c-04d9-46b7-9589-b5f8f79c9f85] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 660a659c-04d9-46b7-9589-b5f8f79c9f85')
2024-03-21T02:17:16.404395923Z Traceback (most recent call last):
2024-03-21T02:17:16.404400079Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-21T02:17:16.404402933Z     R = retval = fun(*args, **kwargs)
2024-03-21T02:17:16.404405820Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-21T02:17:16.404408644Z     return self.run(*args, **kwargs)
2024-03-21T02:17:16.404412642Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-21T02:17:16.404416329Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-21T02:17:16.404419918Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-21T02:17:16.404423270Z     raise AirflowException(msg)
2024-03-21T02:17:16.404444363Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 660a659c-04d9-46b7-9589-b5f8f79c9f85
2024-03-21T02:17:16.417726910Z [2024-03-21 02:17:16,417: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6ac4c7e6-703b-4df5-9963-c2bfd0488d65] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6ac4c7e6-703b-4df5-9963-c2bfd0488d65')
2024-03-21T02:17:16.417764275Z Traceback (most recent call last):
2024-03-21T02:17:16.417769319Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-03-21T02:17:16.417772979Z     R = retval = fun(*args, **kwargs)
2024-03-21T02:17:16.417776711Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-03-21T02:17:16.417779848Z     return self.run(*args, **kwargs)
2024-03-21T02:17:16.417783674Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-03-21T02:17:16.417787715Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-03-21T02:17:16.417790768Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-03-21T02:17:16.417794388Z     raise AirflowException(msg)
2024-03-21T02:17:16.417797997Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6ac4c7e6-703b-4df5-9963-c2bfd0488d65
2024-03-21T02:18:00.647023166Z [2024-03-21 02:18:00,646: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1cac33bd-e314-4e9f-8f66-d04a23adce60] received
2024-03-21T02:18:00.651772427Z [2024-03-21 02:18:00,651: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db8b26c5-99a9-43bd-984f-57953457cb21] received
2024-03-21T02:18:00.658159823Z [2024-03-21 02:18:00,657: INFO/ForkPoolWorker-16] [db8b26c5-99a9-43bd-984f-57953457cb21] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:18:00.661918432Z [2024-03-21 02:18:00,661: INFO/ForkPoolWorker-15] [1cac33bd-e314-4e9f-8f66-d04a23adce60] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:18:00.664493229Z [2024-03-21 02:18:00,664: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7bdfaf2f-81c6-4eda-bcf6-f7cc0cfe63ea] received
2024-03-21T02:18:00.666979015Z [2024-03-21 02:18:00,666: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b497b5e-2cb2-423a-b83e-60e122f02a80] received
2024-03-21T02:18:00.674041794Z [2024-03-21 02:18:00,673: INFO/ForkPoolWorker-2] [6b497b5e-2cb2-423a-b83e-60e122f02a80] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:18:00.689080896Z [2024-03-21 02:18:00,688: INFO/ForkPoolWorker-1] [7bdfaf2f-81c6-4eda-bcf6-f7cc0cfe63ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:18:01.055937114Z [2024-03-21 02:18:01,052: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:18:01.076626308Z [2024-03-21 02:18:01,072: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:18:01.103901655Z [2024-03-21 02:18:01,100: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:18:01.175155174Z [2024-03-21 02:18:01,171: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:18:01.273465148Z [2024-03-21 02:18:01,272: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T02:18:01.277908364Z [2024-03-21 02:18:01,277: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:18:01.309620848Z [2024-03-21 02:18:01,309: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:18:01.314946928Z [2024-03-21 02:18:01,314: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:18:01.314988306Z [2024-03-21 02:18:01,314: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:18:01.315198826Z [2024-03-21 02:18:01,315: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T02:18:01.315711572Z [2024-03-21 02:18:01,315: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:18:01.331238392Z [2024-03-21 02:18:01,330: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:18:01.432700222Z [2024-03-21 02:18:01,432: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:18:02.107452855Z [2024-03-21 02:18:02,106: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1cac33bd-e314-4e9f-8f66-d04a23adce60] succeeded in 1.45408998899984s: None
2024-03-21T02:18:02.167207477Z [2024-03-21 02:18:02,166: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6b497b5e-2cb2-423a-b83e-60e122f02a80] succeeded in 1.498516413001198s: None
2024-03-21T02:18:02.752445976Z [2024-03-21 02:18:02,751: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:18:02.760192770Z [2024-03-21 02:18:02,759: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:18:02.813119070Z [2024-03-21 02:18:02,812: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:18:02.817545714Z [2024-03-21 02:18:02,816: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:18:02.828523540Z [2024-03-21 02:18:02,828: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:18:02.832178090Z [2024-03-21 02:18:02,831: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:18:02.832478281Z [2024-03-21 02:18:02,832: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:18:02.832744619Z [2024-03-21 02:18:02,832: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:18:02.833015560Z [2024-03-21 02:18:02,832: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:18:02.833793007Z [2024-03-21 02:18:02,833: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:18:02.834079040Z [2024-03-21 02:18:02,833: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:18:02.916560122Z [2024-03-21 02:18:02,916: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:18:02.921791713Z [2024-03-21 02:18:02,921: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:18:02.921839756Z [2024-03-21 02:18:02,921: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:18:02.921891876Z [2024-03-21 02:18:02,921: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:18:02.922019178Z [2024-03-21 02:18:02,921: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:18:02.922459562Z [2024-03-21 02:18:02,922: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:18:02.923172829Z [2024-03-21 02:18:02,922: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:18:02.994388597Z [2024-03-21 02:18:02,993: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:18:03.096849431Z [2024-03-21 02:18:03,092: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:18:04.885022260Z [2024-03-21 02:18:04,884: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[db8b26c5-99a9-43bd-984f-57953457cb21] succeeded in 4.231900176000636s: None
2024-03-21T02:18:05.622231667Z [2024-03-21 02:18:05,621: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7bdfaf2f-81c6-4eda-bcf6-f7cc0cfe63ea] succeeded in 4.953765676998955s: None
2024-03-21T02:19:00.359068826Z [2024-03-21 02:19:00,358: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2be06fd5-2d91-4e09-818c-7f063933371c] received
2024-03-21T02:19:00.366549530Z [2024-03-21 02:19:00,366: INFO/ForkPoolWorker-15] [2be06fd5-2d91-4e09-818c-7f063933371c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:19:00.367383554Z [2024-03-21 02:19:00,367: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f11d1e66-a110-499a-92d7-e472e9d56483] received
2024-03-21T02:19:00.369971461Z [2024-03-21 02:19:00,369: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d0f05cba-eb82-4988-8f0a-04ceaceb7a42] received
2024-03-21T02:19:00.383009059Z [2024-03-21 02:19:00,382: INFO/ForkPoolWorker-1] [d0f05cba-eb82-4988-8f0a-04ceaceb7a42] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:19:00.384970966Z [2024-03-21 02:19:00,384: INFO/ForkPoolWorker-16] [f11d1e66-a110-499a-92d7-e472e9d56483] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:19:00.675989897Z [2024-03-21 02:19:00,672: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:19:00.690812767Z [2024-03-21 02:19:00,687: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:19:00.698985102Z [2024-03-21 02:19:00,696: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:19:00.829017894Z [2024-03-21 02:19:00,828: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T02:19:00.832989108Z [2024-03-21 02:19:00,832: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:19:00.855091466Z [2024-03-21 02:19:00,854: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:19:00.856270377Z [2024-03-21 02:19:00,856: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:19:00.856446541Z [2024-03-21 02:19:00,856: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:19:00.856512919Z [2024-03-21 02:19:00,856: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T02:19:00.856796048Z [2024-03-21 02:19:00,856: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:19:00.995262473Z [2024-03-21 02:19:00,994: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:19:01.680118287Z [2024-03-21 02:19:01,679: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d0f05cba-eb82-4988-8f0a-04ceaceb7a42] succeeded in 1.3073731450003834s: None
2024-03-21T02:19:01.896043799Z [2024-03-21 02:19:01,895: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:19:01.899657993Z [2024-03-21 02:19:01,899: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:19:01.921224147Z [2024-03-21 02:19:01,920: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:19:01.924775771Z [2024-03-21 02:19:01,924: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:19:01.930488775Z [2024-03-21 02:19:01,930: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:19:01.932008866Z [2024-03-21 02:19:01,931: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:19:01.932081166Z [2024-03-21 02:19:01,931: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:19:01.932216278Z [2024-03-21 02:19:01,932: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:19:01.932294824Z [2024-03-21 02:19:01,932: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:19:01.932761710Z [2024-03-21 02:19:01,932: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:19:01.932852760Z [2024-03-21 02:19:01,932: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:19:01.952004936Z [2024-03-21 02:19:01,951: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:19:01.953954392Z [2024-03-21 02:19:01,953: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:19:01.953989386Z [2024-03-21 02:19:01,953: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:19:01.954187084Z [2024-03-21 02:19:01,953: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:19:01.954252873Z [2024-03-21 02:19:01,954: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:19:01.954651623Z [2024-03-21 02:19:01,954: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:19:01.954811790Z [2024-03-21 02:19:01,954: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:19:02.045880046Z [2024-03-21 02:19:02,045: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:19:02.045931979Z [2024-03-21 02:19:02,045: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:19:03.566835193Z [2024-03-21 02:19:03,566: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2be06fd5-2d91-4e09-818c-7f063933371c] succeeded in 3.2055644470001425s: None
2024-03-21T02:19:04.000293746Z [2024-03-21 02:19:03,999: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f11d1e66-a110-499a-92d7-e472e9d56483] succeeded in 3.628845471999739s: None
2024-03-21T02:20:01.234083787Z [2024-03-21 02:20:01,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85026ec8-a590-466b-ad15-03358b3d88ee] received
2024-03-21T02:20:01.235734159Z [2024-03-21 02:20:01,235: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6f63f59-239e-4a13-9cab-41ccabe8bd81] received
2024-03-21T02:20:01.245784038Z [2024-03-21 02:20:01,245: INFO/ForkPoolWorker-16] [a6f63f59-239e-4a13-9cab-41ccabe8bd81] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:20:01.246321558Z [2024-03-21 02:20:01,246: INFO/ForkPoolWorker-15] [85026ec8-a590-466b-ad15-03358b3d88ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:20:01.257051457Z [2024-03-21 02:20:01,256: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[117c110c-49de-4e73-b3a2-d51133741faa] received
2024-03-21T02:20:01.261020444Z [2024-03-21 02:20:01,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75a51638-64e4-4be3-9d8d-6ed4230307ad] received
2024-03-21T02:20:01.262701697Z [2024-03-21 02:20:01,262: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a61c8b4-51db-4aea-b7ea-4d17fe826526] received
2024-03-21T02:20:01.263475955Z [2024-03-21 02:20:01,263: INFO/ForkPoolWorker-1] [117c110c-49de-4e73-b3a2-d51133741faa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:20:01.277410933Z [2024-03-21 02:20:01,277: INFO/ForkPoolWorker-3] [5a61c8b4-51db-4aea-b7ea-4d17fe826526] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:20:01.287986767Z [2024-03-21 02:20:01,287: INFO/ForkPoolWorker-2] [75a51638-64e4-4be3-9d8d-6ed4230307ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:20:01.614889064Z [2024-03-21 02:20:01,611: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:20:01.692817244Z [2024-03-21 02:20:01,689: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:20:01.700657893Z [2024-03-21 02:20:01,697: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:20:01.867880864Z [2024-03-21 02:20:01,862: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:20:01.919433363Z [2024-03-21 02:20:01,913: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:20:01.926021406Z [2024-03-21 02:20:01,925: INFO/ForkPoolWorker-3] Getting SDNC list
2024-03-21T02:20:01.929899576Z [2024-03-21 02:20:01,929: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:20:01.935765608Z [2024-03-21 02:20:01,935: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:20:01.975675473Z [2024-03-21 02:20:01,975: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-21T02:20:01.977112953Z [2024-03-21 02:20:01,976: INFO/ForkPoolWorker-3] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:20:01.977145056Z [2024-03-21 02:20:01,977: INFO/ForkPoolWorker-3] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:20:01.977289421Z [2024-03-21 02:20:01,977: INFO/ForkPoolWorker-3] Getting SDNC list OK
2024-03-21T02:20:01.977504578Z [2024-03-21 02:20:01,977: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:20:02.077096466Z [2024-03-21 02:20:02,076: INFO/ForkPoolWorker-3] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:20:02.760275676Z [2024-03-21 02:20:02,759: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a6f63f59-239e-4a13-9cab-41ccabe8bd81] succeeded in 1.5213165669993032s: None
2024-03-21T02:20:03.062480093Z [2024-03-21 02:20:03,061: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[5a61c8b4-51db-4aea-b7ea-4d17fe826526] succeeded in 1.7971228169990354s: None
2024-03-21T02:20:03.675457471Z [2024-03-21 02:20:03,675: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:20:03.682040171Z [2024-03-21 02:20:03,681: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:20:03.715847305Z [2024-03-21 02:20:03,714: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:20:03.718293408Z [2024-03-21 02:20:03,718: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:20:03.719577698Z [2024-03-21 02:20:03,719: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:20:03.720339407Z [2024-03-21 02:20:03,720: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:20:03.720588299Z [2024-03-21 02:20:03,720: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:20:03.720969509Z [2024-03-21 02:20:03,720: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:20:03.722555820Z [2024-03-21 02:20:03,722: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:20:03.836530953Z [2024-03-21 02:20:03,836: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:20:03.937447120Z [2024-03-21 02:20:03,937: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T02:20:03.941409040Z [2024-03-21 02:20:03,940: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:20:03.959432753Z [2024-03-21 02:20:03,959: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:20:03.961891301Z [2024-03-21 02:20:03,961: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:20:03.961995534Z [2024-03-21 02:20:03,961: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:20:03.962329201Z [2024-03-21 02:20:03,961: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:20:03.962748249Z [2024-03-21 02:20:03,962: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T02:20:03.963356363Z [2024-03-21 02:20:03,963: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:20:03.963808385Z [2024-03-21 02:20:03,963: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:20:03.996448373Z [2024-03-21 02:20:03,996: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:20:04.000183256Z [2024-03-21 02:20:03,999: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:20:04.029566073Z [2024-03-21 02:20:04,029: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:20:04.031476718Z [2024-03-21 02:20:04,031: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:20:04.031573488Z [2024-03-21 02:20:04,031: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:20:04.031806702Z [2024-03-21 02:20:04,031: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:20:04.031888254Z [2024-03-21 02:20:04,031: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:20:04.032258640Z [2024-03-21 02:20:04,032: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:20:04.032425694Z [2024-03-21 02:20:04,032: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:20:04.087335966Z [2024-03-21 02:20:04,086: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:20:04.166947311Z [2024-03-21 02:20:04,166: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T02:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:20:04.881219556Z [2024-03-21 02:20:04,880: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[85026ec8-a590-466b-ad15-03358b3d88ee] succeeded in 3.644358937001016s: None
2024-03-21T02:20:05.092935432Z [2024-03-21 02:20:05,092: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5d368da-78f3-4a3d-b945-2c46e928a761] received
2024-03-21T02:20:05.101626755Z [2024-03-21 02:20:05,101: INFO/ForkPoolWorker-15] [e5d368da-78f3-4a3d-b945-2c46e928a761] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:20:05.396578354Z [2024-03-21 02:20:05,393: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:20:05.886665242Z [2024-03-21 02:20:05,886: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[117c110c-49de-4e73-b3a2-d51133741faa] succeeded in 4.628181158999723s: None
2024-03-21T02:20:05.963099104Z [2024-03-21 02:20:05,962: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[75a51638-64e4-4be3-9d8d-6ed4230307ad] succeeded in 4.698300294001456s: None
2024-03-21T02:20:06.605003564Z [2024-03-21 02:20:06,604: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:20:06.608401470Z [2024-03-21 02:20:06,607: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:20:06.625574820Z [2024-03-21 02:20:06,625: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:20:06.627021853Z [2024-03-21 02:20:06,626: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:20:06.627187727Z [2024-03-21 02:20:06,627: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:20:06.627407651Z [2024-03-21 02:20:06,627: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:20:06.627560557Z [2024-03-21 02:20:06,627: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:20:06.627880693Z [2024-03-21 02:20:06,627: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:20:06.628023433Z [2024-03-21 02:20:06,627: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:20:06.707145944Z [2024-03-21 02:20:06,706: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T02:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:20:07.271161200Z [2024-03-21 02:20:07,270: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e5d368da-78f3-4a3d-b945-2c46e928a761] succeeded in 2.1759581320002326s: None
2024-03-21T02:20:07.559902070Z [2024-03-21 02:20:07,559: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d707522-f56e-44f9-a602-649ee25e89ad] received
2024-03-21T02:20:07.570557553Z [2024-03-21 02:20:07,570: INFO/ForkPoolWorker-15] [7d707522-f56e-44f9-a602-649ee25e89ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T02:20:07.874988072Z [2024-03-21 02:20:07,871: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:20:08.977241804Z [2024-03-21 02:20:08,976: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:20:08.980477561Z [2024-03-21 02:20:08,979: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:20:08.999184971Z [2024-03-21 02:20:08,998: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:20:09.000416489Z [2024-03-21 02:20:09,000: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:20:09.000493502Z [2024-03-21 02:20:09,000: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:20:09.000543863Z [2024-03-21 02:20:09,000: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:20:09.000618659Z [2024-03-21 02:20:09,000: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:20:09.000829492Z [2024-03-21 02:20:09,000: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:20:09.000877787Z [2024-03-21 02:20:09,000: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:20:09.082779245Z [2024-03-21 02:20:09,082: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T02:15:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:20:09.733772730Z [2024-03-21 02:20:09,733: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7d707522-f56e-44f9-a602-649ee25e89ad] succeeded in 2.171323951000886s: None
2024-03-21T02:20:10.167307869Z [2024-03-21 02:20:10,167: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6cfe87ff-e0ee-4c1b-881a-308e92ffa174] received
2024-03-21T02:20:10.181043735Z [2024-03-21 02:20:10,180: INFO/ForkPoolWorker-15] [6cfe87ff-e0ee-4c1b-881a-308e92ffa174] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:20:10.672481431Z [2024-03-21 02:20:10,669: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:20:11.890805292Z [2024-03-21 02:20:11,890: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:20:11.894843476Z [2024-03-21 02:20:11,894: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:20:11.912881010Z [2024-03-21 02:20:11,912: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:20:11.914892623Z [2024-03-21 02:20:11,914: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:20:11.914919229Z [2024-03-21 02:20:11,914: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:20:11.915631481Z [2024-03-21 02:20:11,914: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:20:11.915842428Z [2024-03-21 02:20:11,915: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:20:11.917479545Z [2024-03-21 02:20:11,916: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:20:11.917500278Z [2024-03-21 02:20:11,917: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:20:11.993451589Z [2024-03-21 02:20:11,993: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T02:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:20:12.559396663Z [2024-03-21 02:20:12,556: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6cfe87ff-e0ee-4c1b-881a-308e92ffa174] succeeded in 2.385532823000176s: None
2024-03-21T02:21:01.105324407Z [2024-03-21 02:21:01,104: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2dc8f92a-20bd-4bc0-af95-4d1fd2fd2704] received
2024-03-21T02:21:01.108187008Z [2024-03-21 02:21:01,107: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3583bca-c4d5-4793-a701-7322e93544fa] received
2024-03-21T02:21:01.114989744Z [2024-03-21 02:21:01,114: INFO/ForkPoolWorker-16] [c3583bca-c4d5-4793-a701-7322e93544fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:21:01.118579233Z [2024-03-21 02:21:01,118: INFO/ForkPoolWorker-15] [2dc8f92a-20bd-4bc0-af95-4d1fd2fd2704] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:21:01.119655110Z [2024-03-21 02:21:01,119: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16d267ed-def3-42b2-8a3e-fa2ed8130706] received
2024-03-21T02:21:01.127632914Z [2024-03-21 02:21:01,127: INFO/ForkPoolWorker-1] [16d267ed-def3-42b2-8a3e-fa2ed8130706] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:21:01.449653866Z [2024-03-21 02:21:01,446: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:21:01.470513193Z [2024-03-21 02:21:01,467: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:21:01.477304769Z [2024-03-21 02:21:01,473: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:21:01.650568647Z [2024-03-21 02:21:01,650: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T02:21:01.655201940Z [2024-03-21 02:21:01,654: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:21:01.679600931Z [2024-03-21 02:21:01,679: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:21:01.680852869Z [2024-03-21 02:21:01,680: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:21:01.680967602Z [2024-03-21 02:21:01,680: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:21:01.681057450Z [2024-03-21 02:21:01,680: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T02:21:01.681275822Z [2024-03-21 02:21:01,681: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:21:01.785567015Z [2024-03-21 02:21:01,785: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:21:02.462869833Z [2024-03-21 02:21:02,462: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[16d267ed-def3-42b2-8a3e-fa2ed8130706] succeeded in 1.3414040690004185s: None
2024-03-21T02:21:02.738611026Z [2024-03-21 02:21:02,738: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:21:02.742372622Z [2024-03-21 02:21:02,741: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:21:02.762027139Z [2024-03-21 02:21:02,761: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:21:02.763480529Z [2024-03-21 02:21:02,763: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:21:02.763658221Z [2024-03-21 02:21:02,763: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:21:02.763901441Z [2024-03-21 02:21:02,763: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:21:02.764050917Z [2024-03-21 02:21:02,763: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:21:02.764496112Z [2024-03-21 02:21:02,764: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:21:02.764690855Z [2024-03-21 02:21:02,764: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:21:02.800370762Z [2024-03-21 02:21:02,799: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:21:02.805404533Z [2024-03-21 02:21:02,804: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:21:02.825940641Z [2024-03-21 02:21:02,825: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:21:02.828302960Z [2024-03-21 02:21:02,827: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:21:02.828571843Z [2024-03-21 02:21:02,828: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:21:02.828892469Z [2024-03-21 02:21:02,828: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:21:02.829100247Z [2024-03-21 02:21:02,828: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:21:02.829646351Z [2024-03-21 02:21:02,829: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:21:02.829863817Z [2024-03-21 02:21:02,829: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:21:02.887176040Z [2024-03-21 02:21:02,886: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:21:02.949323685Z [2024-03-21 02:21:02,948: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:21:05.052584473Z [2024-03-21 02:21:05,052: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2dc8f92a-20bd-4bc0-af95-4d1fd2fd2704] succeeded in 3.9437788739996904s: None
2024-03-21T02:21:05.166693708Z [2024-03-21 02:21:05,166: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c3583bca-c4d5-4793-a701-7322e93544fa] succeeded in 4.056443806000971s: None
2024-03-21T02:22:00.477545297Z [2024-03-21 02:22:00,477: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca133310-24d9-48b7-9ece-5b5a22df8176] received
2024-03-21T02:22:00.485924744Z [2024-03-21 02:22:00,485: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f733a22-52d2-4624-9a26-df8ed9e76c99] received
2024-03-21T02:22:00.489119378Z [2024-03-21 02:22:00,488: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c886329c-d736-4186-9a64-0da626ef669a] received
2024-03-21T02:22:00.489645218Z [2024-03-21 02:22:00,489: INFO/ForkPoolWorker-15] [ca133310-24d9-48b7-9ece-5b5a22df8176] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:22:00.491786423Z [2024-03-21 02:22:00,491: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8dc82868-d35d-4ea7-b2d0-224d0e960f1b] received
2024-03-21T02:22:00.496144451Z [2024-03-21 02:22:00,495: INFO/ForkPoolWorker-16] [3f733a22-52d2-4624-9a26-df8ed9e76c99] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:22:00.521906481Z [2024-03-21 02:22:00,519: INFO/ForkPoolWorker-1] [c886329c-d736-4186-9a64-0da626ef669a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:22:00.527236598Z [2024-03-21 02:22:00,525: INFO/ForkPoolWorker-2] [8dc82868-d35d-4ea7-b2d0-224d0e960f1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:22:00.891248873Z [2024-03-21 02:22:00,887: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:22:00.941297430Z [2024-03-21 02:22:00,937: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:22:00.970342382Z [2024-03-21 02:22:00,966: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:22:01.049604875Z [2024-03-21 02:22:01,049: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T02:22:01.055503719Z [2024-03-21 02:22:01,055: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:22:01.090852282Z [2024-03-21 02:22:01,086: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:22:01.099445809Z [2024-03-21 02:22:01,099: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:22:01.101151519Z [2024-03-21 02:22:01,100: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:22:01.101304579Z [2024-03-21 02:22:01,101: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:22:01.101399788Z [2024-03-21 02:22:01,101: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T02:22:01.101617933Z [2024-03-21 02:22:01,101: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:22:01.197840897Z [2024-03-21 02:22:01,197: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:22:01.222331276Z [2024-03-21 02:22:01,222: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:22:01.762591536Z [2024-03-21 02:22:01,762: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8dc82868-d35d-4ea7-b2d0-224d0e960f1b] succeeded in 1.265904922000118s: None
2024-03-21T02:22:01.861072681Z [2024-03-21 02:22:01,860: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ca133310-24d9-48b7-9ece-5b5a22df8176] succeeded in 1.3818800629996986s: None
2024-03-21T02:22:02.434274570Z [2024-03-21 02:22:02,433: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:22:02.438166560Z [2024-03-21 02:22:02,437: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:22:02.462361355Z [2024-03-21 02:22:02,462: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:22:02.463991739Z [2024-03-21 02:22:02,463: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:22:02.464192472Z [2024-03-21 02:22:02,463: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:22:02.464544676Z [2024-03-21 02:22:02,464: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:22:02.464678282Z [2024-03-21 02:22:02,464: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:22:02.465095123Z [2024-03-21 02:22:02,464: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:22:02.465283849Z [2024-03-21 02:22:02,465: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:22:02.578016619Z [2024-03-21 02:22:02,577: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:22:02.598482482Z [2024-03-21 02:22:02,598: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:22:02.602123049Z [2024-03-21 02:22:02,601: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:22:02.642799867Z [2024-03-21 02:22:02,642: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:22:02.644239247Z [2024-03-21 02:22:02,644: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:22:02.644427075Z [2024-03-21 02:22:02,644: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:22:02.644629116Z [2024-03-21 02:22:02,644: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:22:02.644740830Z [2024-03-21 02:22:02,644: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:22:02.645208343Z [2024-03-21 02:22:02,645: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:22:02.645335827Z [2024-03-21 02:22:02,645: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:22:02.749551477Z [2024-03-21 02:22:02,749: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:22:04.443848908Z [2024-03-21 02:22:04,443: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3f733a22-52d2-4624-9a26-df8ed9e76c99] succeeded in 3.956037160000051s: None
2024-03-21T02:22:04.633345985Z [2024-03-21 02:22:04,632: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c886329c-d736-4186-9a64-0da626ef669a] succeeded in 4.135943313000098s: None
2024-03-21T02:23:00.448712270Z [2024-03-21 02:23:00,448: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9f95598-73ac-48fb-a913-1f5f9e0c79db] received
2024-03-21T02:23:00.459832593Z [2024-03-21 02:23:00,459: INFO/ForkPoolWorker-15] [e9f95598-73ac-48fb-a913-1f5f9e0c79db] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:23:00.464014482Z [2024-03-21 02:23:00,463: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[709a4ede-867f-403a-9d66-7cdbf222bdda] received
2024-03-21T02:23:00.482419826Z [2024-03-21 02:23:00,482: INFO/ForkPoolWorker-16] [709a4ede-867f-403a-9d66-7cdbf222bdda] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:23:00.489625863Z [2024-03-21 02:23:00,489: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e0cdd94-20b4-4dd8-80e0-13ca60a010a6] received
2024-03-21T02:23:00.528661079Z [2024-03-21 02:23:00,528: INFO/ForkPoolWorker-1] [5e0cdd94-20b4-4dd8-80e0-13ca60a010a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:23:00.841602333Z [2024-03-21 02:23:00,838: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:23:00.904530457Z [2024-03-21 02:23:00,901: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:23:01.064816088Z [2024-03-21 02:23:01,061: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:23:01.248221932Z [2024-03-21 02:23:01,247: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T02:23:01.252818024Z [2024-03-21 02:23:01,252: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:23:01.297200405Z [2024-03-21 02:23:01,296: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:23:01.311489538Z [2024-03-21 02:23:01,311: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:23:01.316719711Z [2024-03-21 02:23:01,311: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:23:01.316945006Z [2024-03-21 02:23:01,316: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T02:23:01.317277761Z [2024-03-21 02:23:01,317: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:23:01.511400847Z [2024-03-21 02:23:01,511: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:23:02.586268146Z [2024-03-21 02:23:02,585: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5e0cdd94-20b4-4dd8-80e0-13ca60a010a6] succeeded in 2.0865728670014505s: None
2024-03-21T02:23:02.839352770Z [2024-03-21 02:23:02,838: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:23:02.842919644Z [2024-03-21 02:23:02,842: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:23:02.898722345Z [2024-03-21 02:23:02,898: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:23:02.900584456Z [2024-03-21 02:23:02,900: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:23:02.900784953Z [2024-03-21 02:23:02,900: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:23:02.901029093Z [2024-03-21 02:23:02,900: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:23:02.901230336Z [2024-03-21 02:23:02,900: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:23:02.901593037Z [2024-03-21 02:23:02,901: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:23:02.901729147Z [2024-03-21 02:23:02,901: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:23:02.901845318Z [2024-03-21 02:23:02,901: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:23:02.905546513Z [2024-03-21 02:23:02,905: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:23:02.933040244Z [2024-03-21 02:23:02,932: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:23:02.935410261Z [2024-03-21 02:23:02,935: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:23:02.935427386Z [2024-03-21 02:23:02,935: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:23:02.935993689Z [2024-03-21 02:23:02,935: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:23:02.936145800Z [2024-03-21 02:23:02,935: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:23:02.938150874Z [2024-03-21 02:23:02,936: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:23:02.938188303Z [2024-03-21 02:23:02,938: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:23:03.066881569Z [2024-03-21 02:23:03,066: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:23:03.124243465Z [2024-03-21 02:23:03,123: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:23:05.712938891Z [2024-03-21 02:23:05,711: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e9f95598-73ac-48fb-a913-1f5f9e0c79db] succeeded in 5.2583774640006595s: None
2024-03-21T02:23:06.813118221Z [2024-03-21 02:23:06,812: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[709a4ede-867f-403a-9d66-7cdbf222bdda] succeeded in 6.338981430999411s: None
2024-03-21T02:24:00.322602206Z [2024-03-21 02:24:00,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[40d9bb78-5134-4cac-9027-868bd77b51dd] received
2024-03-21T02:24:00.324749133Z [2024-03-21 02:24:00,324: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c60959bc-f116-4fac-bfec-f69e87283ee1] received
2024-03-21T02:24:00.334207019Z [2024-03-21 02:24:00,333: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[384cf6fa-8d53-4050-b4dc-24279c614b18] received
2024-03-21T02:24:00.334564881Z [2024-03-21 02:24:00,334: INFO/ForkPoolWorker-15] [40d9bb78-5134-4cac-9027-868bd77b51dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:24:00.335006951Z [2024-03-21 02:24:00,334: INFO/ForkPoolWorker-16] [c60959bc-f116-4fac-bfec-f69e87283ee1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:24:00.341347287Z [2024-03-21 02:24:00,341: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[590c85b9-5922-427e-acf6-bfab1edc329a] received
2024-03-21T02:24:00.342052982Z [2024-03-21 02:24:00,341: INFO/ForkPoolWorker-1] [384cf6fa-8d53-4050-b4dc-24279c614b18] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:24:00.351235216Z [2024-03-21 02:24:00,350: INFO/ForkPoolWorker-2] [590c85b9-5922-427e-acf6-bfab1edc329a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:24:00.724372603Z [2024-03-21 02:24:00,721: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:24:00.739595906Z [2024-03-21 02:24:00,736: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:24:00.784096221Z [2024-03-21 02:24:00,778: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:24:00.860415714Z [2024-03-21 02:24:00,854: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:24:01.139685851Z [2024-03-21 02:24:01,139: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T02:24:01.143988056Z [2024-03-21 02:24:01,143: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:24:01.181800084Z [2024-03-21 02:24:01,181: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:24:01.193245339Z [2024-03-21 02:24:01,192: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:24:01.193589743Z [2024-03-21 02:24:01,193: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:24:01.193628928Z [2024-03-21 02:24:01,193: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T02:24:01.194029689Z [2024-03-21 02:24:01,193: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:24:01.277454705Z [2024-03-21 02:24:01,277: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:24:01.333906987Z [2024-03-21 02:24:01,333: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:24:02.624800733Z [2024-03-21 02:24:02,624: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[40d9bb78-5134-4cac-9027-868bd77b51dd] succeeded in 2.2999693420006224s: None
2024-03-21T02:24:02.633771542Z [2024-03-21 02:24:02,633: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[590c85b9-5922-427e-acf6-bfab1edc329a] succeeded in 2.2901803129989275s: None
2024-03-21T02:24:02.797417945Z [2024-03-21 02:24:02,797: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:24:02.800997754Z [2024-03-21 02:24:02,800: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:24:02.822820327Z [2024-03-21 02:24:02,822: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:24:02.829358381Z [2024-03-21 02:24:02,829: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:24:02.829468928Z [2024-03-21 02:24:02,829: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:24:02.829635707Z [2024-03-21 02:24:02,829: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:24:02.832405658Z [2024-03-21 02:24:02,830: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:24:02.833048876Z [2024-03-21 02:24:02,832: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:24:02.833207888Z [2024-03-21 02:24:02,833: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:24:02.994946121Z [2024-03-21 02:24:02,994: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:24:03.158722236Z [2024-03-21 02:24:03,158: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:24:03.162402228Z [2024-03-21 02:24:03,161: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:24:03.195129577Z [2024-03-21 02:24:03,194: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:24:03.196550187Z [2024-03-21 02:24:03,196: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:24:03.196715535Z [2024-03-21 02:24:03,196: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:24:03.196951802Z [2024-03-21 02:24:03,196: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:24:03.197103840Z [2024-03-21 02:24:03,196: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:24:03.197459662Z [2024-03-21 02:24:03,197: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:24:03.197920543Z [2024-03-21 02:24:03,197: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:24:03.347846396Z [2024-03-21 02:24:03,347: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:24:04.644779608Z [2024-03-21 02:24:04,644: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[384cf6fa-8d53-4050-b4dc-24279c614b18] succeeded in 4.307920936998926s: None
2024-03-21T02:24:05.890745581Z [2024-03-21 02:24:05,890: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c60959bc-f116-4fac-bfec-f69e87283ee1] succeeded in 5.563324593000289s: None
2024-03-21T02:25:01.288396605Z [2024-03-21 02:25:01,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed14f111-33cd-40c9-9c66-22b8b8a4612f] received
2024-03-21T02:25:01.291264224Z [2024-03-21 02:25:01,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3720b86d-0494-447b-a94a-af1811290b43] received
2024-03-21T02:25:01.296700597Z [2024-03-21 02:25:01,296: INFO/ForkPoolWorker-15] [ed14f111-33cd-40c9-9c66-22b8b8a4612f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:25:01.299942536Z [2024-03-21 02:25:01,299: INFO/ForkPoolWorker-16] [3720b86d-0494-447b-a94a-af1811290b43] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:25:01.314406908Z [2024-03-21 02:25:01,314: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58e44e1a-0d03-42b6-8251-725d209c0ac6] received
2024-03-21T02:25:01.315582769Z [2024-03-21 02:25:01,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df2af4a7-c5ff-4b51-9a1e-eebb7d240aab] received
2024-03-21T02:25:01.326414549Z [2024-03-21 02:25:01,326: INFO/ForkPoolWorker-1] [58e44e1a-0d03-42b6-8251-725d209c0ac6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:25:01.353178992Z [2024-03-21 02:25:01,352: INFO/ForkPoolWorker-2] [df2af4a7-c5ff-4b51-9a1e-eebb7d240aab] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:25:01.660893723Z [2024-03-21 02:25:01,657: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:25:01.893363221Z [2024-03-21 02:25:01,882: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:25:01.914609367Z [2024-03-21 02:25:01,906: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:25:02.306355196Z [2024-03-21 02:25:02,299: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:25:02.795234962Z [2024-03-21 02:25:02,794: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T02:25:02.802269964Z [2024-03-21 02:25:02,801: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:25:02.831712389Z [2024-03-21 02:25:02,831: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:25:02.833818156Z [2024-03-21 02:25:02,833: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:25:02.833981949Z [2024-03-21 02:25:02,833: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:25:02.834075408Z [2024-03-21 02:25:02,833: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T02:25:02.834928237Z [2024-03-21 02:25:02,834: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:25:02.962149623Z [2024-03-21 02:25:02,961: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:25:03.855427626Z [2024-03-21 02:25:03,854: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[df2af4a7-c5ff-4b51-9a1e-eebb7d240aab] succeeded in 2.5378488669994113s: None
2024-03-21T02:25:04.072648965Z [2024-03-21 02:25:04,072: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:25:04.077164547Z [2024-03-21 02:25:04,076: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:25:04.103765521Z [2024-03-21 02:25:04,103: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:25:04.105127602Z [2024-03-21 02:25:04,104: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:25:04.105148035Z [2024-03-21 02:25:04,105: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:25:04.105297659Z [2024-03-21 02:25:04,105: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:25:04.105304903Z [2024-03-21 02:25:04,105: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:25:04.105517785Z [2024-03-21 02:25:04,105: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:25:04.105557193Z [2024-03-21 02:25:04,105: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:25:04.143004361Z [2024-03-21 02:25:04,142: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:25:04.158530369Z [2024-03-21 02:25:04,158: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:25:04.171811451Z [2024-03-21 02:25:04,171: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:25:04.175879108Z [2024-03-21 02:25:04,175: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:25:04.186399439Z [2024-03-21 02:25:04,186: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:25:04.186432602Z [2024-03-21 02:25:04,186: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:25:04.187865790Z [2024-03-21 02:25:04,187: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:25:04.188092907Z [2024-03-21 02:25:04,187: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:25:04.188383829Z [2024-03-21 02:25:04,188: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:25:04.188604139Z [2024-03-21 02:25:04,188: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:25:04.189002280Z [2024-03-21 02:25:04,188: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:25:04.189640117Z [2024-03-21 02:25:04,189: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:25:04.221197033Z [2024-03-21 02:25:04,220: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:25:04.224684336Z [2024-03-21 02:25:04,224: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:25:04.225118797Z [2024-03-21 02:25:04,224: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:25:04.225412685Z [2024-03-21 02:25:04,225: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:25:04.225589156Z [2024-03-21 02:25:04,225: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:25:04.226021033Z [2024-03-21 02:25:04,225: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:25:04.226593927Z [2024-03-21 02:25:04,226: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:25:04.281463279Z [2024-03-21 02:25:04,281: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T02:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:25:04.508280623Z [2024-03-21 02:25:04,507: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:25:05.072427435Z [2024-03-21 02:25:05,071: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ed14f111-33cd-40c9-9c66-22b8b8a4612f] succeeded in 3.782104851999975s: None
2024-03-21T02:25:05.136095866Z [2024-03-21 02:25:05,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0205f13-da4a-483a-89c4-8740accbef89] received
2024-03-21T02:25:05.148665392Z [2024-03-21 02:25:05,147: INFO/ForkPoolWorker-15] [f0205f13-da4a-483a-89c4-8740accbef89] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:25:05.542328807Z [2024-03-21 02:25:05,539: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:25:05.896213229Z [2024-03-21 02:25:05,895: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[58e44e1a-0d03-42b6-8251-725d209c0ac6] succeeded in 4.578907275999882s: None
2024-03-21T02:25:06.759144330Z [2024-03-21 02:25:06,758: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3720b86d-0494-447b-a94a-af1811290b43] succeeded in 5.465892964999512s: None
2024-03-21T02:25:06.800120362Z [2024-03-21 02:25:06,799: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:25:06.803527964Z [2024-03-21 02:25:06,802: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:25:06.822014589Z [2024-03-21 02:25:06,821: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:25:06.823312744Z [2024-03-21 02:25:06,823: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:25:06.823346622Z [2024-03-21 02:25:06,823: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:25:06.823521090Z [2024-03-21 02:25:06,823: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:25:06.823579138Z [2024-03-21 02:25:06,823: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:25:06.823933861Z [2024-03-21 02:25:06,823: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:25:06.824030959Z [2024-03-21 02:25:06,823: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:25:06.914540684Z [2024-03-21 02:25:06,914: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T02:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:25:07.510804838Z [2024-03-21 02:25:07,510: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f0205f13-da4a-483a-89c4-8740accbef89] succeeded in 2.372074925000561s: None
2024-03-21T02:25:07.669313038Z [2024-03-21 02:25:07,669: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1f68905-dbb8-47d1-afaf-3869b3a64280] received
2024-03-21T02:25:07.686542169Z [2024-03-21 02:25:07,686: INFO/ForkPoolWorker-15] [f1f68905-dbb8-47d1-afaf-3869b3a64280] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T02:25:08.004256924Z [2024-03-21 02:25:07,998: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:25:09.323049900Z [2024-03-21 02:25:09,322: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:25:09.326287288Z [2024-03-21 02:25:09,325: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:25:09.357012626Z [2024-03-21 02:25:09,356: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:25:09.358801790Z [2024-03-21 02:25:09,358: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:25:09.358902647Z [2024-03-21 02:25:09,358: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:25:09.359035757Z [2024-03-21 02:25:09,358: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:25:09.359050745Z [2024-03-21 02:25:09,358: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:25:09.363237354Z [2024-03-21 02:25:09,362: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:25:09.363317919Z [2024-03-21 02:25:09,363: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:25:09.482449214Z [2024-03-21 02:25:09,482: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T02:20:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:25:10.273034947Z [2024-03-21 02:25:10,272: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f1f68905-dbb8-47d1-afaf-3869b3a64280] succeeded in 2.6015868579997914s: None
2024-03-21T02:25:10.353864579Z [2024-03-21 02:25:10,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5f915ae-840f-443a-955e-28e3dd313768] received
2024-03-21T02:25:10.376113466Z [2024-03-21 02:25:10,375: INFO/ForkPoolWorker-15] [c5f915ae-840f-443a-955e-28e3dd313768] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:25:10.715355760Z [2024-03-21 02:25:10,711: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:25:12.119711336Z [2024-03-21 02:25:12,119: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:25:12.123148232Z [2024-03-21 02:25:12,122: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:25:12.143664906Z [2024-03-21 02:25:12,143: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:25:12.145042077Z [2024-03-21 02:25:12,144: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:25:12.145208923Z [2024-03-21 02:25:12,145: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:25:12.145392799Z [2024-03-21 02:25:12,145: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:25:12.145497074Z [2024-03-21 02:25:12,145: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:25:12.145780096Z [2024-03-21 02:25:12,145: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:25:12.145812064Z [2024-03-21 02:25:12,145: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:25:12.246266246Z [2024-03-21 02:25:12,245: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T02:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:25:12.842617538Z [2024-03-21 02:25:12,842: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c5f915ae-840f-443a-955e-28e3dd313768] succeeded in 2.4849125139990065s: None
2024-03-21T02:26:01.219826582Z [2024-03-21 02:26:01,219: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84268787-2840-41ae-84ec-866420257248] received
2024-03-21T02:26:01.227046353Z [2024-03-21 02:26:01,226: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f07cd5b1-c6e5-48d7-8860-21e2014954c1] received
2024-03-21T02:26:01.234951135Z [2024-03-21 02:26:01,233: INFO/ForkPoolWorker-15] [84268787-2840-41ae-84ec-866420257248] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:26:01.235567674Z [2024-03-21 02:26:01,235: INFO/ForkPoolWorker-16] [f07cd5b1-c6e5-48d7-8860-21e2014954c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:26:01.236300995Z [2024-03-21 02:26:01,236: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cfe2a11a-f1d5-4b48-8931-f7163b8db1d9] received
2024-03-21T02:26:01.247999815Z [2024-03-21 02:26:01,247: INFO/ForkPoolWorker-1] [cfe2a11a-f1d5-4b48-8931-f7163b8db1d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:26:01.680537906Z [2024-03-21 02:26:01,677: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:26:01.900166253Z [2024-03-21 02:26:01,896: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:26:02.180365691Z [2024-03-21 02:26:02,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7f38586-97c3-43e8-abde-b9f257b92e15] received
2024-03-21T02:26:02.194960791Z [2024-03-21 02:26:02,194: INFO/ForkPoolWorker-2] [f7f38586-97c3-43e8-abde-b9f257b92e15] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:26:02.246658494Z [2024-03-21 02:26:02,244: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:26:02.322456904Z [2024-03-21 02:26:02,317: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:26:02.554469560Z [2024-03-21 02:26:02,553: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T02:26:02.559053760Z [2024-03-21 02:26:02,558: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:26:02.618674195Z [2024-03-21 02:26:02,618: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:26:02.620215172Z [2024-03-21 02:26:02,619: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:26:02.620467554Z [2024-03-21 02:26:02,620: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:26:02.620549035Z [2024-03-21 02:26:02,620: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T02:26:02.620837216Z [2024-03-21 02:26:02,620: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:26:02.764220506Z [2024-03-21 02:26:02,763: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:26:02.826113535Z [2024-03-21 02:26:02,819: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:26:03.078622125Z [2024-03-21 02:26:03,078: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f07cd5b1-c6e5-48d7-8860-21e2014954c1] succeeded in 1.8498540220007271s: None
2024-03-21T02:26:03.691947216Z [2024-03-21 02:26:03,691: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cfe2a11a-f1d5-4b48-8931-f7163b8db1d9] succeeded in 2.451687826000125s: None
2024-03-21T02:26:03.994765642Z [2024-03-21 02:26:03,994: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:26:03.998284139Z [2024-03-21 02:26:03,997: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:26:04.026771907Z [2024-03-21 02:26:04,026: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:26:04.029611812Z [2024-03-21 02:26:04,029: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:26:04.029832891Z [2024-03-21 02:26:04,029: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:26:04.030015502Z [2024-03-21 02:26:04,029: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:26:04.030109559Z [2024-03-21 02:26:04,030: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:26:04.030425291Z [2024-03-21 02:26:04,030: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:26:04.030519903Z [2024-03-21 02:26:04,030: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:26:04.079540747Z [2024-03-21 02:26:04,079: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T02:26:04.083062408Z [2024-03-21 02:26:04,082: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:26:04.110030119Z [2024-03-21 02:26:04,109: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:26:04.111320519Z [2024-03-21 02:26:04,111: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:26:04.111449495Z [2024-03-21 02:26:04,111: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:26:04.111633227Z [2024-03-21 02:26:04,111: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:26:04.111741045Z [2024-03-21 02:26:04,111: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T02:26:04.112097153Z [2024-03-21 02:26:04,111: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:26:04.112223526Z [2024-03-21 02:26:04,112: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:26:04.121288082Z [2024-03-21 02:26:04,121: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:26:04.192570443Z [2024-03-21 02:26:04,192: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:26:08.325965414Z [2024-03-21 02:26:08,325: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[84268787-2840-41ae-84ec-866420257248] succeeded in 7.102504136000789s: None
2024-03-21T02:26:08.922707332Z [2024-03-21 02:26:08,922: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f7f38586-97c3-43e8-abde-b9f257b92e15] succeeded in 6.735435389999111s: None
2024-03-21T02:27:00.651106144Z [2024-03-21 02:27:00,650: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27070d9a-8eac-40db-a10f-aff7cba40995] received
2024-03-21T02:27:00.664640380Z [2024-03-21 02:27:00,664: INFO/ForkPoolWorker-15] [27070d9a-8eac-40db-a10f-aff7cba40995] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:27:00.672153948Z [2024-03-21 02:27:00,671: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a11603e-e7a1-46a6-bb0e-05973fdcb102] received
2024-03-21T02:27:00.684083852Z [2024-03-21 02:27:00,683: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a552d2b4-40ca-486d-9daa-e35a1ea9b164] received
2024-03-21T02:27:00.687450383Z [2024-03-21 02:27:00,687: INFO/ForkPoolWorker-16] [5a11603e-e7a1-46a6-bb0e-05973fdcb102] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:27:00.699884888Z [2024-03-21 02:27:00,699: INFO/ForkPoolWorker-1] [a552d2b4-40ca-486d-9daa-e35a1ea9b164] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:27:00.970258744Z [2024-03-21 02:27:00,965: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:27:01.015972534Z [2024-03-21 02:27:01,013: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:27:01.028436843Z [2024-03-21 02:27:01,025: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:27:01.254398961Z [2024-03-21 02:27:01,253: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T02:27:01.258423021Z [2024-03-21 02:27:01,258: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:27:01.289213541Z [2024-03-21 02:27:01,288: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:27:01.291077441Z [2024-03-21 02:27:01,290: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:27:01.291099629Z [2024-03-21 02:27:01,290: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:27:01.291169267Z [2024-03-21 02:27:01,291: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T02:27:01.291356391Z [2024-03-21 02:27:01,291: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:27:01.428289553Z [2024-03-21 02:27:01,428: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:27:02.095752857Z [2024-03-21 02:27:02,095: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a552d2b4-40ca-486d-9daa-e35a1ea9b164] succeeded in 1.4095816959998047s: None
2024-03-21T02:27:02.146326036Z [2024-03-21 02:27:02,145: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:27:02.149813239Z [2024-03-21 02:27:02,149: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:27:02.179663627Z [2024-03-21 02:27:02,179: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:27:02.181579948Z [2024-03-21 02:27:02,181: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:27:02.181850644Z [2024-03-21 02:27:02,181: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:27:02.182085627Z [2024-03-21 02:27:02,181: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:27:02.182241064Z [2024-03-21 02:27:02,182: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:27:02.182637282Z [2024-03-21 02:27:02,182: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:27:02.183253716Z [2024-03-21 02:27:02,183: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:27:02.280478531Z [2024-03-21 02:27:02,279: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:27:02.356490184Z [2024-03-21 02:27:02,353: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:27:02.358396484Z [2024-03-21 02:27:02,357: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:27:02.421785105Z [2024-03-21 02:27:02,421: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:27:02.425640861Z [2024-03-21 02:27:02,425: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:27:02.425797440Z [2024-03-21 02:27:02,425: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:27:02.426068128Z [2024-03-21 02:27:02,425: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:27:02.426223313Z [2024-03-21 02:27:02,426: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:27:02.426589152Z [2024-03-21 02:27:02,426: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:27:02.427220719Z [2024-03-21 02:27:02,426: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:27:02.543171427Z [2024-03-21 02:27:02,542: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:27:04.098381040Z [2024-03-21 02:27:04,097: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5a11603e-e7a1-46a6-bb0e-05973fdcb102] succeeded in 3.4235834629998863s: None
2024-03-21T02:27:04.160932336Z [2024-03-21 02:27:04,160: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[27070d9a-8eac-40db-a10f-aff7cba40995] succeeded in 3.5071258719999605s: None
2024-03-21T02:28:00.980105475Z [2024-03-21 02:28:00,979: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b460804f-132b-462f-b68b-2561244ebafd] received
2024-03-21T02:28:00.984888293Z [2024-03-21 02:28:00,984: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b874a967-abf2-49e7-a0cc-20868572d85d] received
2024-03-21T02:28:00.987799731Z [2024-03-21 02:28:00,987: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c3c920d-a412-465b-ac07-709f8e7af41f] received
2024-03-21T02:28:00.993865921Z [2024-03-21 02:28:00,993: INFO/ForkPoolWorker-15] [b460804f-132b-462f-b68b-2561244ebafd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:28:00.996188076Z [2024-03-21 02:28:00,995: INFO/ForkPoolWorker-1] [4c3c920d-a412-465b-ac07-709f8e7af41f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:28:00.999631037Z [2024-03-21 02:28:00,999: INFO/ForkPoolWorker-16] [b874a967-abf2-49e7-a0cc-20868572d85d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:28:01.014509874Z [2024-03-21 02:28:01,014: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b161b844-4985-4b69-bf9e-fdc544c82735] received
2024-03-21T02:28:01.023567104Z [2024-03-21 02:28:01,023: INFO/ForkPoolWorker-2] [b161b844-4985-4b69-bf9e-fdc544c82735] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:28:01.445795452Z [2024-03-21 02:28:01,442: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:28:01.521521176Z [2024-03-21 02:28:01,517: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:28:01.592334244Z [2024-03-21 02:28:01,577: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:28:01.615338610Z [2024-03-21 02:28:01,609: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:28:01.688494802Z [2024-03-21 02:28:01,686: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T02:28:01.698856141Z [2024-03-21 02:28:01,690: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:28:01.719713550Z [2024-03-21 02:28:01,719: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:28:01.723358818Z [2024-03-21 02:28:01,723: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:28:01.723463325Z [2024-03-21 02:28:01,723: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:28:01.723469422Z [2024-03-21 02:28:01,723: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T02:28:01.723695712Z [2024-03-21 02:28:01,723: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:28:01.816455708Z [2024-03-21 02:28:01,815: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:28:02.083019736Z [2024-03-21 02:28:02,082: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:28:02.875675685Z [2024-03-21 02:28:02,875: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b161b844-4985-4b69-bf9e-fdc544c82735] succeeded in 1.859143043999211s: None
2024-03-21T02:28:03.024369724Z [2024-03-21 02:28:03,023: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b460804f-132b-462f-b68b-2561244ebafd] succeeded in 2.041508464999424s: None
2024-03-21T02:28:03.552473216Z [2024-03-21 02:28:03,552: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:28:03.556055371Z [2024-03-21 02:28:03,555: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:28:03.586428940Z [2024-03-21 02:28:03,585: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:28:03.587733965Z [2024-03-21 02:28:03,587: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:28:03.590781184Z [2024-03-21 02:28:03,590: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:28:03.590969324Z [2024-03-21 02:28:03,590: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:28:03.591099475Z [2024-03-21 02:28:03,590: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:28:03.591412201Z [2024-03-21 02:28:03,591: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:28:03.591545958Z [2024-03-21 02:28:03,591: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:28:03.592037184Z [2024-03-21 02:28:03,591: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:28:03.592409971Z [2024-03-21 02:28:03,592: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:28:03.615044754Z [2024-03-21 02:28:03,614: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:28:03.616234621Z [2024-03-21 02:28:03,615: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:28:03.616251596Z [2024-03-21 02:28:03,616: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:28:03.616413649Z [2024-03-21 02:28:03,616: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:28:03.616492191Z [2024-03-21 02:28:03,616: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:28:03.616762859Z [2024-03-21 02:28:03,616: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:28:03.616773313Z [2024-03-21 02:28:03,616: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:28:03.716804295Z [2024-03-21 02:28:03,716: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:28:03.735466170Z [2024-03-21 02:28:03,735: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:28:06.499016833Z [2024-03-21 02:28:06,498: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4c3c920d-a412-465b-ac07-709f8e7af41f] succeeded in 5.5095430170003965s: None
2024-03-21T02:28:06.643292920Z [2024-03-21 02:28:06,642: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b874a967-abf2-49e7-a0cc-20868572d85d] succeeded in 5.655188263999662s: None
2024-03-21T02:29:00.355179442Z [2024-03-21 02:29:00,354: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8d402ad-14f9-4e4d-837a-ee1f3d4493c1] received
2024-03-21T02:29:00.358014056Z [2024-03-21 02:29:00,357: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bceb20d0-64de-49d8-a552-1b1c053e9518] received
2024-03-21T02:29:00.364343912Z [2024-03-21 02:29:00,364: INFO/ForkPoolWorker-15] [c8d402ad-14f9-4e4d-837a-ee1f3d4493c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:29:00.366644977Z [2024-03-21 02:29:00,366: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bbaa99f4-244b-499f-826e-7666613cc652] received
2024-03-21T02:29:00.371889864Z [2024-03-21 02:29:00,371: INFO/ForkPoolWorker-16] [bceb20d0-64de-49d8-a552-1b1c053e9518] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:29:00.374676599Z [2024-03-21 02:29:00,374: INFO/ForkPoolWorker-1] [bbaa99f4-244b-499f-826e-7666613cc652] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:29:00.646783315Z [2024-03-21 02:29:00,643: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:29:00.673429998Z [2024-03-21 02:29:00,669: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:29:00.722215629Z [2024-03-21 02:29:00,718: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:29:00.917033853Z [2024-03-21 02:29:00,916: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T02:29:00.922665313Z [2024-03-21 02:29:00,922: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:29:00.945573417Z [2024-03-21 02:29:00,945: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:29:00.948157933Z [2024-03-21 02:29:00,947: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:29:00.948608587Z [2024-03-21 02:29:00,948: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:29:00.948806688Z [2024-03-21 02:29:00,948: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T02:29:00.949237392Z [2024-03-21 02:29:00,949: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:29:01.066741604Z [2024-03-21 02:29:01,066: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:29:01.786736874Z [2024-03-21 02:29:01,786: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:29:01.790148469Z [2024-03-21 02:29:01,789: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:29:01.838299116Z [2024-03-21 02:29:01,838: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:29:01.853356393Z [2024-03-21 02:29:01,852: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:29:01.853658586Z [2024-03-21 02:29:01,853: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:29:01.854204033Z [2024-03-21 02:29:01,853: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:29:01.854460820Z [2024-03-21 02:29:01,854: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:29:01.855068111Z [2024-03-21 02:29:01,854: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:29:01.856178525Z [2024-03-21 02:29:01,855: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:29:01.896405926Z [2024-03-21 02:29:01,896: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bbaa99f4-244b-499f-826e-7666613cc652] succeeded in 1.528383004000716s: None
2024-03-21T02:29:01.966130106Z [2024-03-21 02:29:01,965: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:29:01.968439619Z [2024-03-21 02:29:01,968: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:29:01.972063283Z [2024-03-21 02:29:01,971: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:29:01.998852363Z [2024-03-21 02:29:01,998: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:29:02.000963467Z [2024-03-21 02:29:02,000: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:29:02.001719548Z [2024-03-21 02:29:02,001: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:29:02.002031332Z [2024-03-21 02:29:02,001: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:29:02.002542052Z [2024-03-21 02:29:02,002: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:29:02.002970776Z [2024-03-21 02:29:02,002: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:29:02.003744056Z [2024-03-21 02:29:02,003: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:29:02.118757032Z [2024-03-21 02:29:02,118: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:29:03.606287283Z [2024-03-21 02:29:03,605: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bceb20d0-64de-49d8-a552-1b1c053e9518] succeeded in 3.2441431429997465s: None
2024-03-21T02:29:04.135053206Z [2024-03-21 02:29:04,134: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c8d402ad-14f9-4e4d-837a-ee1f3d4493c1] succeeded in 3.7754042819997267s: None
2024-03-21T02:30:01.022831811Z [2024-03-21 02:30:01,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c67a87f-16c8-4cc6-8a68-59b81dfcc4af] received
2024-03-21T02:30:01.025417586Z [2024-03-21 02:30:01,025: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fdaf6d4-767c-4c9c-9095-f2e85ad65d7f] received
2024-03-21T02:30:01.029603628Z [2024-03-21 02:30:01,029: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65f1643f-a650-431c-a85a-cda39f4f08d2] received
2024-03-21T02:30:01.031478246Z [2024-03-21 02:30:01,031: INFO/ForkPoolWorker-15] [1c67a87f-16c8-4cc6-8a68-59b81dfcc4af] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:30:01.031771123Z [2024-03-21 02:30:01,031: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca63fada-39ca-44b0-8288-57c6fe8d3349] received
2024-03-21T02:30:01.034294779Z [2024-03-21 02:30:01,034: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ddad691d-cfcf-49ed-875f-59369ec9b5a6] received
2024-03-21T02:30:01.056574082Z [2024-03-21 02:30:01,056: INFO/ForkPoolWorker-16] [9fdaf6d4-767c-4c9c-9095-f2e85ad65d7f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:30:01.059239832Z [2024-03-21 02:30:01,058: INFO/ForkPoolWorker-3] [ddad691d-cfcf-49ed-875f-59369ec9b5a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:30:01.063137970Z [2024-03-21 02:30:01,062: INFO/ForkPoolWorker-1] [65f1643f-a650-431c-a85a-cda39f4f08d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:30:01.087474407Z [2024-03-21 02:30:01,087: INFO/ForkPoolWorker-2] [ca63fada-39ca-44b0-8288-57c6fe8d3349] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:30:01.442773292Z [2024-03-21 02:30:01,438: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:30:01.511372763Z [2024-03-21 02:30:01,507: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:30:01.531383383Z [2024-03-21 02:30:01,528: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:30:01.582389626Z [2024-03-21 02:30:01,568: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:30:01.807943553Z [2024-03-21 02:30:01,800: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:30:01.986305986Z [2024-03-21 02:30:01,985: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T02:30:02.005032469Z [2024-03-21 02:30:01,999: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:30:02.072699011Z [2024-03-21 02:30:02,072: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:30:02.077014075Z [2024-03-21 02:30:02,076: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:30:02.077599886Z [2024-03-21 02:30:02,077: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:30:02.077859138Z [2024-03-21 02:30:02,077: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T02:30:02.078315350Z [2024-03-21 02:30:02,078: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:30:02.302188901Z [2024-03-21 02:30:02,300: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:30:02.384016743Z [2024-03-21 02:30:02,383: INFO/ForkPoolWorker-2] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:30:03.251539016Z [2024-03-21 02:30:03,251: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ca63fada-39ca-44b0-8288-57c6fe8d3349] succeeded in 2.2055359999994835s: None
2024-03-21T02:30:03.283990956Z [2024-03-21 02:30:03,283: INFO/ForkPoolWorker-3] Getting VIM list
2024-03-21T02:30:03.287879260Z [2024-03-21 02:30:03,287: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:30:03.293069162Z [2024-03-21 02:30:03,292: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:30:03.297571753Z [2024-03-21 02:30:03,297: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:30:03.325753483Z [2024-03-21 02:30:03,325: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-21T02:30:03.329215377Z [2024-03-21 02:30:03,328: INFO/ForkPoolWorker-3] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:30:03.329595118Z [2024-03-21 02:30:03,329: INFO/ForkPoolWorker-3] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:30:03.329887608Z [2024-03-21 02:30:03,329: INFO/ForkPoolWorker-3] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:30:03.330089524Z [2024-03-21 02:30:03,329: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-03-21T02:30:03.330627608Z [2024-03-21 02:30:03,330: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:30:03.331020744Z [2024-03-21 02:30:03,330: INFO/ForkPoolWorker-3] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:30:03.332921150Z [2024-03-21 02:30:03,332: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:30:03.341718944Z [2024-03-21 02:30:03,341: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:30:03.345474482Z [2024-03-21 02:30:03,344: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:30:03.345496339Z [2024-03-21 02:30:03,344: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:30:03.345501371Z [2024-03-21 02:30:03,344: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:30:03.345525696Z [2024-03-21 02:30:03,345: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:30:03.345529776Z [2024-03-21 02:30:03,345: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:30:03.373524587Z [2024-03-21 02:30:03,373: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1c67a87f-16c8-4cc6-8a68-59b81dfcc4af] succeeded in 2.3490646459995332s: None
2024-03-21T02:30:03.432433227Z [2024-03-21 02:30:03,432: INFO/ForkPoolWorker-3] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:30:03.668496148Z [2024-03-21 02:30:03,668: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:30:04.064707456Z [2024-03-21 02:30:04,064: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:30:04.069410716Z [2024-03-21 02:30:04,068: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:30:04.100478530Z [2024-03-21 02:30:04,100: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:30:04.103169249Z [2024-03-21 02:30:04,102: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:30:04.103427224Z [2024-03-21 02:30:04,103: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:30:04.103819159Z [2024-03-21 02:30:04,103: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:30:04.104061165Z [2024-03-21 02:30:04,103: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:30:04.104877731Z [2024-03-21 02:30:04,104: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:30:04.105157141Z [2024-03-21 02:30:04,104: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:30:04.217802696Z [2024-03-21 02:30:04,217: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T02:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:30:04.916566278Z [2024-03-21 02:30:04,915: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[65f1643f-a650-431c-a85a-cda39f4f08d2] succeeded in 3.8834231969995017s: None
2024-03-21T02:30:05.066549903Z [2024-03-21 02:30:05,066: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[ddad691d-cfcf-49ed-875f-59369ec9b5a6] succeeded in 4.020308007000494s: None
2024-03-21T02:30:05.552741371Z [2024-03-21 02:30:05,552: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07d3290a-320a-4194-8d8f-1f6ee4c52e11] received
2024-03-21T02:30:05.561981833Z [2024-03-21 02:30:05,561: INFO/ForkPoolWorker-15] [07d3290a-320a-4194-8d8f-1f6ee4c52e11] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:30:05.780513076Z [2024-03-21 02:30:05,780: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9fdaf6d4-767c-4c9c-9095-f2e85ad65d7f] succeeded in 4.753411550998862s: None
2024-03-21T02:30:05.878099937Z [2024-03-21 02:30:05,875: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:30:07.058434956Z [2024-03-21 02:30:07,058: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:30:07.062333144Z [2024-03-21 02:30:07,061: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:30:07.080234694Z [2024-03-21 02:30:07,079: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:30:07.082267358Z [2024-03-21 02:30:07,081: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:30:07.082538035Z [2024-03-21 02:30:07,082: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:30:07.082878713Z [2024-03-21 02:30:07,082: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:30:07.083092453Z [2024-03-21 02:30:07,082: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:30:07.083714041Z [2024-03-21 02:30:07,083: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:30:07.083882406Z [2024-03-21 02:30:07,083: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:30:07.183148960Z [2024-03-21 02:30:07,182: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T02:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:30:07.797336876Z [2024-03-21 02:30:07,796: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[07d3290a-320a-4194-8d8f-1f6ee4c52e11] succeeded in 2.2426745319990005s: None
2024-03-21T02:30:07.902947325Z [2024-03-21 02:30:07,902: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b875229c-33d0-4150-93f8-f86dad879a50] received
2024-03-21T02:30:07.910390507Z [2024-03-21 02:30:07,910: INFO/ForkPoolWorker-15] [b875229c-33d0-4150-93f8-f86dad879a50] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T02:30:08.191606328Z [2024-03-21 02:30:08,186: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:30:09.304414455Z [2024-03-21 02:30:09,303: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:30:09.307745511Z [2024-03-21 02:30:09,307: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:30:09.327654619Z [2024-03-21 02:30:09,327: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:30:09.329282059Z [2024-03-21 02:30:09,328: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:30:09.329544375Z [2024-03-21 02:30:09,329: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:30:09.329765814Z [2024-03-21 02:30:09,329: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:30:09.329961554Z [2024-03-21 02:30:09,329: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:30:09.330338281Z [2024-03-21 02:30:09,330: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:30:09.330537270Z [2024-03-21 02:30:09,330: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:30:09.458255833Z [2024-03-21 02:30:09,457: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T02:25:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:30:10.026323895Z [2024-03-21 02:30:10,025: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b875229c-33d0-4150-93f8-f86dad879a50] succeeded in 2.1208371319989965s: None
2024-03-21T02:30:10.231374571Z [2024-03-21 02:30:10,231: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82875e5c-e25b-4eab-891c-940be9c30a6b] received
2024-03-21T02:30:10.241354439Z [2024-03-21 02:30:10,241: INFO/ForkPoolWorker-15] [82875e5c-e25b-4eab-891c-940be9c30a6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:30:10.616190719Z [2024-03-21 02:30:10,613: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:30:11.793254811Z [2024-03-21 02:30:11,792: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:30:11.796639189Z [2024-03-21 02:30:11,796: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:30:11.814972379Z [2024-03-21 02:30:11,814: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:30:11.816195015Z [2024-03-21 02:30:11,815: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:30:11.816202849Z [2024-03-21 02:30:11,816: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:30:11.816385457Z [2024-03-21 02:30:11,816: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:30:11.816433413Z [2024-03-21 02:30:11,816: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:30:11.816687803Z [2024-03-21 02:30:11,816: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:30:11.816750963Z [2024-03-21 02:30:11,816: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:30:11.921370904Z [2024-03-21 02:30:11,919: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T02:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:30:12.484900504Z [2024-03-21 02:30:12,484: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[82875e5c-e25b-4eab-891c-940be9c30a6b] succeeded in 2.251452855000025s: None
2024-03-21T02:31:00.837997179Z [2024-03-21 02:31:00,837: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f925489c-dd50-40fa-8588-85596d63957f] received
2024-03-21T02:31:00.839376167Z [2024-03-21 02:31:00,839: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1855fab1-fb0c-433e-bbdc-4e56b6682e71] received
2024-03-21T02:31:00.846060297Z [2024-03-21 02:31:00,845: INFO/ForkPoolWorker-16] [1855fab1-fb0c-433e-bbdc-4e56b6682e71] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:31:00.850114721Z [2024-03-21 02:31:00,849: INFO/ForkPoolWorker-15] [f925489c-dd50-40fa-8588-85596d63957f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:31:00.861973356Z [2024-03-21 02:31:00,861: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42bb903d-a8d2-4b36-8b77-a5a4e5392453] received
2024-03-21T02:31:00.875960472Z [2024-03-21 02:31:00,875: INFO/ForkPoolWorker-1] [42bb903d-a8d2-4b36-8b77-a5a4e5392453] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:31:01.150672201Z [2024-03-21 02:31:01,147: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:31:01.243148556Z [2024-03-21 02:31:01,239: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:31:01.323174810Z [2024-03-21 02:31:01,319: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:31:01.432013147Z [2024-03-21 02:31:01,431: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T02:31:01.436717729Z [2024-03-21 02:31:01,436: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:31:01.461913032Z [2024-03-21 02:31:01,461: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:31:01.463289460Z [2024-03-21 02:31:01,462: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:31:01.463466983Z [2024-03-21 02:31:01,463: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:31:01.463528296Z [2024-03-21 02:31:01,463: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T02:31:01.463896950Z [2024-03-21 02:31:01,463: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:31:01.588817834Z [2024-03-21 02:31:01,588: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:31:02.465793573Z [2024-03-21 02:31:02,465: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[42bb903d-a8d2-4b36-8b77-a5a4e5392453] succeeded in 1.601592750999771s: None
2024-03-21T02:31:02.602273832Z [2024-03-21 02:31:02,601: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:31:02.605609248Z [2024-03-21 02:31:02,605: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:31:02.625161739Z [2024-03-21 02:31:02,624: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:31:02.626619583Z [2024-03-21 02:31:02,626: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:31:02.626680446Z [2024-03-21 02:31:02,626: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:31:02.626816346Z [2024-03-21 02:31:02,626: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:31:02.626878527Z [2024-03-21 02:31:02,626: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:31:02.627223154Z [2024-03-21 02:31:02,627: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:31:02.627266197Z [2024-03-21 02:31:02,627: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:31:02.713451791Z [2024-03-21 02:31:02,713: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:31:03.027171317Z [2024-03-21 02:31:03,026: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:31:03.030793953Z [2024-03-21 02:31:03,030: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:31:03.051722972Z [2024-03-21 02:31:03,051: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:31:03.053450371Z [2024-03-21 02:31:03,053: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:31:03.053888701Z [2024-03-21 02:31:03,053: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:31:03.054175375Z [2024-03-21 02:31:03,053: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:31:03.054265237Z [2024-03-21 02:31:03,054: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:31:03.054598647Z [2024-03-21 02:31:03,054: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:31:03.054722029Z [2024-03-21 02:31:03,054: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:31:03.145163731Z [2024-03-21 02:31:03,144: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:31:04.196359780Z [2024-03-21 02:31:04,195: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f925489c-dd50-40fa-8588-85596d63957f] succeeded in 3.3536329769995064s: None
2024-03-21T02:31:05.606370044Z [2024-03-21 02:31:05,605: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1855fab1-fb0c-433e-bbdc-4e56b6682e71] succeeded in 4.765173710000454s: None
2024-03-21T02:32:00.802613968Z [2024-03-21 02:32:00,802: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0489d871-978d-45a6-a455-a501795422e5] received
2024-03-21T02:32:00.815620703Z [2024-03-21 02:32:00,815: INFO/ForkPoolWorker-15] [0489d871-978d-45a6-a455-a501795422e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:32:00.817027730Z [2024-03-21 02:32:00,816: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[487922fb-f0b6-46c5-bfe1-11939a59b67b] received
2024-03-21T02:32:00.822023786Z [2024-03-21 02:32:00,821: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[630ba75f-f4f0-4599-9b6f-6a4301337a5e] received
2024-03-21T02:32:00.829108690Z [2024-03-21 02:32:00,828: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dea65729-c8a1-4064-ab6f-ff508fc1545f] received
2024-03-21T02:32:00.838282694Z [2024-03-21 02:32:00,837: INFO/ForkPoolWorker-2] [dea65729-c8a1-4064-ab6f-ff508fc1545f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:32:00.838956714Z [2024-03-21 02:32:00,838: INFO/ForkPoolWorker-1] [630ba75f-f4f0-4599-9b6f-6a4301337a5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:32:00.841530521Z [2024-03-21 02:32:00,841: INFO/ForkPoolWorker-16] [487922fb-f0b6-46c5-bfe1-11939a59b67b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:32:01.190983775Z [2024-03-21 02:32:01,187: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:32:01.229493476Z [2024-03-21 02:32:01,225: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:32:01.390757123Z [2024-03-21 02:32:01,385: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:32:01.574560666Z [2024-03-21 02:32:01,570: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:32:01.824831833Z [2024-03-21 02:32:01,824: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:32:01.840534534Z [2024-03-21 02:32:01,839: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T02:32:01.859168114Z [2024-03-21 02:32:01,854: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:32:01.900237022Z [2024-03-21 02:32:01,899: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:32:01.905597787Z [2024-03-21 02:32:01,905: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:32:01.905873012Z [2024-03-21 02:32:01,905: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:32:01.905996157Z [2024-03-21 02:32:01,905: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T02:32:01.906374745Z [2024-03-21 02:32:01,906: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:32:02.043797686Z [2024-03-21 02:32:02,043: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:32:02.689521104Z [2024-03-21 02:32:02,689: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0489d871-978d-45a6-a455-a501795422e5] succeeded in 1.8793908950010518s: None
2024-03-21T02:32:02.832838726Z [2024-03-21 02:32:02,832: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:32:02.836249322Z [2024-03-21 02:32:02,835: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:32:02.884568636Z [2024-03-21 02:32:02,884: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:32:02.886774156Z [2024-03-21 02:32:02,886: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:32:02.886847446Z [2024-03-21 02:32:02,886: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:32:02.887003647Z [2024-03-21 02:32:02,886: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:32:02.887074502Z [2024-03-21 02:32:02,886: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:32:02.889687281Z [2024-03-21 02:32:02,887: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:32:02.889751382Z [2024-03-21 02:32:02,887: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:32:02.889757806Z [2024-03-21 02:32:02,887: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:32:02.892887821Z [2024-03-21 02:32:02,891: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:32:02.912886394Z [2024-03-21 02:32:02,912: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[dea65729-c8a1-4064-ab6f-ff508fc1545f] succeeded in 2.081800325000586s: None
2024-03-21T02:32:02.922659503Z [2024-03-21 02:32:02,922: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:32:02.926437165Z [2024-03-21 02:32:02,926: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:32:02.926900429Z [2024-03-21 02:32:02,926: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:32:02.927309060Z [2024-03-21 02:32:02,926: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:32:02.927611903Z [2024-03-21 02:32:02,927: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:32:02.928103499Z [2024-03-21 02:32:02,927: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:32:02.928924780Z [2024-03-21 02:32:02,928: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:32:03.032175276Z [2024-03-21 02:32:03,031: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:32:03.052916966Z [2024-03-21 02:32:03,052: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:32:04.577998881Z [2024-03-21 02:32:04,577: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[630ba75f-f4f0-4599-9b6f-6a4301337a5e] succeeded in 3.75337054999909s: None
2024-03-21T02:32:04.950391461Z [2024-03-21 02:32:04,949: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[487922fb-f0b6-46c5-bfe1-11939a59b67b] succeeded in 4.119913483998971s: None
2024-03-21T02:33:00.880232716Z [2024-03-21 02:33:00,879: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c49eb899-8c1e-41cf-b36a-331cb2b11b6b] received
2024-03-21T02:33:00.884120422Z [2024-03-21 02:33:00,883: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0df13ccd-4310-4c81-b20c-bfd4fcc21c2a] received
2024-03-21T02:33:00.887974000Z [2024-03-21 02:33:00,887: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa3879b4-356b-4029-9e78-440b21895512] received
2024-03-21T02:33:00.889806239Z [2024-03-21 02:33:00,889: INFO/ForkPoolWorker-15] [c49eb899-8c1e-41cf-b36a-331cb2b11b6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:33:00.899099256Z [2024-03-21 02:33:00,898: INFO/ForkPoolWorker-16] [0df13ccd-4310-4c81-b20c-bfd4fcc21c2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:33:00.908438285Z [2024-03-21 02:33:00,908: INFO/ForkPoolWorker-1] [aa3879b4-356b-4029-9e78-440b21895512] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:33:01.188843489Z [2024-03-21 02:33:01,185: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:33:01.227698278Z [2024-03-21 02:33:01,224: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:33:01.250261878Z [2024-03-21 02:33:01,247: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:33:01.403107835Z [2024-03-21 02:33:01,402: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T02:33:01.407357057Z [2024-03-21 02:33:01,406: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:33:01.432873764Z [2024-03-21 02:33:01,432: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:33:01.435049611Z [2024-03-21 02:33:01,434: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:33:01.435308130Z [2024-03-21 02:33:01,435: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:33:01.435470562Z [2024-03-21 02:33:01,435: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T02:33:01.435789885Z [2024-03-21 02:33:01,435: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:33:01.526582953Z [2024-03-21 02:33:01,526: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:33:02.131831416Z [2024-03-21 02:33:02,131: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0df13ccd-4310-4c81-b20c-bfd4fcc21c2a] succeeded in 1.2453540949991293s: None
2024-03-21T02:33:02.694314754Z [2024-03-21 02:33:02,693: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:33:02.698188313Z [2024-03-21 02:33:02,697: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:33:02.723671116Z [2024-03-21 02:33:02,723: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:33:02.725823599Z [2024-03-21 02:33:02,725: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:33:02.726005384Z [2024-03-21 02:33:02,725: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:33:02.726222811Z [2024-03-21 02:33:02,726: INFO/ForkPoolWorker-15] Read VIM f1cafdd0-7c1f-45b0-89e1-8ac630d7f168 (k8s07_dummy)
2024-03-21T02:33:02.726504755Z [2024-03-21 02:33:02,726: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'f1cafdd0-7c1f-45b0-89e1-8ac630d7f168', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}]
2024-03-21T02:33:02.726645866Z [2024-03-21 02:33:02,726: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:33:02.727054811Z [2024-03-21 02:33:02,726: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:33:02.727198219Z [2024-03-21 02:33:02,727: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:33:02.735019658Z [2024-03-21 02:33:02,734: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:33:02.800411034Z [2024-03-21 02:33:02,799: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:33:02.803915137Z [2024-03-21 02:33:02,803: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:33:02.829909654Z [2024-03-21 02:33:02,829: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:33:02.831316936Z [2024-03-21 02:33:02,831: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:33:02.831328721Z [2024-03-21 02:33:02,831: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:33:02.831440042Z [2024-03-21 02:33:02,831: INFO/ForkPoolWorker-1] Read VIM f1cafdd0-7c1f-45b0-89e1-8ac630d7f168 (k8s07_dummy)
2024-03-21T02:33:02.831601285Z [2024-03-21 02:33:02,831: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'f1cafdd0-7c1f-45b0-89e1-8ac630d7f168', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}]
2024-03-21T02:33:02.831632710Z [2024-03-21 02:33:02,831: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:33:02.831944135Z [2024-03-21 02:33:02,831: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:33:02.832087319Z [2024-03-21 02:33:02,831: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:33:02.837655448Z [2024-03-21 02:33:02,837: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:33:02.857157185Z [2024-03-21 02:33:02,856: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:33:02.938832400Z [2024-03-21 02:33:02,938: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:33:04.460256071Z [2024-03-21 02:33:04,459: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aa3879b4-356b-4029-9e78-440b21895512] succeeded in 3.569964648999303s: None
2024-03-21T02:33:04.866667602Z [2024-03-21 02:33:04,866: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c49eb899-8c1e-41cf-b36a-331cb2b11b6b] succeeded in 3.9845783389991993s: None
2024-03-21T02:34:00.776343770Z [2024-03-21 02:34:00,776: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45eee45d-c169-445f-9e1c-3657b8774d2b] received
2024-03-21T02:34:00.778413210Z [2024-03-21 02:34:00,778: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b373e03b-4f4c-4069-b327-640263f913fa] received
2024-03-21T02:34:00.779937381Z [2024-03-21 02:34:00,779: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5459a07f-0ca7-4edf-a495-1f0e0aa858f6] received
2024-03-21T02:34:00.781641201Z [2024-03-21 02:34:00,781: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9cc2fe3b-00d4-4e62-8108-0059142981b6] received
2024-03-21T02:34:00.787092675Z [2024-03-21 02:34:00,786: INFO/ForkPoolWorker-15] [45eee45d-c169-445f-9e1c-3657b8774d2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:34:00.789982131Z [2024-03-21 02:34:00,789: INFO/ForkPoolWorker-16] [b373e03b-4f4c-4069-b327-640263f913fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:34:00.790766780Z [2024-03-21 02:34:00,790: INFO/ForkPoolWorker-1] [5459a07f-0ca7-4edf-a495-1f0e0aa858f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:34:00.794608660Z [2024-03-21 02:34:00,794: INFO/ForkPoolWorker-2] [9cc2fe3b-00d4-4e62-8108-0059142981b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:34:01.124146953Z [2024-03-21 02:34:01,121: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:34:01.232131596Z [2024-03-21 02:34:01,229: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:34:01.275872335Z [2024-03-21 02:34:01,272: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:34:01.289936150Z [2024-03-21 02:34:01,286: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:34:01.454879718Z [2024-03-21 02:34:01,454: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T02:34:01.466064934Z [2024-03-21 02:34:01,465: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:34:01.480801920Z [2024-03-21 02:34:01,480: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:34:01.517606053Z [2024-03-21 02:34:01,517: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:34:01.519192895Z [2024-03-21 02:34:01,518: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:34:01.519380108Z [2024-03-21 02:34:01,519: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:34:01.519511953Z [2024-03-21 02:34:01,519: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T02:34:01.520128739Z [2024-03-21 02:34:01,519: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:34:01.614855591Z [2024-03-21 02:34:01,614: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:34:02.564905704Z [2024-03-21 02:34:02,563: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[45eee45d-c169-445f-9e1c-3657b8774d2b] succeeded in 1.7859617079993768s: None
2024-03-21T02:34:02.658062919Z [2024-03-21 02:34:02,657: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9cc2fe3b-00d4-4e62-8108-0059142981b6] succeeded in 1.8740103730015107s: None
2024-03-21T02:34:03.129937109Z [2024-03-21 02:34:03,129: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:34:03.133990000Z [2024-03-21 02:34:03,133: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:34:03.154780821Z [2024-03-21 02:34:03,154: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:34:03.156290080Z [2024-03-21 02:34:03,156: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:34:03.156600469Z [2024-03-21 02:34:03,156: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:34:03.156815118Z [2024-03-21 02:34:03,156: INFO/ForkPoolWorker-16] Read VIM f1cafdd0-7c1f-45b0-89e1-8ac630d7f168 (k8s07_dummy)
2024-03-21T02:34:03.157162233Z [2024-03-21 02:34:03,156: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'f1cafdd0-7c1f-45b0-89e1-8ac630d7f168', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}]
2024-03-21T02:34:03.157330018Z [2024-03-21 02:34:03,157: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:34:03.157715096Z [2024-03-21 02:34:03,157: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:34:03.158309146Z [2024-03-21 02:34:03,158: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:34:03.163151947Z [2024-03-21 02:34:03,162: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:34:03.230598665Z [2024-03-21 02:34:03,230: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:34:03.234160934Z [2024-03-21 02:34:03,233: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:34:03.246155009Z [2024-03-21 02:34:03,245: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:34:03.253611116Z [2024-03-21 02:34:03,253: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:34:03.255087211Z [2024-03-21 02:34:03,254: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:34:03.255201360Z [2024-03-21 02:34:03,254: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:34:03.255216071Z [2024-03-21 02:34:03,255: INFO/ForkPoolWorker-1] Read VIM f1cafdd0-7c1f-45b0-89e1-8ac630d7f168 (k8s07_dummy)
2024-03-21T02:34:03.255385555Z [2024-03-21 02:34:03,255: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'f1cafdd0-7c1f-45b0-89e1-8ac630d7f168', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}]
2024-03-21T02:34:03.255438736Z [2024-03-21 02:34:03,255: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:34:03.255718573Z [2024-03-21 02:34:03,255: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:34:03.256749099Z [2024-03-21 02:34:03,256: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:34:03.262586405Z [2024-03-21 02:34:03,262: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:34:03.374801953Z [2024-03-21 02:34:03,374: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:34:04.776252483Z [2024-03-21 02:34:04,775: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b373e03b-4f4c-4069-b327-640263f913fa] succeeded in 3.9960686649992567s: None
2024-03-21T02:34:05.822005040Z [2024-03-21 02:34:05,821: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5459a07f-0ca7-4edf-a495-1f0e0aa858f6] succeeded in 5.040509340999051s: None
2024-03-21T02:35:01.266863231Z [2024-03-21 02:35:01,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6e1069f-1f8a-4ec6-9938-255da466b2d3] received
2024-03-21T02:35:01.270256255Z [2024-03-21 02:35:01,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63a4ca0b-54e7-4760-8178-3ee16776777b] received
2024-03-21T02:35:01.275496027Z [2024-03-21 02:35:01,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78be9ee4-8818-414a-9df7-d9773e41a840] received
2024-03-21T02:35:01.278318496Z [2024-03-21 02:35:01,278: INFO/ForkPoolWorker-16] [63a4ca0b-54e7-4760-8178-3ee16776777b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:35:01.282678641Z [2024-03-21 02:35:01,282: INFO/ForkPoolWorker-1] [78be9ee4-8818-414a-9df7-d9773e41a840] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:35:01.288966348Z [2024-03-21 02:35:01,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e91b86d-6ca5-4c9f-8ce1-c27777402123] received
2024-03-21T02:35:01.288994744Z [2024-03-21 02:35:01,288: INFO/ForkPoolWorker-15] [b6e1069f-1f8a-4ec6-9938-255da466b2d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:35:01.296464728Z [2024-03-21 02:35:01,296: INFO/ForkPoolWorker-2] [0e91b86d-6ca5-4c9f-8ce1-c27777402123] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:35:01.717382103Z [2024-03-21 02:35:01,712: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:35:01.854364895Z [2024-03-21 02:35:01,846: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:35:01.917001516Z [2024-03-21 02:35:01,916: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T02:35:01.926637199Z [2024-03-21 02:35:01,926: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:35:01.939897712Z [2024-03-21 02:35:01,936: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:35:02.004330275Z [2024-03-21 02:35:02,004: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:35:02.010286357Z [2024-03-21 02:35:02,009: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:35:02.011105819Z [2024-03-21 02:35:02,010: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:35:02.013654682Z [2024-03-21 02:35:02,013: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T02:35:02.014063664Z [2024-03-21 02:35:02,013: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:35:02.050533011Z [2024-03-21 02:35:02,047: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:35:02.170526371Z [2024-03-21 02:35:02,170: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:35:03.301880097Z [2024-03-21 02:35:03,301: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[63a4ca0b-54e7-4760-8178-3ee16776777b] succeeded in 2.030177590999301s: None
2024-03-21T02:35:03.489920774Z [2024-03-21 02:35:03,489: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T02:35:03.493485479Z [2024-03-21 02:35:03,492: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:35:03.514604135Z [2024-03-21 02:35:03,514: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:35:03.516130911Z [2024-03-21 02:35:03,515: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:35:03.516185077Z [2024-03-21 02:35:03,516: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:35:03.516410763Z [2024-03-21 02:35:03,516: INFO/ForkPoolWorker-2] Read VIM f1cafdd0-7c1f-45b0-89e1-8ac630d7f168 (k8s07_dummy)
2024-03-21T02:35:03.516564725Z [2024-03-21 02:35:03,516: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'f1cafdd0-7c1f-45b0-89e1-8ac630d7f168', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}]
2024-03-21T02:35:03.516824856Z [2024-03-21 02:35:03,516: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T02:35:03.517562447Z [2024-03-21 02:35:03,517: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:35:03.517576904Z [2024-03-21 02:35:03,517: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:35:03.522387793Z [2024-03-21 02:35:03,522: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:35:03.622317378Z [2024-03-21 02:35:03,621: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:35:03.784442179Z [2024-03-21 02:35:03,784: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:35:03.788292361Z [2024-03-21 02:35:03,787: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:35:03.818052924Z [2024-03-21 02:35:03,817: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:35:03.819846371Z [2024-03-21 02:35:03,819: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:35:03.820050075Z [2024-03-21 02:35:03,819: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:35:03.820276605Z [2024-03-21 02:35:03,820: INFO/ForkPoolWorker-15] Read VIM f1cafdd0-7c1f-45b0-89e1-8ac630d7f168 (k8s07_dummy)
2024-03-21T02:35:03.820522428Z [2024-03-21 02:35:03,820: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'f1cafdd0-7c1f-45b0-89e1-8ac630d7f168', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}]
2024-03-21T02:35:03.820641262Z [2024-03-21 02:35:03,820: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:35:03.821020425Z [2024-03-21 02:35:03,820: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:35:03.821161427Z [2024-03-21 02:35:03,820: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:35:03.828552079Z [2024-03-21 02:35:03,828: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:35:03.910927707Z [2024-03-21 02:35:03,910: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:35:03.917919798Z [2024-03-21 02:35:03,917: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:35:03.967971897Z [2024-03-21 02:35:03,967: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:35:03.974365689Z [2024-03-21 02:35:03,974: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:35:03.975227088Z [2024-03-21 02:35:03,974: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:35:03.976685053Z [2024-03-21 02:35:03,975: INFO/ForkPoolWorker-1] Read VIM f1cafdd0-7c1f-45b0-89e1-8ac630d7f168 (k8s07_dummy)
2024-03-21T02:35:03.977101326Z [2024-03-21 02:35:03,976: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'f1cafdd0-7c1f-45b0-89e1-8ac630d7f168', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}]
2024-03-21T02:35:03.977293726Z [2024-03-21 02:35:03,977: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:35:03.977918009Z [2024-03-21 02:35:03,977: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:35:03.978508032Z [2024-03-21 02:35:03,977: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:35:03.997427677Z [2024-03-21 02:35:03,996: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:35:04.022896266Z [2024-03-21 02:35:04,022: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:35:04.122739841Z [2024-03-21 02:35:04,122: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T02:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:35:04.814156990Z [2024-03-21 02:35:04,813: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[78be9ee4-8818-414a-9df7-d9773e41a840] succeeded in 3.537004831001468s: None
2024-03-21T02:35:05.206260607Z [2024-03-21 02:35:05,204: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[764017e2-d318-4f8a-8b1e-a2336f4edf68] received
2024-03-21T02:35:05.214474549Z [2024-03-21 02:35:05,214: INFO/ForkPoolWorker-16] [764017e2-d318-4f8a-8b1e-a2336f4edf68] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:35:05.523424415Z [2024-03-21 02:35:05,519: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:35:05.587617980Z [2024-03-21 02:35:05,586: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b6e1069f-1f8a-4ec6-9938-255da466b2d3] succeeded in 4.313581520000298s: None
2024-03-21T02:35:06.242395047Z [2024-03-21 02:35:06,242: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0e91b86d-6ca5-4c9f-8ce1-c27777402123] succeeded in 4.951886513001227s: None
2024-03-21T02:35:06.933488996Z [2024-03-21 02:35:06,932: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:35:06.937164693Z [2024-03-21 02:35:06,936: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:35:06.966795493Z [2024-03-21 02:35:06,966: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:35:06.968926856Z [2024-03-21 02:35:06,968: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:35:06.969178040Z [2024-03-21 02:35:06,968: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:35:06.969337054Z [2024-03-21 02:35:06,969: INFO/ForkPoolWorker-16] Read VIM f1cafdd0-7c1f-45b0-89e1-8ac630d7f168 (k8s07_dummy)
2024-03-21T02:35:06.969614855Z [2024-03-21 02:35:06,969: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'f1cafdd0-7c1f-45b0-89e1-8ac630d7f168', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}]
2024-03-21T02:35:06.969722825Z [2024-03-21 02:35:06,969: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:35:06.970147589Z [2024-03-21 02:35:06,969: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:35:06.970277635Z [2024-03-21 02:35:06,970: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:35:06.977680085Z [2024-03-21 02:35:06,977: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:35:07.061032720Z [2024-03-21 02:35:07,060: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T02:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:35:07.659454715Z [2024-03-21 02:35:07,658: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[764017e2-d318-4f8a-8b1e-a2336f4edf68] succeeded in 2.4496398719984427s: None
2024-03-21T02:35:08.209359850Z [2024-03-21 02:35:08,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80dbe1fb-1ad1-439f-9497-58e56fad7367] received
2024-03-21T02:35:08.218076443Z [2024-03-21 02:35:08,217: INFO/ForkPoolWorker-15] [80dbe1fb-1ad1-439f-9497-58e56fad7367] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T02:35:08.515211142Z [2024-03-21 02:35:08,510: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:35:09.785089178Z [2024-03-21 02:35:09,784: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:35:09.788684635Z [2024-03-21 02:35:09,787: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:35:09.811721860Z [2024-03-21 02:35:09,811: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:35:09.813077051Z [2024-03-21 02:35:09,812: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:35:09.813094493Z [2024-03-21 02:35:09,812: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:35:09.813098936Z [2024-03-21 02:35:09,812: INFO/ForkPoolWorker-15] Read VIM f1cafdd0-7c1f-45b0-89e1-8ac630d7f168 (k8s07_dummy)
2024-03-21T02:35:09.813103173Z [2024-03-21 02:35:09,812: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'f1cafdd0-7c1f-45b0-89e1-8ac630d7f168', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}]
2024-03-21T02:35:09.813107357Z [2024-03-21 02:35:09,812: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:35:09.813348141Z [2024-03-21 02:35:09,813: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:35:09.813376680Z [2024-03-21 02:35:09,813: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:35:09.819415901Z [2024-03-21 02:35:09,819: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:35:09.911929954Z [2024-03-21 02:35:09,911: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T02:30:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:35:10.478800145Z [2024-03-21 02:35:10,478: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[80dbe1fb-1ad1-439f-9497-58e56fad7367] succeeded in 2.2666784430002735s: None
2024-03-21T02:35:10.541321370Z [2024-03-21 02:35:10,541: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb38deb0-3a9c-4fb7-ab51-f5454fec9af9] received
2024-03-21T02:35:10.559325926Z [2024-03-21 02:35:10,558: INFO/ForkPoolWorker-15] [eb38deb0-3a9c-4fb7-ab51-f5454fec9af9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:35:10.840850558Z [2024-03-21 02:35:10,837: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:35:11.991742924Z [2024-03-21 02:35:11,991: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:35:11.995140082Z [2024-03-21 02:35:11,994: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:35:12.016819153Z [2024-03-21 02:35:12,016: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:35:12.018887189Z [2024-03-21 02:35:12,018: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:35:12.019058661Z [2024-03-21 02:35:12,018: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:35:12.019262967Z [2024-03-21 02:35:12,019: INFO/ForkPoolWorker-15] Read VIM f1cafdd0-7c1f-45b0-89e1-8ac630d7f168 (k8s07_dummy)
2024-03-21T02:35:12.019576064Z [2024-03-21 02:35:12,019: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'f1cafdd0-7c1f-45b0-89e1-8ac630d7f168', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}]
2024-03-21T02:35:12.019771520Z [2024-03-21 02:35:12,019: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:35:12.020551020Z [2024-03-21 02:35:12,020: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:35:12.020736612Z [2024-03-21 02:35:12,020: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:35:12.029679889Z [2024-03-21 02:35:12,029: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:35:12.118325776Z [2024-03-21 02:35:12,118: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T02:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:35:12.647614800Z [2024-03-21 02:35:12,647: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eb38deb0-3a9c-4fb7-ab51-f5454fec9af9] succeeded in 2.098411027000111s: None
2024-03-21T02:36:00.445141478Z [2024-03-21 02:36:00,444: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1803d8bb-6502-4b2b-b9c5-b1c8a36a12df] received
2024-03-21T02:36:00.451528304Z [2024-03-21 02:36:00,451: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7df4f92c-d97e-4b38-b908-2f5d0288dff7] received
2024-03-21T02:36:00.453216116Z [2024-03-21 02:36:00,452: INFO/ForkPoolWorker-15] [1803d8bb-6502-4b2b-b9c5-b1c8a36a12df] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:36:00.454947080Z [2024-03-21 02:36:00,454: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5387e5d-1725-485c-b8a7-a1e7b0fda1b4] received
2024-03-21T02:36:00.462200479Z [2024-03-21 02:36:00,461: INFO/ForkPoolWorker-16] [7df4f92c-d97e-4b38-b908-2f5d0288dff7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:36:00.468851420Z [2024-03-21 02:36:00,468: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ad5714d-fef4-40e3-9042-dcce1ef2d0c6] received
2024-03-21T02:36:00.474008540Z [2024-03-21 02:36:00,469: INFO/ForkPoolWorker-1] [d5387e5d-1725-485c-b8a7-a1e7b0fda1b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:36:00.478156833Z [2024-03-21 02:36:00,477: INFO/ForkPoolWorker-2] [2ad5714d-fef4-40e3-9042-dcce1ef2d0c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:36:00.815862759Z [2024-03-21 02:36:00,811: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:36:00.826741696Z [2024-03-21 02:36:00,823: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:36:00.899399109Z [2024-03-21 02:36:00,895: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:36:00.903175018Z [2024-03-21 02:36:00,894: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:36:01.070465990Z [2024-03-21 02:36:01,069: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T02:36:01.078349606Z [2024-03-21 02:36:01,077: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:36:01.122297831Z [2024-03-21 02:36:01,122: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:36:01.123650096Z [2024-03-21 02:36:01,123: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:36:01.123910243Z [2024-03-21 02:36:01,123: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:36:01.124048178Z [2024-03-21 02:36:01,123: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T02:36:01.124510515Z [2024-03-21 02:36:01,124: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:36:01.206787066Z [2024-03-21 02:36:01,206: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:36:01.253121273Z [2024-03-21 02:36:01,252: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:36:02.053826678Z [2024-03-21 02:36:02,053: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1803d8bb-6502-4b2b-b9c5-b1c8a36a12df] succeeded in 1.6070757599991339s: None
2024-03-21T02:36:02.118556819Z [2024-03-21 02:36:02,117: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2ad5714d-fef4-40e3-9042-dcce1ef2d0c6] succeeded in 1.6472777929993754s: None
2024-03-21T02:36:02.649310628Z [2024-03-21 02:36:02,647: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:36:02.659605715Z [2024-03-21 02:36:02,655: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:36:02.741148751Z [2024-03-21 02:36:02,736: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:36:02.745817602Z [2024-03-21 02:36:02,745: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:36:02.746721192Z [2024-03-21 02:36:02,745: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:36:02.746879519Z [2024-03-21 02:36:02,746: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:36:02.746917429Z [2024-03-21 02:36:02,746: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:36:02.747393814Z [2024-03-21 02:36:02,747: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:36:02.747497193Z [2024-03-21 02:36:02,747: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:36:02.832118732Z [2024-03-21 02:36:02,831: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:36:02.835847853Z [2024-03-21 02:36:02,835: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:36:02.864211088Z [2024-03-21 02:36:02,863: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:36:02.865986419Z [2024-03-21 02:36:02,865: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:36:02.866252973Z [2024-03-21 02:36:02,865: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:36:02.866449701Z [2024-03-21 02:36:02,866: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:36:02.866506288Z [2024-03-21 02:36:02,866: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:36:02.867183072Z [2024-03-21 02:36:02,867: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:36:02.867232293Z [2024-03-21 02:36:02,867: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:36:03.001980473Z [2024-03-21 02:36:03,001: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:36:03.024517799Z [2024-03-21 02:36:03,024: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:36:04.632036942Z [2024-03-21 02:36:04,631: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d5387e5d-1725-485c-b8a7-a1e7b0fda1b4] succeeded in 4.174271855999905s: None
2024-03-21T02:36:04.920327592Z [2024-03-21 02:36:04,919: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7df4f92c-d97e-4b38-b908-2f5d0288dff7] succeeded in 4.466078071000084s: None
2024-03-21T02:37:00.725467123Z [2024-03-21 02:37:00,725: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d0aad71-e6d2-4c6e-8798-2e6640fb0c58] received
2024-03-21T02:37:00.730037460Z [2024-03-21 02:37:00,729: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1385a295-a0e5-4997-b11e-4525f34f6f29] received
2024-03-21T02:37:00.743516102Z [2024-03-21 02:37:00,742: INFO/ForkPoolWorker-16] [1385a295-a0e5-4997-b11e-4525f34f6f29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:37:00.746785344Z [2024-03-21 02:37:00,746: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6599e1c-bd15-489b-9fd9-33824743f31a] received
2024-03-21T02:37:00.747137463Z [2024-03-21 02:37:00,746: INFO/ForkPoolWorker-15] [9d0aad71-e6d2-4c6e-8798-2e6640fb0c58] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:37:00.758122901Z [2024-03-21 02:37:00,756: INFO/ForkPoolWorker-1] [b6599e1c-bd15-489b-9fd9-33824743f31a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:37:01.171860649Z [2024-03-21 02:37:01,168: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:37:01.187012242Z [2024-03-21 02:37:01,183: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:37:01.189633752Z [2024-03-21 02:37:01,185: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:37:01.347989220Z [2024-03-21 02:37:01,347: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T02:37:01.352414122Z [2024-03-21 02:37:01,351: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:37:01.388348682Z [2024-03-21 02:37:01,387: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:37:01.393456833Z [2024-03-21 02:37:01,393: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:37:01.393591819Z [2024-03-21 02:37:01,393: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:37:01.393713913Z [2024-03-21 02:37:01,393: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T02:37:01.394037923Z [2024-03-21 02:37:01,393: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:37:01.502936060Z [2024-03-21 02:37:01,502: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:37:02.131469996Z [2024-03-21 02:37:02,130: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b6599e1c-bd15-489b-9fd9-33824743f31a] succeeded in 1.3797479280001426s: None
2024-03-21T02:37:02.622514611Z [2024-03-21 02:37:02,622: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:37:02.626951621Z [2024-03-21 02:37:02,626: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:37:02.647780689Z [2024-03-21 02:37:02,647: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:37:02.649505770Z [2024-03-21 02:37:02,649: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:37:02.649657602Z [2024-03-21 02:37:02,649: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:37:02.649948554Z [2024-03-21 02:37:02,649: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:37:02.650141981Z [2024-03-21 02:37:02,649: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:37:02.650530455Z [2024-03-21 02:37:02,650: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:37:02.650712344Z [2024-03-21 02:37:02,650: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:37:02.717295865Z [2024-03-21 02:37:02,716: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:37:02.720988872Z [2024-03-21 02:37:02,720: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:37:02.742997387Z [2024-03-21 02:37:02,742: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:37:02.744697367Z [2024-03-21 02:37:02,744: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:37:02.744905424Z [2024-03-21 02:37:02,744: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:37:02.745153648Z [2024-03-21 02:37:02,744: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:37:02.745314055Z [2024-03-21 02:37:02,745: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:37:02.745789315Z [2024-03-21 02:37:02,745: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:37:02.745946459Z [2024-03-21 02:37:02,745: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:37:02.746931841Z [2024-03-21 02:37:02,746: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:37:02.869533141Z [2024-03-21 02:37:02,865: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:37:04.426344091Z [2024-03-21 02:37:04,425: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1385a295-a0e5-4997-b11e-4525f34f6f29] succeeded in 3.6944580389990733s: None
2024-03-21T02:37:04.629052048Z [2024-03-21 02:37:04,628: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9d0aad71-e6d2-4c6e-8798-2e6640fb0c58] succeeded in 3.897585775999687s: None
2024-03-21T02:38:00.540211394Z [2024-03-21 02:38:00,539: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58b24ffa-4821-4d50-87aa-922918d7948d] received
2024-03-21T02:38:00.541419259Z [2024-03-21 02:38:00,541: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45c514dd-55c5-46c8-b6f2-e1a085476d94] received
2024-03-21T02:38:00.549019177Z [2024-03-21 02:38:00,548: INFO/ForkPoolWorker-15] [58b24ffa-4821-4d50-87aa-922918d7948d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:38:00.550042964Z [2024-03-21 02:38:00,549: INFO/ForkPoolWorker-16] [45c514dd-55c5-46c8-b6f2-e1a085476d94] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:38:00.551687201Z [2024-03-21 02:38:00,551: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[922278ef-ddcd-4c37-a22d-db53b7be9891] received
2024-03-21T02:38:00.553416064Z [2024-03-21 02:38:00,553: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba569267-f851-4086-ae30-4a301cb82cd7] received
2024-03-21T02:38:00.571283044Z [2024-03-21 02:38:00,570: INFO/ForkPoolWorker-1] [922278ef-ddcd-4c37-a22d-db53b7be9891] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:38:00.572345470Z [2024-03-21 02:38:00,571: INFO/ForkPoolWorker-2] [ba569267-f851-4086-ae30-4a301cb82cd7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:38:00.889000196Z [2024-03-21 02:38:00,885: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:38:00.900869126Z [2024-03-21 02:38:00,897: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:38:00.904043174Z [2024-03-21 02:38:00,900: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:38:01.066763200Z [2024-03-21 02:38:01,062: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:38:01.181095669Z [2024-03-21 02:38:01,180: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:38:01.264664343Z [2024-03-21 02:38:01,264: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T02:38:01.270671628Z [2024-03-21 02:38:01,270: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:38:01.321493299Z [2024-03-21 02:38:01,321: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:38:01.324141573Z [2024-03-21 02:38:01,323: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:38:01.324330064Z [2024-03-21 02:38:01,324: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:38:01.324479002Z [2024-03-21 02:38:01,324: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T02:38:01.324770435Z [2024-03-21 02:38:01,324: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:38:01.449874368Z [2024-03-21 02:38:01,449: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:38:01.883022213Z [2024-03-21 02:38:01,882: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[58b24ffa-4821-4d50-87aa-922918d7948d] succeeded in 1.3401089150011103s: None
2024-03-21T02:38:02.125931260Z [2024-03-21 02:38:02,125: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ba569267-f851-4086-ae30-4a301cb82cd7] succeeded in 1.5674451920003776s: None
2024-03-21T02:38:02.449326529Z [2024-03-21 02:38:02,448: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:38:02.454804640Z [2024-03-21 02:38:02,453: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:38:02.484958645Z [2024-03-21 02:38:02,484: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:38:02.486711531Z [2024-03-21 02:38:02,486: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:38:02.486778199Z [2024-03-21 02:38:02,486: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:38:02.486970660Z [2024-03-21 02:38:02,486: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:38:02.487058705Z [2024-03-21 02:38:02,486: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:38:02.487530705Z [2024-03-21 02:38:02,487: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:38:02.487638598Z [2024-03-21 02:38:02,487: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:38:02.563065972Z [2024-03-21 02:38:02,562: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:38:02.566924582Z [2024-03-21 02:38:02,566: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:38:02.585806861Z [2024-03-21 02:38:02,585: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:38:02.589015207Z [2024-03-21 02:38:02,588: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:38:02.589187669Z [2024-03-21 02:38:02,589: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:38:02.589370161Z [2024-03-21 02:38:02,589: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:38:02.589448377Z [2024-03-21 02:38:02,589: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:38:02.589711604Z [2024-03-21 02:38:02,589: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:38:02.589799051Z [2024-03-21 02:38:02,589: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:38:02.594363614Z [2024-03-21 02:38:02,593: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:38:02.675076537Z [2024-03-21 02:38:02,674: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:38:04.302320772Z [2024-03-21 02:38:04,301: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[922278ef-ddcd-4c37-a22d-db53b7be9891] succeeded in 3.7471666279998317s: None
2024-03-21T02:38:04.610119929Z [2024-03-21 02:38:04,609: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[45c514dd-55c5-46c8-b6f2-e1a085476d94] succeeded in 4.064466046998859s: None
2024-03-21T02:39:00.301026741Z [2024-03-21 02:39:00,300: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[366a2e95-032e-4259-955b-0f41cfbc84bd] received
2024-03-21T02:39:00.305341850Z [2024-03-21 02:39:00,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c196be15-e3eb-42de-9f7b-9c5860d5b7d4] received
2024-03-21T02:39:00.313168883Z [2024-03-21 02:39:00,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b17f1823-a7b4-4219-8480-72d5c879a316] received
2024-03-21T02:39:00.315442638Z [2024-03-21 02:39:00,315: INFO/ForkPoolWorker-16] [c196be15-e3eb-42de-9f7b-9c5860d5b7d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:39:00.317195626Z [2024-03-21 02:39:00,316: INFO/ForkPoolWorker-15] [366a2e95-032e-4259-955b-0f41cfbc84bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:39:00.327824931Z [2024-03-21 02:39:00,327: INFO/ForkPoolWorker-1] [b17f1823-a7b4-4219-8480-72d5c879a316] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:39:00.616667058Z [2024-03-21 02:39:00,613: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:39:00.629671733Z [2024-03-21 02:39:00,626: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:39:00.640838630Z [2024-03-21 02:39:00,637: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:39:00.790734186Z [2024-03-21 02:39:00,790: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T02:39:00.795020539Z [2024-03-21 02:39:00,794: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:39:00.822688251Z [2024-03-21 02:39:00,822: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:39:00.824571534Z [2024-03-21 02:39:00,824: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:39:00.825239951Z [2024-03-21 02:39:00,824: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:39:00.825521417Z [2024-03-21 02:39:00,825: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T02:39:00.825969617Z [2024-03-21 02:39:00,825: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:39:00.931699306Z [2024-03-21 02:39:00,931: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:39:01.485655449Z [2024-03-21 02:39:01,485: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b17f1823-a7b4-4219-8480-72d5c879a316] succeeded in 1.1689331929992477s: None
2024-03-21T02:39:01.927851319Z [2024-03-21 02:39:01,927: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:39:01.931310217Z [2024-03-21 02:39:01,930: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:39:01.953051956Z [2024-03-21 02:39:01,952: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:39:01.954425957Z [2024-03-21 02:39:01,954: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:39:01.954550369Z [2024-03-21 02:39:01,954: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:39:01.954732890Z [2024-03-21 02:39:01,954: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:39:01.954865349Z [2024-03-21 02:39:01,954: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:39:01.955244364Z [2024-03-21 02:39:01,955: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:39:01.955265828Z [2024-03-21 02:39:01,955: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:39:02.005508422Z [2024-03-21 02:39:02,005: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:39:02.010720780Z [2024-03-21 02:39:02,009: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:39:02.034106353Z [2024-03-21 02:39:02,033: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:39:02.037592028Z [2024-03-21 02:39:02,037: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:39:02.037823506Z [2024-03-21 02:39:02,037: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:39:02.038171824Z [2024-03-21 02:39:02,037: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:39:02.038374939Z [2024-03-21 02:39:02,038: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:39:02.038792180Z [2024-03-21 02:39:02,038: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:39:02.038999548Z [2024-03-21 02:39:02,038: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:39:02.056962544Z [2024-03-21 02:39:02,056: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:39:02.140157929Z [2024-03-21 02:39:02,139: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:39:03.934642471Z [2024-03-21 02:39:03,934: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[366a2e95-032e-4259-955b-0f41cfbc84bd] succeeded in 3.6274743610010773s: None
2024-03-21T02:39:04.281920318Z [2024-03-21 02:39:04,281: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c196be15-e3eb-42de-9f7b-9c5860d5b7d4] succeeded in 3.9745683879991702s: None
2024-03-21T02:40:00.369563101Z [2024-03-21 02:40:00,369: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b30e279-21ff-468e-b3ba-76db93418649] received
2024-03-21T02:40:00.378521735Z [2024-03-21 02:40:00,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab1095b2-2fab-4c74-bc8e-528c8de99bb9] received
2024-03-21T02:40:00.379618137Z [2024-03-21 02:40:00,379: INFO/ForkPoolWorker-15] [6b30e279-21ff-468e-b3ba-76db93418649] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:40:00.398287770Z [2024-03-21 02:40:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35e3ed02-ab3f-4f62-a3b9-c29b7b2d9f5d] received
2024-03-21T02:40:00.400582298Z [2024-03-21 02:40:00,399: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52f2dc35-5b8c-4f31-b9f6-3c05705d57ed] received
2024-03-21T02:40:00.403823315Z [2024-03-21 02:40:00,403: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea2710cf-6e08-4973-9d85-d135cda9e2af] received
2024-03-21T02:40:00.406393143Z [2024-03-21 02:40:00,405: INFO/ForkPoolWorker-16] [ab1095b2-2fab-4c74-bc8e-528c8de99bb9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:40:00.407303660Z [2024-03-21 02:40:00,407: INFO/ForkPoolWorker-1] [35e3ed02-ab3f-4f62-a3b9-c29b7b2d9f5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:40:00.424113637Z [2024-03-21 02:40:00,423: INFO/ForkPoolWorker-2] [52f2dc35-5b8c-4f31-b9f6-3c05705d57ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:40:00.443984731Z [2024-03-21 02:40:00,443: INFO/ForkPoolWorker-3] [ea2710cf-6e08-4973-9d85-d135cda9e2af] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:40:00.765036391Z [2024-03-21 02:40:00,761: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:40:00.792115380Z [2024-03-21 02:40:00,789: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:40:00.853588693Z [2024-03-21 02:40:00,838: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:40:01.007494020Z [2024-03-21 02:40:00,999: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:40:01.052573081Z [2024-03-21 02:40:01,047: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:40:01.138107862Z [2024-03-21 02:40:01,137: INFO/ForkPoolWorker-3] Getting SDNC list
2024-03-21T02:40:01.145189892Z [2024-03-21 02:40:01,142: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:40:01.209773743Z [2024-03-21 02:40:01,209: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-21T02:40:01.211021335Z [2024-03-21 02:40:01,210: INFO/ForkPoolWorker-3] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:40:01.211271589Z [2024-03-21 02:40:01,211: INFO/ForkPoolWorker-3] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:40:01.212596165Z [2024-03-21 02:40:01,212: INFO/ForkPoolWorker-3] Getting SDNC list OK
2024-03-21T02:40:01.216810727Z [2024-03-21 02:40:01,216: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:40:01.546691469Z [2024-03-21 02:40:01,546: INFO/ForkPoolWorker-3] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:40:01.647283044Z [2024-03-21 02:40:01,646: INFO/ForkPoolWorker-2] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:40:02.495341566Z [2024-03-21 02:40:02,494: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:40:02.498932945Z [2024-03-21 02:40:02,498: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:40:02.537293048Z [2024-03-21 02:40:02,537: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:40:02.541880313Z [2024-03-21 02:40:02,541: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:40:02.541911041Z [2024-03-21 02:40:02,541: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:40:02.542084953Z [2024-03-21 02:40:02,541: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:40:02.542142161Z [2024-03-21 02:40:02,542: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:40:02.542479463Z [2024-03-21 02:40:02,542: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:40:02.542643724Z [2024-03-21 02:40:02,542: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:40:02.557707676Z [2024-03-21 02:40:02,557: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[52f2dc35-5b8c-4f31-b9f6-3c05705d57ed] succeeded in 2.1531332039994595s: None
2024-03-21T02:40:02.558771042Z [2024-03-21 02:40:02,558: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[ea2710cf-6e08-4973-9d85-d135cda9e2af] succeeded in 2.147227972998735s: None
2024-03-21T02:40:02.637871907Z [2024-03-21 02:40:02,637: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:40:02.714336009Z [2024-03-21 02:40:02,713: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:40:02.718074162Z [2024-03-21 02:40:02,717: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:40:02.738775253Z [2024-03-21 02:40:02,738: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:40:02.740367223Z [2024-03-21 02:40:02,740: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:40:02.740439486Z [2024-03-21 02:40:02,740: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:40:02.740619277Z [2024-03-21 02:40:02,740: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:40:02.740757924Z [2024-03-21 02:40:02,740: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:40:02.741094317Z [2024-03-21 02:40:02,740: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:40:02.741163420Z [2024-03-21 02:40:02,741: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:40:02.860679470Z [2024-03-21 02:40:02,860: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T02:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:40:03.119173660Z [2024-03-21 02:40:03,118: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:40:03.129206534Z [2024-03-21 02:40:03,128: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:40:03.162893299Z [2024-03-21 02:40:03,162: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:40:03.164975515Z [2024-03-21 02:40:03,164: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:40:03.165093646Z [2024-03-21 02:40:03,164: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:40:03.165354002Z [2024-03-21 02:40:03,165: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:40:03.165488710Z [2024-03-21 02:40:03,165: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:40:03.165864245Z [2024-03-21 02:40:03,165: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:40:03.166505509Z [2024-03-21 02:40:03,166: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:40:03.308643808Z [2024-03-21 02:40:03,308: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:40:03.495245678Z [2024-03-21 02:40:03,494: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6b30e279-21ff-468e-b3ba-76db93418649] succeeded in 3.1224649679988943s: None
2024-03-21T02:40:03.859827567Z [2024-03-21 02:40:03,859: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5eccfc7-3d7d-4c5d-9d15-9fc0aa0aed11] received
2024-03-21T02:40:03.868383422Z [2024-03-21 02:40:03,867: INFO/ForkPoolWorker-15] [b5eccfc7-3d7d-4c5d-9d15-9fc0aa0aed11] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:40:04.146287444Z [2024-03-21 02:40:04,143: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:40:04.381870217Z [2024-03-21 02:40:04,380: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[35e3ed02-ab3f-4f62-a3b9-c29b7b2d9f5d] succeeded in 3.9787582740009384s: None
2024-03-21T02:40:05.281286590Z [2024-03-21 02:40:05,280: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ab1095b2-2fab-4c74-bc8e-528c8de99bb9] succeeded in 4.894718665000255s: None
2024-03-21T02:40:05.369961759Z [2024-03-21 02:40:05,369: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:40:05.373669807Z [2024-03-21 02:40:05,373: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:40:05.397598555Z [2024-03-21 02:40:05,397: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:40:05.400161626Z [2024-03-21 02:40:05,399: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:40:05.400222106Z [2024-03-21 02:40:05,400: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:40:05.400740432Z [2024-03-21 02:40:05,400: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:40:05.401085669Z [2024-03-21 02:40:05,400: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:40:05.402042736Z [2024-03-21 02:40:05,401: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:40:05.402424538Z [2024-03-21 02:40:05,402: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:40:05.499586126Z [2024-03-21 02:40:05,499: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T02:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:40:06.151887752Z [2024-03-21 02:40:06,151: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b5eccfc7-3d7d-4c5d-9d15-9fc0aa0aed11] succeeded in 2.2893443490011123s: None
2024-03-21T02:40:06.628470353Z [2024-03-21 02:40:06,628: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4951b315-dafd-46fe-bdda-220bf791fda0] received
2024-03-21T02:40:06.644565303Z [2024-03-21 02:40:06,644: INFO/ForkPoolWorker-15] [4951b315-dafd-46fe-bdda-220bf791fda0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T02:40:06.950989917Z [2024-03-21 02:40:06,947: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:40:08.049835977Z [2024-03-21 02:40:08,049: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:40:08.054065529Z [2024-03-21 02:40:08,053: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:40:08.078596655Z [2024-03-21 02:40:08,078: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:40:08.080107059Z [2024-03-21 02:40:08,079: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:40:08.080294002Z [2024-03-21 02:40:08,080: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:40:08.080542597Z [2024-03-21 02:40:08,080: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:40:08.080734876Z [2024-03-21 02:40:08,080: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:40:08.081110933Z [2024-03-21 02:40:08,080: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:40:08.081747050Z [2024-03-21 02:40:08,081: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:40:08.186778643Z [2024-03-21 02:40:08,173: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T02:35:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:40:08.821260327Z [2024-03-21 02:40:08,820: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4951b315-dafd-46fe-bdda-220bf791fda0] succeeded in 2.187367880000238s: None
2024-03-21T02:40:09.030448413Z [2024-03-21 02:40:09,029: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac85711f-fdef-4436-adc0-2b2ef57d34d1] received
2024-03-21T02:40:09.043703127Z [2024-03-21 02:40:09,043: INFO/ForkPoolWorker-15] [ac85711f-fdef-4436-adc0-2b2ef57d34d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:40:09.350459284Z [2024-03-21 02:40:09,345: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:40:10.571533180Z [2024-03-21 02:40:10,571: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:40:10.575141427Z [2024-03-21 02:40:10,574: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:40:10.594696083Z [2024-03-21 02:40:10,594: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:40:10.595975671Z [2024-03-21 02:40:10,595: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:40:10.596053101Z [2024-03-21 02:40:10,595: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:40:10.596209132Z [2024-03-21 02:40:10,596: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:40:10.596283384Z [2024-03-21 02:40:10,596: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:40:10.596594714Z [2024-03-21 02:40:10,596: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:40:10.596777712Z [2024-03-21 02:40:10,596: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:40:10.680398521Z [2024-03-21 02:40:10,679: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T02:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:40:11.263641069Z [2024-03-21 02:40:11,263: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ac85711f-fdef-4436-adc0-2b2ef57d34d1] succeeded in 2.2295572130005894s: None
2024-03-21T02:41:00.663241939Z [2024-03-21 02:41:00,662: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e34e229d-418a-4582-b221-2030152df13c] received
2024-03-21T02:41:00.669751983Z [2024-03-21 02:41:00,669: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5244ac4-d3f8-440b-a8d7-68c877e87dc2] received
2024-03-21T02:41:00.678276056Z [2024-03-21 02:41:00,677: INFO/ForkPoolWorker-16] [e5244ac4-d3f8-440b-a8d7-68c877e87dc2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:41:00.679214068Z [2024-03-21 02:41:00,678: INFO/ForkPoolWorker-15] [e34e229d-418a-4582-b221-2030152df13c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:41:00.682203099Z [2024-03-21 02:41:00,681: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6601b887-6650-469d-96a0-bd25beffac4b] received
2024-03-21T02:41:00.688766385Z [2024-03-21 02:41:00,688: INFO/ForkPoolWorker-1] [6601b887-6650-469d-96a0-bd25beffac4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:41:00.999154086Z [2024-03-21 02:41:00,996: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:41:01.011351944Z [2024-03-21 02:41:01,007: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:41:01.037101591Z [2024-03-21 02:41:01,033: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:41:01.228527796Z [2024-03-21 02:41:01,228: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T02:41:01.232588503Z [2024-03-21 02:41:01,232: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:41:01.275325299Z [2024-03-21 02:41:01,275: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:41:01.277250132Z [2024-03-21 02:41:01,276: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:41:01.277506072Z [2024-03-21 02:41:01,277: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:41:01.277688644Z [2024-03-21 02:41:01,277: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T02:41:01.278058536Z [2024-03-21 02:41:01,277: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:41:01.447950306Z [2024-03-21 02:41:01,447: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:41:02.160468704Z [2024-03-21 02:41:02,160: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e5244ac4-d3f8-440b-a8d7-68c877e87dc2] succeeded in 1.4892306290003035s: None
2024-03-21T02:41:02.219580513Z [2024-03-21 02:41:02,219: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:41:02.223079821Z [2024-03-21 02:41:02,222: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:41:02.292584802Z [2024-03-21 02:41:02,287: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:41:02.292601968Z [2024-03-21 02:41:02,288: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:41:02.292605454Z [2024-03-21 02:41:02,288: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:41:02.292609207Z [2024-03-21 02:41:02,288: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:41:02.292613060Z [2024-03-21 02:41:02,289: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:41:02.292616479Z [2024-03-21 02:41:02,289: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:41:02.292619868Z [2024-03-21 02:41:02,289: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:41:02.467152777Z [2024-03-21 02:41:02,466: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:41:02.595998300Z [2024-03-21 02:41:02,595: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:41:02.609686137Z [2024-03-21 02:41:02,608: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:41:02.655829281Z [2024-03-21 02:41:02,655: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:41:02.659579866Z [2024-03-21 02:41:02,659: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:41:02.659673313Z [2024-03-21 02:41:02,659: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:41:02.659841456Z [2024-03-21 02:41:02,659: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:41:02.659966492Z [2024-03-21 02:41:02,659: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:41:02.660433879Z [2024-03-21 02:41:02,660: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:41:02.660541678Z [2024-03-21 02:41:02,660: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:41:02.861248076Z [2024-03-21 02:41:02,860: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:41:04.418427480Z [2024-03-21 02:41:04,417: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6601b887-6650-469d-96a0-bd25beffac4b] succeeded in 3.7342916979996517s: None
2024-03-21T02:41:06.142754917Z [2024-03-21 02:41:06,142: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e34e229d-418a-4582-b221-2030152df13c] succeeded in 5.476815531999819s: None
2024-03-21T02:42:00.964659234Z [2024-03-21 02:42:00,964: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[294778f4-55b3-46f6-a896-665ef16c25ef] received
2024-03-21T02:42:00.970428432Z [2024-03-21 02:42:00,970: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74b563f3-090c-4cbf-bd27-9dda70e55cbb] received
2024-03-21T02:42:00.972527188Z [2024-03-21 02:42:00,972: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[606530cc-10b9-43d6-810d-f13dcd89d8cb] received
2024-03-21T02:42:00.975994992Z [2024-03-21 02:42:00,975: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f415758-05ed-4903-9938-cdc05511e2fc] received
2024-03-21T02:42:00.978784640Z [2024-03-21 02:42:00,978: INFO/ForkPoolWorker-15] [294778f4-55b3-46f6-a896-665ef16c25ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:42:00.982177643Z [2024-03-21 02:42:00,981: INFO/ForkPoolWorker-16] [74b563f3-090c-4cbf-bd27-9dda70e55cbb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:42:00.988712265Z [2024-03-21 02:42:00,988: INFO/ForkPoolWorker-1] [606530cc-10b9-43d6-810d-f13dcd89d8cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:42:00.990509765Z [2024-03-21 02:42:00,990: INFO/ForkPoolWorker-2] [1f415758-05ed-4903-9938-cdc05511e2fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:42:01.292525368Z [2024-03-21 02:42:01,289: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:42:01.299991114Z [2024-03-21 02:42:01,295: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:42:01.362338677Z [2024-03-21 02:42:01,359: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:42:01.514432879Z [2024-03-21 02:42:01,513: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T02:42:01.519282009Z [2024-03-21 02:42:01,518: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:42:01.546474465Z [2024-03-21 02:42:01,546: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:42:01.548811836Z [2024-03-21 02:42:01,548: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:42:01.549134330Z [2024-03-21 02:42:01,548: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:42:01.549201387Z [2024-03-21 02:42:01,549: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T02:42:01.549658188Z [2024-03-21 02:42:01,549: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:42:01.625168237Z [2024-03-21 02:42:01,620: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:42:01.640195467Z [2024-03-21 02:42:01,639: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:42:01.641643770Z [2024-03-21 02:42:01,641: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:42:02.265233886Z [2024-03-21 02:42:02,259: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[294778f4-55b3-46f6-a896-665ef16c25ef] succeeded in 1.2935362449989043s: None
2024-03-21T02:42:02.426302396Z [2024-03-21 02:42:02,425: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1f415758-05ed-4903-9938-cdc05511e2fc] succeeded in 1.4418646529993566s: None
2024-03-21T02:42:02.583288406Z [2024-03-21 02:42:02,582: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:42:02.586709857Z [2024-03-21 02:42:02,586: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:42:02.608901449Z [2024-03-21 02:42:02,608: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:42:02.610316922Z [2024-03-21 02:42:02,610: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:42:02.610436563Z [2024-03-21 02:42:02,610: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:42:02.610638176Z [2024-03-21 02:42:02,610: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:42:02.610746019Z [2024-03-21 02:42:02,610: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:42:02.611056870Z [2024-03-21 02:42:02,610: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:42:02.611169314Z [2024-03-21 02:42:02,611: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:42:02.704859168Z [2024-03-21 02:42:02,704: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:42:03.023853482Z [2024-03-21 02:42:03,023: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:42:03.027278566Z [2024-03-21 02:42:03,026: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:42:03.052301197Z [2024-03-21 02:42:03,052: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:42:03.053737934Z [2024-03-21 02:42:03,053: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:42:03.053807934Z [2024-03-21 02:42:03,053: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:42:03.054100154Z [2024-03-21 02:42:03,053: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:42:03.054110727Z [2024-03-21 02:42:03,054: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:42:03.054418033Z [2024-03-21 02:42:03,054: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:42:03.054486361Z [2024-03-21 02:42:03,054: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:42:03.137401424Z [2024-03-21 02:42:03,137: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:42:05.558582555Z [2024-03-21 02:42:05,558: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[74b563f3-090c-4cbf-bd27-9dda70e55cbb] succeeded in 4.586049870998977s: None
2024-03-21T02:42:05.591356290Z [2024-03-21 02:42:05,590: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[606530cc-10b9-43d6-810d-f13dcd89d8cb] succeeded in 4.616936865000753s: None
2024-03-21T02:43:01.230642373Z [2024-03-21 02:43:01,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b81bfe02-e530-4ff1-b501-5606a3e8dc2f] received
2024-03-21T02:43:01.234922212Z [2024-03-21 02:43:01,234: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b593e50f-2818-49a7-81c5-4aa4d67e187f] received
2024-03-21T02:43:01.245151694Z [2024-03-21 02:43:01,244: INFO/ForkPoolWorker-16] [b593e50f-2818-49a7-81c5-4aa4d67e187f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:43:01.249470724Z [2024-03-21 02:43:01,248: INFO/ForkPoolWorker-15] [b81bfe02-e530-4ff1-b501-5606a3e8dc2f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:43:01.255901830Z [2024-03-21 02:43:01,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed0a678e-2355-4150-9fd3-75d47525f4c8] received
2024-03-21T02:43:01.267480556Z [2024-03-21 02:43:01,267: INFO/ForkPoolWorker-1] [ed0a678e-2355-4150-9fd3-75d47525f4c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:43:01.566008952Z [2024-03-21 02:43:01,562: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:43:01.566989504Z [2024-03-21 02:43:01,563: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:43:01.582646649Z [2024-03-21 02:43:01,579: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:43:01.749220898Z [2024-03-21 02:43:01,748: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T02:43:01.753398956Z [2024-03-21 02:43:01,752: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:43:01.781136897Z [2024-03-21 02:43:01,780: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:43:01.782639024Z [2024-03-21 02:43:01,782: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:43:01.782736316Z [2024-03-21 02:43:01,782: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:43:01.782908942Z [2024-03-21 02:43:01,782: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T02:43:01.783384150Z [2024-03-21 02:43:01,783: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:43:01.890819385Z [2024-03-21 02:43:01,890: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:43:02.920913987Z [2024-03-21 02:43:02,919: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ed0a678e-2355-4150-9fd3-75d47525f4c8] succeeded in 1.662472168000022s: None
2024-03-21T02:43:03.116258137Z [2024-03-21 02:43:03,115: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:43:03.119738057Z [2024-03-21 02:43:03,119: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:43:03.150640471Z [2024-03-21 02:43:03,150: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:43:03.152478408Z [2024-03-21 02:43:03,152: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:43:03.152517919Z [2024-03-21 02:43:03,152: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:43:03.152753836Z [2024-03-21 02:43:03,152: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:43:03.152800863Z [2024-03-21 02:43:03,152: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:43:03.153480321Z [2024-03-21 02:43:03,153: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:43:03.153644867Z [2024-03-21 02:43:03,153: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:43:03.247241021Z [2024-03-21 02:43:03,246: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:43:03.250804426Z [2024-03-21 02:43:03,250: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:43:03.285661993Z [2024-03-21 02:43:03,285: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:43:03.291249402Z [2024-03-21 02:43:03,290: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:43:03.311339152Z [2024-03-21 02:43:03,310: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:43:03.311419703Z [2024-03-21 02:43:03,311: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:43:03.311671315Z [2024-03-21 02:43:03,311: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:43:03.311797957Z [2024-03-21 02:43:03,311: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:43:03.312201164Z [2024-03-21 02:43:03,312: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:43:03.312302339Z [2024-03-21 02:43:03,312: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:43:03.427916522Z [2024-03-21 02:43:03,427: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:43:08.158875428Z [2024-03-21 02:43:08,158: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b81bfe02-e530-4ff1-b501-5606a3e8dc2f] succeeded in 6.924501346999023s: None
2024-03-21T02:43:09.229840086Z [2024-03-21 02:43:09,229: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b593e50f-2818-49a7-81c5-4aa4d67e187f] succeeded in 7.992648743000245s: None
2024-03-21T02:44:00.432900554Z [2024-03-21 02:44:00,432: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dba47ba8-9b28-47ed-a1b4-b28b2e20836a] received
2024-03-21T02:44:00.435231270Z [2024-03-21 02:44:00,434: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[afffae47-7d4f-4bca-8c06-6f9c4823b755] received
2024-03-21T02:44:00.446063092Z [2024-03-21 02:44:00,445: INFO/ForkPoolWorker-16] [afffae47-7d4f-4bca-8c06-6f9c4823b755] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:44:00.446836207Z [2024-03-21 02:44:00,446: INFO/ForkPoolWorker-15] [dba47ba8-9b28-47ed-a1b4-b28b2e20836a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:44:00.462571776Z [2024-03-21 02:44:00,462: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37e9ac88-45c6-4d32-a195-45f8a463b21a] received
2024-03-21T02:44:00.473290168Z [2024-03-21 02:44:00,473: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fcca3714-e229-4bb5-a3f7-cf46b77540c5] received
2024-03-21T02:44:00.481612717Z [2024-03-21 02:44:00,481: INFO/ForkPoolWorker-1] [37e9ac88-45c6-4d32-a195-45f8a463b21a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:44:00.497996565Z [2024-03-21 02:44:00,497: INFO/ForkPoolWorker-2] [fcca3714-e229-4bb5-a3f7-cf46b77540c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:44:01.080243269Z [2024-03-21 02:44:01,076: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:44:01.110424618Z [2024-03-21 02:44:01,106: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:44:01.387944896Z [2024-03-21 02:44:01,382: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:44:01.700657165Z [2024-03-21 02:44:01,700: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:44:01.955533543Z [2024-03-21 02:44:01,946: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:44:02.576746331Z [2024-03-21 02:44:02,576: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T02:44:02.581223625Z [2024-03-21 02:44:02,580: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:44:02.638710893Z [2024-03-21 02:44:02,638: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:44:02.640096841Z [2024-03-21 02:44:02,639: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:44:02.640362700Z [2024-03-21 02:44:02,640: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:44:02.640701882Z [2024-03-21 02:44:02,640: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T02:44:02.641050442Z [2024-03-21 02:44:02,640: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:44:02.901385501Z [2024-03-21 02:44:02,901: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:44:02.969917688Z [2024-03-21 02:44:02,969: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dba47ba8-9b28-47ed-a1b4-b28b2e20836a] succeeded in 2.533032084000297s: None
2024-03-21T02:44:03.762298211Z [2024-03-21 02:44:03,761: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fcca3714-e229-4bb5-a3f7-cf46b77540c5] succeeded in 3.27438932899895s: None
2024-03-21T02:44:03.917254564Z [2024-03-21 02:44:03,916: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:44:03.920601317Z [2024-03-21 02:44:03,920: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:44:03.945659478Z [2024-03-21 02:44:03,945: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:44:03.956420066Z [2024-03-21 02:44:03,949: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:44:03.956445915Z [2024-03-21 02:44:03,949: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:44:03.956450324Z [2024-03-21 02:44:03,950: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:44:03.956453381Z [2024-03-21 02:44:03,951: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:44:03.956469741Z [2024-03-21 02:44:03,951: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:44:03.956473715Z [2024-03-21 02:44:03,951: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:44:03.956476884Z [2024-03-21 02:44:03,951: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:44:03.956479854Z [2024-03-21 02:44:03,951: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:44:04.002582354Z [2024-03-21 02:44:04,002: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:44:04.004229351Z [2024-03-21 02:44:04,003: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:44:04.004265058Z [2024-03-21 02:44:04,004: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:44:04.004440320Z [2024-03-21 02:44:04,004: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:44:04.004523571Z [2024-03-21 02:44:04,004: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:44:04.004895671Z [2024-03-21 02:44:04,004: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:44:04.004923741Z [2024-03-21 02:44:04,004: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:44:04.049529529Z [2024-03-21 02:44:04,049: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:44:04.113277959Z [2024-03-21 02:44:04,112: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:44:06.976156015Z [2024-03-21 02:44:06,975: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[37e9ac88-45c6-4d32-a195-45f8a463b21a] succeeded in 6.5076515459986695s: None
2024-03-21T02:44:07.838853298Z [2024-03-21 02:44:07,838: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[afffae47-7d4f-4bca-8c06-6f9c4823b755] succeeded in 7.4019288160016s: None
2024-03-21T02:45:00.648658469Z [2024-03-21 02:45:00,648: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[387dcd33-3fb4-4719-aba8-5c911f1642dd] received
2024-03-21T02:45:00.651410956Z [2024-03-21 02:45:00,651: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a90bea8-3cf9-4a50-9978-fa9ac435f948] received
2024-03-21T02:45:00.653141493Z [2024-03-21 02:45:00,652: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c78f4c33-28e3-4669-b5dc-538072048d89] received
2024-03-21T02:45:00.655008599Z [2024-03-21 02:45:00,654: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5839123f-15f8-4c99-bb8b-f67a2d428ac3] received
2024-03-21T02:45:00.658215636Z [2024-03-21 02:45:00,657: INFO/ForkPoolWorker-15] [387dcd33-3fb4-4719-aba8-5c911f1642dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:45:00.669824238Z [2024-03-21 02:45:00,668: INFO/ForkPoolWorker-1] [c78f4c33-28e3-4669-b5dc-538072048d89] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:45:00.669871227Z [2024-03-21 02:45:00,669: INFO/ForkPoolWorker-16] [8a90bea8-3cf9-4a50-9978-fa9ac435f948] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:45:00.675408655Z [2024-03-21 02:45:00,675: INFO/ForkPoolWorker-2] [5839123f-15f8-4c99-bb8b-f67a2d428ac3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:45:01.015452504Z [2024-03-21 02:45:01,010: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:45:01.063041388Z [2024-03-21 02:45:01,056: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:45:01.333704325Z [2024-03-21 02:45:01,324: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:45:01.338985805Z [2024-03-21 02:45:01,335: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:45:01.543215237Z [2024-03-21 02:45:01,541: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T02:45:01.548854390Z [2024-03-21 02:45:01,548: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:45:01.584672694Z [2024-03-21 02:45:01,584: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:45:01.592403805Z [2024-03-21 02:45:01,592: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:45:01.592736555Z [2024-03-21 02:45:01,592: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:45:01.592951529Z [2024-03-21 02:45:01,592: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T02:45:01.593430396Z [2024-03-21 02:45:01,593: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:45:01.692222519Z [2024-03-21 02:45:01,691: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:45:02.581773946Z [2024-03-21 02:45:02,581: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5839123f-15f8-4c99-bb8b-f67a2d428ac3] succeeded in 1.9231987789989944s: None
2024-03-21T02:45:02.614859902Z [2024-03-21 02:45:02,614: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:45:02.619079934Z [2024-03-21 02:45:02,618: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:45:02.642643339Z [2024-03-21 02:45:02,642: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:45:02.644125161Z [2024-03-21 02:45:02,643: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:45:02.644263791Z [2024-03-21 02:45:02,644: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:45:02.644522313Z [2024-03-21 02:45:02,644: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:45:02.644649146Z [2024-03-21 02:45:02,644: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:45:02.644968489Z [2024-03-21 02:45:02,644: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:45:02.645124505Z [2024-03-21 02:45:02,644: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:45:02.729407206Z [2024-03-21 02:45:02,729: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T02:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:45:02.891852655Z [2024-03-21 02:45:02,891: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:45:02.895322301Z [2024-03-21 02:45:02,894: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:45:02.921345364Z [2024-03-21 02:45:02,921: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:45:02.926579003Z [2024-03-21 02:45:02,926: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:45:02.926903738Z [2024-03-21 02:45:02,926: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:45:02.927204173Z [2024-03-21 02:45:02,926: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:45:02.927558119Z [2024-03-21 02:45:02,927: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:45:02.928054216Z [2024-03-21 02:45:02,927: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:45:02.928446797Z [2024-03-21 02:45:02,928: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:45:02.977156700Z [2024-03-21 02:45:02,976: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:45:03.001552225Z [2024-03-21 02:45:03,000: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:45:03.052213791Z [2024-03-21 02:45:03,051: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:45:03.054130741Z [2024-03-21 02:45:03,053: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:45:03.054450010Z [2024-03-21 02:45:03,054: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:45:03.054575036Z [2024-03-21 02:45:03,054: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:45:03.054628237Z [2024-03-21 02:45:03,054: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:45:03.054928061Z [2024-03-21 02:45:03,054: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:45:03.054968619Z [2024-03-21 02:45:03,054: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:45:03.076080121Z [2024-03-21 02:45:03,075: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:45:03.136939619Z [2024-03-21 02:45:03,136: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:45:03.611541526Z [2024-03-21 02:45:03,611: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[387dcd33-3fb4-4719-aba8-5c911f1642dd] succeeded in 2.961341039999752s: None
2024-03-21T02:45:04.331818462Z [2024-03-21 02:45:04,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23bf02e7-1ba7-4a0a-a229-0584b75eb922] received
2024-03-21T02:45:04.347686660Z [2024-03-21 02:45:04,347: INFO/ForkPoolWorker-15] [23bf02e7-1ba7-4a0a-a229-0584b75eb922] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:45:04.640528177Z [2024-03-21 02:45:04,637: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:45:04.844922126Z [2024-03-21 02:45:04,841: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8a90bea8-3cf9-4a50-9978-fa9ac435f948] succeeded in 4.188007302000187s: None
2024-03-21T02:45:05.128332939Z [2024-03-21 02:45:05,127: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c78f4c33-28e3-4669-b5dc-538072048d89] succeeded in 4.4720091149993095s: None
2024-03-21T02:45:05.999181953Z [2024-03-21 02:45:05,998: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:45:06.003143961Z [2024-03-21 02:45:06,002: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:45:06.023588399Z [2024-03-21 02:45:06,023: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:45:06.025373242Z [2024-03-21 02:45:06,025: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:45:06.025558011Z [2024-03-21 02:45:06,025: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:45:06.025787039Z [2024-03-21 02:45:06,025: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:45:06.025879266Z [2024-03-21 02:45:06,025: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:45:06.026177369Z [2024-03-21 02:45:06,026: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:45:06.026315344Z [2024-03-21 02:45:06,026: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:45:06.138989494Z [2024-03-21 02:45:06,138: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T02:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:45:06.733266798Z [2024-03-21 02:45:06,732: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[23bf02e7-1ba7-4a0a-a229-0584b75eb922] succeeded in 2.3965268169995397s: None
2024-03-21T02:45:06.815716256Z [2024-03-21 02:45:06,815: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4ed23b6-e480-4e9b-a295-c2536243020d] received
2024-03-21T02:45:06.825556785Z [2024-03-21 02:45:06,825: INFO/ForkPoolWorker-15] [a4ed23b6-e480-4e9b-a295-c2536243020d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T02:45:07.134227857Z [2024-03-21 02:45:07,131: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:45:08.340006655Z [2024-03-21 02:45:08,339: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:45:08.343335433Z [2024-03-21 02:45:08,342: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:45:08.387277534Z [2024-03-21 02:45:08,386: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:45:08.388756348Z [2024-03-21 02:45:08,388: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:45:08.388886419Z [2024-03-21 02:45:08,388: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:45:08.389121164Z [2024-03-21 02:45:08,388: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:45:08.389275384Z [2024-03-21 02:45:08,389: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:45:08.389659905Z [2024-03-21 02:45:08,389: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:45:08.389880578Z [2024-03-21 02:45:08,389: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:45:08.510802643Z [2024-03-21 02:45:08,510: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T02:40:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:45:09.069623140Z [2024-03-21 02:45:09,068: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a4ed23b6-e480-4e9b-a295-c2536243020d] succeeded in 2.2512351519999356s: None
2024-03-21T02:45:09.508209060Z [2024-03-21 02:45:09,507: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[846bfd98-4bed-494f-ab91-c42c10614492] received
2024-03-21T02:45:09.542506531Z [2024-03-21 02:45:09,542: INFO/ForkPoolWorker-15] [846bfd98-4bed-494f-ab91-c42c10614492] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:45:09.907729289Z [2024-03-21 02:45:09,904: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:45:11.239649804Z [2024-03-21 02:45:11,239: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:45:11.242948675Z [2024-03-21 02:45:11,242: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:45:11.269247091Z [2024-03-21 02:45:11,267: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:45:11.270284638Z [2024-03-21 02:45:11,270: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:45:11.270365811Z [2024-03-21 02:45:11,270: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:45:11.270479140Z [2024-03-21 02:45:11,270: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:45:11.270859878Z [2024-03-21 02:45:11,270: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:45:11.271469763Z [2024-03-21 02:45:11,271: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:45:11.271488500Z [2024-03-21 02:45:11,271: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:45:11.364923700Z [2024-03-21 02:45:11,364: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T02:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:45:12.110410810Z [2024-03-21 02:45:12,109: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[846bfd98-4bed-494f-ab91-c42c10614492] succeeded in 2.594963874000314s: None
2024-03-21T02:46:01.047510275Z [2024-03-21 02:46:01,047: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5527deb7-335f-4cb4-9cbc-e74583b625a1] received
2024-03-21T02:46:01.049495327Z [2024-03-21 02:46:01,049: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2c35d63-5b26-4157-a190-6fbf20c3e16c] received
2024-03-21T02:46:01.052061780Z [2024-03-21 02:46:01,051: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[355fedca-7b7f-4228-b18a-72540b8dab78] received
2024-03-21T02:46:01.058947560Z [2024-03-21 02:46:01,058: INFO/ForkPoolWorker-1] [355fedca-7b7f-4228-b18a-72540b8dab78] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:46:01.061359201Z [2024-03-21 02:46:01,061: INFO/ForkPoolWorker-16] [d2c35d63-5b26-4157-a190-6fbf20c3e16c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:46:01.069196826Z [2024-03-21 02:46:01,068: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63d5c349-3a1b-4349-bcab-65827849f153] received
2024-03-21T02:46:01.076980654Z [2024-03-21 02:46:01,076: INFO/ForkPoolWorker-15] [5527deb7-335f-4cb4-9cbc-e74583b625a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:46:01.079063870Z [2024-03-21 02:46:01,078: INFO/ForkPoolWorker-2] [63d5c349-3a1b-4349-bcab-65827849f153] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:46:01.380228611Z [2024-03-21 02:46:01,376: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:46:01.448991686Z [2024-03-21 02:46:01,443: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:46:01.460141760Z [2024-03-21 02:46:01,455: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:46:01.489168546Z [2024-03-21 02:46:01,485: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:46:01.690518781Z [2024-03-21 02:46:01,690: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T02:46:01.694631099Z [2024-03-21 02:46:01,694: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:46:01.741262644Z [2024-03-21 02:46:01,740: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:46:01.745857836Z [2024-03-21 02:46:01,745: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:46:01.746439996Z [2024-03-21 02:46:01,746: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:46:01.746905449Z [2024-03-21 02:46:01,746: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T02:46:01.747209860Z [2024-03-21 02:46:01,747: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:46:01.879319154Z [2024-03-21 02:46:01,878: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:46:01.895782292Z [2024-03-21 02:46:01,895: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:46:02.728432510Z [2024-03-21 02:46:02,727: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d2c35d63-5b26-4157-a190-6fbf20c3e16c] succeeded in 1.6768776179997076s: None
2024-03-21T02:46:02.730575385Z [2024-03-21 02:46:02,729: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[63d5c349-3a1b-4349-bcab-65827849f153] succeeded in 1.6589220899986685s: None
2024-03-21T02:46:03.191769295Z [2024-03-21 02:46:03,191: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:46:03.195508819Z [2024-03-21 02:46:03,194: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:46:03.225320757Z [2024-03-21 02:46:03,225: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:46:03.227311818Z [2024-03-21 02:46:03,227: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:46:03.227444543Z [2024-03-21 02:46:03,227: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:46:03.227649117Z [2024-03-21 02:46:03,227: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:46:03.227721462Z [2024-03-21 02:46:03,227: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:46:03.228159344Z [2024-03-21 02:46:03,227: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:46:03.228260478Z [2024-03-21 02:46:03,228: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:46:03.325692507Z [2024-03-21 02:46:03,325: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:46:03.336948392Z [2024-03-21 02:46:03,336: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:46:03.340958053Z [2024-03-21 02:46:03,340: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:46:03.372360150Z [2024-03-21 02:46:03,371: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:46:03.374469769Z [2024-03-21 02:46:03,374: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:46:03.374578873Z [2024-03-21 02:46:03,374: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:46:03.374816054Z [2024-03-21 02:46:03,374: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:46:03.375022516Z [2024-03-21 02:46:03,374: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:46:03.375533331Z [2024-03-21 02:46:03,375: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:46:03.376184237Z [2024-03-21 02:46:03,375: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:46:03.489208142Z [2024-03-21 02:46:03,488: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:46:05.342043985Z [2024-03-21 02:46:05,341: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5527deb7-335f-4cb4-9cbc-e74583b625a1] succeeded in 4.283771362999687s: None
2024-03-21T02:46:05.986074989Z [2024-03-21 02:46:05,985: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[355fedca-7b7f-4228-b18a-72540b8dab78] succeeded in 4.93203286500102s: None
2024-03-21T02:47:00.358526276Z [2024-03-21 02:47:00,358: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7053aa63-4362-469e-afd8-3791874dc5ef] received
2024-03-21T02:47:00.361501444Z [2024-03-21 02:47:00,361: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba956b51-16e7-4c57-b401-71b940fc97b1] received
2024-03-21T02:47:00.368167049Z [2024-03-21 02:47:00,367: INFO/ForkPoolWorker-15] [7053aa63-4362-469e-afd8-3791874dc5ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:47:00.375720207Z [2024-03-21 02:47:00,375: INFO/ForkPoolWorker-16] [ba956b51-16e7-4c57-b401-71b940fc97b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:47:00.380723403Z [2024-03-21 02:47:00,380: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18cf90de-ce82-4093-aa27-626e974b63ef] received
2024-03-21T02:47:00.390768308Z [2024-03-21 02:47:00,390: INFO/ForkPoolWorker-1] [18cf90de-ce82-4093-aa27-626e974b63ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:47:00.709752797Z [2024-03-21 02:47:00,706: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:47:00.712378319Z [2024-03-21 02:47:00,706: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:47:00.729423247Z [2024-03-21 02:47:00,725: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:47:00.924681844Z [2024-03-21 02:47:00,924: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T02:47:00.929335418Z [2024-03-21 02:47:00,928: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:47:00.961351218Z [2024-03-21 02:47:00,961: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:47:00.962699401Z [2024-03-21 02:47:00,962: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:47:00.962952661Z [2024-03-21 02:47:00,962: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:47:00.963115305Z [2024-03-21 02:47:00,962: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T02:47:00.963334926Z [2024-03-21 02:47:00,963: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:47:01.135419571Z [2024-03-21 02:47:01,135: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:47:01.870323718Z [2024-03-21 02:47:01,869: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ba956b51-16e7-4c57-b401-71b940fc97b1] succeeded in 1.5059334270008549s: None
2024-03-21T02:47:02.219914006Z [2024-03-21 02:47:02,219: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:47:02.223906706Z [2024-03-21 02:47:02,223: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:47:02.246696280Z [2024-03-21 02:47:02,246: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:47:02.254212996Z [2024-03-21 02:47:02,253: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:47:02.255077407Z [2024-03-21 02:47:02,253: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:47:02.255565227Z [2024-03-21 02:47:02,255: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:47:02.255596317Z [2024-03-21 02:47:02,255: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:47:02.255704335Z [2024-03-21 02:47:02,255: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:47:02.255758036Z [2024-03-21 02:47:02,255: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:47:02.256215838Z [2024-03-21 02:47:02,255: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:47:02.256222732Z [2024-03-21 02:47:02,255: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:47:02.327258650Z [2024-03-21 02:47:02,326: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:47:02.329300366Z [2024-03-21 02:47:02,328: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:47:02.329883455Z [2024-03-21 02:47:02,329: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:47:02.330262703Z [2024-03-21 02:47:02,329: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:47:02.330518709Z [2024-03-21 02:47:02,330: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:47:02.331008108Z [2024-03-21 02:47:02,330: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:47:02.331411467Z [2024-03-21 02:47:02,330: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:47:02.442861997Z [2024-03-21 02:47:02,442: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:47:02.503629274Z [2024-03-21 02:47:02,503: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:47:03.984758664Z [2024-03-21 02:47:03,984: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7053aa63-4362-469e-afd8-3791874dc5ef] succeeded in 3.6227300299997296s: None
2024-03-21T02:47:04.567520194Z [2024-03-21 02:47:04,566: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[18cf90de-ce82-4093-aa27-626e974b63ef] succeeded in 4.184055900999738s: None
2024-03-21T02:48:00.976230468Z [2024-03-21 02:48:00,975: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[931d21ff-e766-4c0e-84f4-50bb0ecaec32] received
2024-03-21T02:48:00.982056750Z [2024-03-21 02:48:00,981: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ebfe6cf2-e33e-4799-95a9-c63184f818ba] received
2024-03-21T02:48:00.988470586Z [2024-03-21 02:48:00,987: INFO/ForkPoolWorker-15] [931d21ff-e766-4c0e-84f4-50bb0ecaec32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:48:00.988974417Z [2024-03-21 02:48:00,988: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb2bff12-fecf-4fb1-9669-2faaa883bda6] received
2024-03-21T02:48:00.994374916Z [2024-03-21 02:48:00,994: INFO/ForkPoolWorker-16] [ebfe6cf2-e33e-4799-95a9-c63184f818ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:48:00.999270128Z [2024-03-21 02:48:00,998: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ab017ae-9528-4795-9796-c81cbea5fd77] received
2024-03-21T02:48:01.000072387Z [2024-03-21 02:48:00,999: INFO/ForkPoolWorker-1] [cb2bff12-fecf-4fb1-9669-2faaa883bda6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:48:01.016696701Z [2024-03-21 02:48:01,016: INFO/ForkPoolWorker-2] [4ab017ae-9528-4795-9796-c81cbea5fd77] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:48:01.406110176Z [2024-03-21 02:48:01,402: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:48:01.458530303Z [2024-03-21 02:48:01,453: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:48:01.561156273Z [2024-03-21 02:48:01,556: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:48:01.700076418Z [2024-03-21 02:48:01,696: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:48:01.703299221Z [2024-03-21 02:48:01,702: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T02:48:01.708359615Z [2024-03-21 02:48:01,707: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:48:01.731284993Z [2024-03-21 02:48:01,731: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:48:01.732794959Z [2024-03-21 02:48:01,732: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:48:01.735683222Z [2024-03-21 02:48:01,735: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:48:01.735818355Z [2024-03-21 02:48:01,735: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T02:48:01.736161465Z [2024-03-21 02:48:01,735: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:48:01.800130340Z [2024-03-21 02:48:01,799: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:48:01.909593220Z [2024-03-21 02:48:01,909: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:48:02.860835593Z [2024-03-21 02:48:02,859: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ebfe6cf2-e33e-4799-95a9-c63184f818ba] succeeded in 1.8760422000013932s: None
2024-03-21T02:48:02.957270384Z [2024-03-21 02:48:02,956: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cb2bff12-fecf-4fb1-9669-2faaa883bda6] succeeded in 1.966387221000332s: None
2024-03-21T02:48:03.366151657Z [2024-03-21 02:48:03,365: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T02:48:03.374091739Z [2024-03-21 02:48:03,373: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:48:03.382986486Z [2024-03-21 02:48:03,382: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:48:03.386949774Z [2024-03-21 02:48:03,386: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:48:03.410087214Z [2024-03-21 02:48:03,409: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:48:03.413877481Z [2024-03-21 02:48:03,413: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:48:03.413910636Z [2024-03-21 02:48:03,413: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:48:03.414123654Z [2024-03-21 02:48:03,413: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:48:03.414215001Z [2024-03-21 02:48:03,414: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T02:48:03.414722442Z [2024-03-21 02:48:03,414: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:48:03.414790756Z [2024-03-21 02:48:03,414: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:48:03.423122208Z [2024-03-21 02:48:03,422: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:48:03.428570216Z [2024-03-21 02:48:03,428: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:48:03.428764068Z [2024-03-21 02:48:03,428: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:48:03.429119130Z [2024-03-21 02:48:03,428: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:48:03.429275614Z [2024-03-21 02:48:03,429: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:48:03.429644558Z [2024-03-21 02:48:03,429: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:48:03.430221634Z [2024-03-21 02:48:03,429: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:48:03.508722159Z [2024-03-21 02:48:03,508: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:48:03.525088067Z [2024-03-21 02:48:03,524: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:48:05.061781524Z [2024-03-21 02:48:05,061: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[931d21ff-e766-4c0e-84f4-50bb0ecaec32] succeeded in 4.080213893999826s: None
2024-03-21T02:48:05.486829900Z [2024-03-21 02:48:05,486: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4ab017ae-9528-4795-9796-c81cbea5fd77] succeeded in 4.479310030999841s: None
2024-03-21T02:49:00.857638384Z [2024-03-21 02:49:00,857: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e93d890-e8d3-4cd1-b4bc-9b9a916d814a] received
2024-03-21T02:49:00.869153348Z [2024-03-21 02:49:00,868: INFO/ForkPoolWorker-15] [9e93d890-e8d3-4cd1-b4bc-9b9a916d814a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:49:00.875600070Z [2024-03-21 02:49:00,875: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96ef9e55-b6b6-41d8-9c35-774698e75c9c] received
2024-03-21T02:49:00.887830967Z [2024-03-21 02:49:00,887: INFO/ForkPoolWorker-16] [96ef9e55-b6b6-41d8-9c35-774698e75c9c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:49:00.896961951Z [2024-03-21 02:49:00,896: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc254d18-9823-47db-9ead-b525caf9c75d] received
2024-03-21T02:49:00.905965093Z [2024-03-21 02:49:00,905: INFO/ForkPoolWorker-1] [fc254d18-9823-47db-9ead-b525caf9c75d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:49:01.233375842Z [2024-03-21 02:49:01,229: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:49:01.282403528Z [2024-03-21 02:49:01,278: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:49:01.336125360Z [2024-03-21 02:49:01,328: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:49:01.439068734Z [2024-03-21 02:49:01,438: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T02:49:01.443248256Z [2024-03-21 02:49:01,442: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:49:01.489942974Z [2024-03-21 02:49:01,489: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:49:01.491368899Z [2024-03-21 02:49:01,491: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:49:01.491980472Z [2024-03-21 02:49:01,491: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:49:01.492206785Z [2024-03-21 02:49:01,491: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T02:49:01.492592198Z [2024-03-21 02:49:01,492: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:49:01.656970662Z [2024-03-21 02:49:01,656: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:49:02.503335278Z [2024-03-21 02:49:02,502: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fc254d18-9823-47db-9ead-b525caf9c75d] succeeded in 1.604488842000137s: None
2024-03-21T02:49:02.793864087Z [2024-03-21 02:49:02,793: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:49:02.797290943Z [2024-03-21 02:49:02,796: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:49:02.819429082Z [2024-03-21 02:49:02,819: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:49:02.821049053Z [2024-03-21 02:49:02,820: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:49:02.821230296Z [2024-03-21 02:49:02,821: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:49:02.821360350Z [2024-03-21 02:49:02,821: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:49:02.821422879Z [2024-03-21 02:49:02,821: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:49:02.821769186Z [2024-03-21 02:49:02,821: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:49:02.821839363Z [2024-03-21 02:49:02,821: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:49:02.929101309Z [2024-03-21 02:49:02,928: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:49:03.090194742Z [2024-03-21 02:49:03,089: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:49:03.094117452Z [2024-03-21 02:49:03,093: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:49:03.117500343Z [2024-03-21 02:49:03,117: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:49:03.118857296Z [2024-03-21 02:49:03,118: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:49:03.119015834Z [2024-03-21 02:49:03,118: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:49:03.119344680Z [2024-03-21 02:49:03,118: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:49:03.119552526Z [2024-03-21 02:49:03,119: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:49:03.120135655Z [2024-03-21 02:49:03,119: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:49:03.120659651Z [2024-03-21 02:49:03,120: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:49:03.220692582Z [2024-03-21 02:49:03,220: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:49:04.687550733Z [2024-03-21 02:49:04,686: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9e93d890-e8d3-4cd1-b4bc-9b9a916d814a] succeeded in 3.8258004979998077s: None
2024-03-21T02:49:05.266304990Z [2024-03-21 02:49:05,265: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[96ef9e55-b6b6-41d8-9c35-774698e75c9c] succeeded in 4.388740394999331s: None
2024-03-21T02:50:00.389745100Z [2024-03-21 02:50:00,389: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3ad5fbc-e852-4881-a154-44c6ba39ab0b] received
2024-03-21T02:50:00.392859022Z [2024-03-21 02:50:00,392: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19cceb8c-e254-456c-91a8-070fecf3fb1b] received
2024-03-21T02:50:00.397882402Z [2024-03-21 02:50:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c73d075c-c868-48cb-b58e-564effecc67b] received
2024-03-21T02:50:00.399994729Z [2024-03-21 02:50:00,399: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c46869d6-1d84-4369-abeb-a40bc6b6394e] received
2024-03-21T02:50:00.401492062Z [2024-03-21 02:50:00,401: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[516aeeb2-da8c-4a0c-ba28-29e7e732bfb5] received
2024-03-21T02:50:00.422658985Z [2024-03-21 02:50:00,421: INFO/ForkPoolWorker-3] [516aeeb2-da8c-4a0c-ba28-29e7e732bfb5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:50:00.423383355Z [2024-03-21 02:50:00,422: INFO/ForkPoolWorker-1] [c73d075c-c868-48cb-b58e-564effecc67b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:50:00.426309753Z [2024-03-21 02:50:00,426: INFO/ForkPoolWorker-16] [19cceb8c-e254-456c-91a8-070fecf3fb1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:50:00.426848418Z [2024-03-21 02:50:00,426: INFO/ForkPoolWorker-15] [b3ad5fbc-e852-4881-a154-44c6ba39ab0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:50:00.427377977Z [2024-03-21 02:50:00,427: INFO/ForkPoolWorker-2] [c46869d6-1d84-4369-abeb-a40bc6b6394e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:50:00.824084452Z [2024-03-21 02:50:00,819: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:50:00.947458828Z [2024-03-21 02:50:00,944: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:50:01.080755872Z [2024-03-21 02:50:01,080: INFO/ForkPoolWorker-3] Getting SDNC list
2024-03-21T02:50:01.087225923Z [2024-03-21 02:50:01,086: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:50:01.118918101Z [2024-03-21 02:50:01,118: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-21T02:50:01.120459224Z [2024-03-21 02:50:01,120: INFO/ForkPoolWorker-3] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:50:01.120700531Z [2024-03-21 02:50:01,120: INFO/ForkPoolWorker-3] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:50:01.120811910Z [2024-03-21 02:50:01,120: INFO/ForkPoolWorker-3] Getting SDNC list OK
2024-03-21T02:50:01.121092025Z [2024-03-21 02:50:01,120: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:50:01.257842902Z [2024-03-21 02:50:01,252: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:50:01.270645553Z [2024-03-21 02:50:01,270: INFO/ForkPoolWorker-3] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:50:01.309749981Z [2024-03-21 02:50:01,302: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:50:01.315114155Z [2024-03-21 02:50:01,309: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:50:02.394830623Z [2024-03-21 02:50:02,394: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:50:02.438781088Z [2024-03-21 02:50:02,438: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[516aeeb2-da8c-4a0c-ba28-29e7e732bfb5] succeeded in 2.032946160999927s: None
2024-03-21T02:50:03.354975274Z [2024-03-21 02:50:03,354: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[19cceb8c-e254-456c-91a8-070fecf3fb1b] succeeded in 2.9565383450008085s: None
2024-03-21T02:50:03.366952383Z [2024-03-21 02:50:03,366: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T02:50:03.371938012Z [2024-03-21 02:50:03,371: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:50:03.430132590Z [2024-03-21 02:50:03,429: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:50:03.431793593Z [2024-03-21 02:50:03,431: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:50:03.432663181Z [2024-03-21 02:50:03,431: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:50:03.432959147Z [2024-03-21 02:50:03,432: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:50:03.433230275Z [2024-03-21 02:50:03,433: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T02:50:03.434142516Z [2024-03-21 02:50:03,433: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:50:03.434343947Z [2024-03-21 02:50:03,434: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:50:03.579206077Z [2024-03-21 02:50:03,578: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:50:03.660175768Z [2024-03-21 02:50:03,659: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:50:03.672366246Z [2024-03-21 02:50:03,671: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:50:03.780563296Z [2024-03-21 02:50:03,780: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:50:03.782395266Z [2024-03-21 02:50:03,782: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:50:03.782556215Z [2024-03-21 02:50:03,782: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:50:03.782870204Z [2024-03-21 02:50:03,782: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:50:03.783089793Z [2024-03-21 02:50:03,782: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:50:03.783441775Z [2024-03-21 02:50:03,783: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:50:03.783796225Z [2024-03-21 02:50:03,783: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:50:03.986735410Z [2024-03-21 02:50:03,986: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T02:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:50:04.055012772Z [2024-03-21 02:50:04,054: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:50:04.058533376Z [2024-03-21 02:50:04,058: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:50:04.077733792Z [2024-03-21 02:50:04,077: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:50:04.079008280Z [2024-03-21 02:50:04,078: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:50:04.079021187Z [2024-03-21 02:50:04,078: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:50:04.079129356Z [2024-03-21 02:50:04,078: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:50:04.079140990Z [2024-03-21 02:50:04,079: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:50:04.079388095Z [2024-03-21 02:50:04,079: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:50:04.079400228Z [2024-03-21 02:50:04,079: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:50:04.341260068Z [2024-03-21 02:50:04,340: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:50:05.015153585Z [2024-03-21 02:50:05,014: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b3ad5fbc-e852-4881-a154-44c6ba39ab0b] succeeded in 4.61954141500064s: None
2024-03-21T02:50:05.498885432Z [2024-03-21 02:50:05,498: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c46869d6-1d84-4369-abeb-a40bc6b6394e] succeeded in 5.096107384999414s: None
2024-03-21T02:50:05.716350145Z [2024-03-21 02:50:05,715: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c47f1f88-cfb1-4425-9cf6-dd59b8418020] received
2024-03-21T02:50:05.724620498Z [2024-03-21 02:50:05,724: INFO/ForkPoolWorker-15] [c47f1f88-cfb1-4425-9cf6-dd59b8418020] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:50:06.059039173Z [2024-03-21 02:50:06,055: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:50:06.801764157Z [2024-03-21 02:50:06,801: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c73d075c-c868-48cb-b58e-564effecc67b] succeeded in 6.401829091999389s: None
2024-03-21T02:50:07.404758603Z [2024-03-21 02:50:07,404: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:50:07.408845523Z [2024-03-21 02:50:07,408: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:50:07.430467443Z [2024-03-21 02:50:07,430: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:50:07.432206239Z [2024-03-21 02:50:07,431: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:50:07.432240364Z [2024-03-21 02:50:07,432: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:50:07.432297165Z [2024-03-21 02:50:07,432: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:50:07.432461709Z [2024-03-21 02:50:07,432: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:50:07.432679496Z [2024-03-21 02:50:07,432: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:50:07.433107554Z [2024-03-21 02:50:07,432: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:50:07.523991708Z [2024-03-21 02:50:07,523: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T02:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:50:08.175220478Z [2024-03-21 02:50:08,172: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c47f1f88-cfb1-4425-9cf6-dd59b8418020] succeeded in 2.4545694520002144s: None
2024-03-21T02:50:08.565145048Z [2024-03-21 02:50:08,564: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2f1708c-4e40-467f-8564-8146063fb000] received
2024-03-21T02:50:08.582161586Z [2024-03-21 02:50:08,581: INFO/ForkPoolWorker-15] [f2f1708c-4e40-467f-8564-8146063fb000] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T02:50:08.973188806Z [2024-03-21 02:50:08,969: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:50:10.339580728Z [2024-03-21 02:50:10,339: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:50:10.347241967Z [2024-03-21 02:50:10,343: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:50:10.377289782Z [2024-03-21 02:50:10,377: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:50:10.378662655Z [2024-03-21 02:50:10,378: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:50:10.378827799Z [2024-03-21 02:50:10,378: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:50:10.379037116Z [2024-03-21 02:50:10,378: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:50:10.379123526Z [2024-03-21 02:50:10,379: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:50:10.379942506Z [2024-03-21 02:50:10,379: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:50:10.380114009Z [2024-03-21 02:50:10,379: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:50:10.472557897Z [2024-03-21 02:50:10,472: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T02:45:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:50:11.048166349Z [2024-03-21 02:50:11,047: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f2f1708c-4e40-467f-8564-8146063fb000] succeeded in 2.479967948000194s: None
2024-03-21T02:50:12.051978497Z [2024-03-21 02:50:12,051: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b48540bf-f426-44dc-9972-0bb872008504] received
2024-03-21T02:50:12.060166431Z [2024-03-21 02:50:12,059: INFO/ForkPoolWorker-15] [b48540bf-f426-44dc-9972-0bb872008504] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:50:12.435088774Z [2024-03-21 02:50:12,431: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:50:13.617321566Z [2024-03-21 02:50:13,616: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:50:13.620740332Z [2024-03-21 02:50:13,620: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:50:13.638298136Z [2024-03-21 02:50:13,638: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:50:13.639812663Z [2024-03-21 02:50:13,639: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:50:13.639963314Z [2024-03-21 02:50:13,639: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:50:13.640220396Z [2024-03-21 02:50:13,639: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:50:13.640469691Z [2024-03-21 02:50:13,640: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:50:13.640835838Z [2024-03-21 02:50:13,640: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:50:13.640988837Z [2024-03-21 02:50:13,640: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:50:13.725709361Z [2024-03-21 02:50:13,725: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T02:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:50:14.291670254Z [2024-03-21 02:50:14,291: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b48540bf-f426-44dc-9972-0bb872008504] succeeded in 2.2367011120004463s: None
2024-03-21T02:51:00.374747362Z [2024-03-21 02:51:00,374: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[095eae2d-0ace-4656-a2d7-ac2dfb953757] received
2024-03-21T02:51:00.380803821Z [2024-03-21 02:51:00,380: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8e0a14b-0694-431e-af79-348a663b8b4a] received
2024-03-21T02:51:00.387936265Z [2024-03-21 02:51:00,387: INFO/ForkPoolWorker-16] [e8e0a14b-0694-431e-af79-348a663b8b4a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:51:00.388842322Z [2024-03-21 02:51:00,388: INFO/ForkPoolWorker-15] [095eae2d-0ace-4656-a2d7-ac2dfb953757] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:51:00.394893757Z [2024-03-21 02:51:00,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82d9d3f9-b6e4-4af5-97a1-fe88615b6625] received
2024-03-21T02:51:00.408337183Z [2024-03-21 02:51:00,408: INFO/ForkPoolWorker-1] [82d9d3f9-b6e4-4af5-97a1-fe88615b6625] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:51:00.718051913Z [2024-03-21 02:51:00,714: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:51:00.737370987Z [2024-03-21 02:51:00,733: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:51:00.749596869Z [2024-03-21 02:51:00,746: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:51:00.913160351Z [2024-03-21 02:51:00,912: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T02:51:00.917090049Z [2024-03-21 02:51:00,916: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:51:00.934439632Z [2024-03-21 02:51:00,934: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:51:00.935954155Z [2024-03-21 02:51:00,935: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:51:00.936129888Z [2024-03-21 02:51:00,935: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:51:00.936213395Z [2024-03-21 02:51:00,936: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T02:51:00.936526579Z [2024-03-21 02:51:00,936: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:51:01.077616508Z [2024-03-21 02:51:01,077: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:51:01.695221055Z [2024-03-21 02:51:01,694: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e8e0a14b-0694-431e-af79-348a663b8b4a] succeeded in 1.3121188409986644s: None
2024-03-21T02:51:02.032640414Z [2024-03-21 02:51:02,032: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:51:02.037691485Z [2024-03-21 02:51:02,036: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:51:02.065531329Z [2024-03-21 02:51:02,065: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:51:02.067107767Z [2024-03-21 02:51:02,066: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:51:02.067131842Z [2024-03-21 02:51:02,067: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:51:02.067287876Z [2024-03-21 02:51:02,067: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:51:02.067307609Z [2024-03-21 02:51:02,067: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:51:02.067590963Z [2024-03-21 02:51:02,067: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:51:02.067606510Z [2024-03-21 02:51:02,067: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:51:02.175888743Z [2024-03-21 02:51:02,175: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:51:02.178552969Z [2024-03-21 02:51:02,178: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:51:02.179667984Z [2024-03-21 02:51:02,179: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:51:02.205442200Z [2024-03-21 02:51:02,205: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:51:02.206695204Z [2024-03-21 02:51:02,206: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:51:02.206807860Z [2024-03-21 02:51:02,206: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:51:02.206998793Z [2024-03-21 02:51:02,206: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:51:02.207054786Z [2024-03-21 02:51:02,206: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:51:02.207496065Z [2024-03-21 02:51:02,207: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:51:02.207515503Z [2024-03-21 02:51:02,207: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:51:02.355547404Z [2024-03-21 02:51:02,355: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:51:04.253644334Z [2024-03-21 02:51:04,253: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[82d9d3f9-b6e4-4af5-97a1-fe88615b6625] succeeded in 3.855429811999784s: None
2024-03-21T02:51:04.445899597Z [2024-03-21 02:51:04,445: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[095eae2d-0ace-4656-a2d7-ac2dfb953757] succeeded in 4.069229896000252s: None
2024-03-21T02:52:01.186578173Z [2024-03-21 02:52:01,186: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4ba60b0-abe9-4997-b705-5fbba6928f36] received
2024-03-21T02:52:01.190857693Z [2024-03-21 02:52:01,190: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe853e16-4717-46a0-98cb-7f16d9c87a10] received
2024-03-21T02:52:01.194314408Z [2024-03-21 02:52:01,194: INFO/ForkPoolWorker-15] [e4ba60b0-abe9-4997-b705-5fbba6928f36] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:52:01.196591903Z [2024-03-21 02:52:01,196: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6291064-2b99-4e50-98ce-04783d131b91] received
2024-03-21T02:52:01.203339425Z [2024-03-21 02:52:01,203: INFO/ForkPoolWorker-16] [fe853e16-4717-46a0-98cb-7f16d9c87a10] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:52:01.216280438Z [2024-03-21 02:52:01,215: INFO/ForkPoolWorker-1] [c6291064-2b99-4e50-98ce-04783d131b91] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:52:01.535181883Z [2024-03-21 02:52:01,534: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0b3e0d8-cd84-438a-ab43-59ce2d4be0bb] received
2024-03-21T02:52:01.562957904Z [2024-03-21 02:52:01,562: INFO/ForkPoolWorker-2] [b0b3e0d8-cd84-438a-ab43-59ce2d4be0bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:52:01.663302922Z [2024-03-21 02:52:01,659: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:52:01.915902860Z [2024-03-21 02:52:01,911: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:52:01.957227774Z [2024-03-21 02:52:01,952: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:52:01.998854681Z [2024-03-21 02:52:01,998: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:52:02.156808118Z [2024-03-21 02:52:02,152: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:52:02.362881487Z [2024-03-21 02:52:02,360: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T02:52:02.380583050Z [2024-03-21 02:52:02,372: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:52:02.506817217Z [2024-03-21 02:52:02,506: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:52:02.507994739Z [2024-03-21 02:52:02,507: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:52:02.508069345Z [2024-03-21 02:52:02,507: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:52:02.508104558Z [2024-03-21 02:52:02,508: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T02:52:02.508343747Z [2024-03-21 02:52:02,508: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:52:02.699255936Z [2024-03-21 02:52:02,698: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:52:02.937883222Z [2024-03-21 02:52:02,937: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e4ba60b0-abe9-4997-b705-5fbba6928f36] succeeded in 1.7491709909991187s: None
2024-03-21T02:52:03.545516347Z [2024-03-21 02:52:03,545: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c6291064-2b99-4e50-98ce-04783d131b91] succeeded in 2.346014009999635s: None
2024-03-21T02:52:03.877101582Z [2024-03-21 02:52:03,876: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:52:03.881334677Z [2024-03-21 02:52:03,880: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:52:03.921406498Z [2024-03-21 02:52:03,921: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:52:03.922920256Z [2024-03-21 02:52:03,922: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:52:03.923048714Z [2024-03-21 02:52:03,922: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:52:03.923263721Z [2024-03-21 02:52:03,923: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:52:03.923332118Z [2024-03-21 02:52:03,923: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:52:03.923999855Z [2024-03-21 02:52:03,923: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:52:03.924157400Z [2024-03-21 02:52:03,924: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:52:04.026500075Z [2024-03-21 02:52:04,026: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:52:04.184446106Z [2024-03-21 02:52:04,183: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T02:52:04.188717068Z [2024-03-21 02:52:04,187: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:52:04.231251807Z [2024-03-21 02:52:04,230: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:52:04.233230387Z [2024-03-21 02:52:04,232: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:52:04.233273511Z [2024-03-21 02:52:04,233: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:52:04.233458667Z [2024-03-21 02:52:04,233: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:52:04.233494403Z [2024-03-21 02:52:04,233: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T02:52:04.234514046Z [2024-03-21 02:52:04,233: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:52:04.234648286Z [2024-03-21 02:52:04,234: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:52:04.363968375Z [2024-03-21 02:52:04,363: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:52:06.587811263Z [2024-03-21 02:52:06,587: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fe853e16-4717-46a0-98cb-7f16d9c87a10] succeeded in 5.3951354320015525s: None
2024-03-21T02:52:06.966951261Z [2024-03-21 02:52:06,966: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b0b3e0d8-cd84-438a-ab43-59ce2d4be0bb] succeeded in 5.419254930000534s: None
2024-03-21T02:53:01.026523387Z [2024-03-21 02:53:01,026: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ee22111-55fe-4427-931a-0337deceb6ab] received
2024-03-21T02:53:01.035799945Z [2024-03-21 02:53:01,035: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c17ad0e3-bb9d-42e3-be18-b72f66d02399] received
2024-03-21T02:53:01.037561430Z [2024-03-21 02:53:01,037: INFO/ForkPoolWorker-15] [3ee22111-55fe-4427-931a-0337deceb6ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:53:01.049423590Z [2024-03-21 02:53:01,048: INFO/ForkPoolWorker-16] [c17ad0e3-bb9d-42e3-be18-b72f66d02399] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:53:01.081469811Z [2024-03-21 02:53:01,081: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[976e1555-e28b-4a02-8fd8-3cf100308342] received
2024-03-21T02:53:01.090166139Z [2024-03-21 02:53:01,089: INFO/ForkPoolWorker-1] [976e1555-e28b-4a02-8fd8-3cf100308342] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:53:01.426913656Z [2024-03-21 02:53:01,422: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:53:01.438540008Z [2024-03-21 02:53:01,434: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:53:01.471586644Z [2024-03-21 02:53:01,467: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:53:01.633881174Z [2024-03-21 02:53:01,633: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T02:53:01.638239563Z [2024-03-21 02:53:01,637: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:53:01.669426651Z [2024-03-21 02:53:01,669: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:53:01.671180561Z [2024-03-21 02:53:01,670: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:53:01.671281762Z [2024-03-21 02:53:01,671: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:53:01.671366960Z [2024-03-21 02:53:01,671: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T02:53:01.671669919Z [2024-03-21 02:53:01,671: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:53:01.807053956Z [2024-03-21 02:53:01,806: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:53:02.553298831Z [2024-03-21 02:53:02,552: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[976e1555-e28b-4a02-8fd8-3cf100308342] succeeded in 1.469910528001492s: None
2024-03-21T02:53:02.858873921Z [2024-03-21 02:53:02,858: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:53:02.862509844Z [2024-03-21 02:53:02,861: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:53:02.901804605Z [2024-03-21 02:53:02,901: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:53:02.903484061Z [2024-03-21 02:53:02,903: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:53:02.903570183Z [2024-03-21 02:53:02,903: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:53:02.903726563Z [2024-03-21 02:53:02,903: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:53:02.903804712Z [2024-03-21 02:53:02,903: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:53:02.904194997Z [2024-03-21 02:53:02,903: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:53:02.904211336Z [2024-03-21 02:53:02,904: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:53:02.982410525Z [2024-03-21 02:53:02,982: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:53:03.079567847Z [2024-03-21 02:53:03,079: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:53:03.084083000Z [2024-03-21 02:53:03,083: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:53:03.118916099Z [2024-03-21 02:53:03,118: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:53:03.122348127Z [2024-03-21 02:53:03,121: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:53:03.122582721Z [2024-03-21 02:53:03,122: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:53:03.122922004Z [2024-03-21 02:53:03,122: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:53:03.123118049Z [2024-03-21 02:53:03,122: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:53:03.123737810Z [2024-03-21 02:53:03,123: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:53:03.123918335Z [2024-03-21 02:53:03,123: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:53:03.276246337Z [2024-03-21 02:53:03,275: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:53:04.945774655Z [2024-03-21 02:53:04,945: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c17ad0e3-bb9d-42e3-be18-b72f66d02399] succeeded in 3.904459503999533s: None
2024-03-21T02:53:05.446323992Z [2024-03-21 02:53:05,445: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3ee22111-55fe-4427-931a-0337deceb6ab] succeeded in 4.415365748000113s: None
2024-03-21T02:54:00.831799069Z [2024-03-21 02:54:00,831: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79b6c646-9383-4dba-8e87-181172ad3ec2] received
2024-03-21T02:54:00.834456643Z [2024-03-21 02:54:00,834: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c7bf2b0-973a-44e4-b617-a00106599ddb] received
2024-03-21T02:54:00.845399568Z [2024-03-21 02:54:00,845: INFO/ForkPoolWorker-15] [79b6c646-9383-4dba-8e87-181172ad3ec2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:54:00.845427407Z [2024-03-21 02:54:00,845: INFO/ForkPoolWorker-16] [7c7bf2b0-973a-44e4-b617-a00106599ddb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:54:00.853157009Z [2024-03-21 02:54:00,852: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e498c43-d57f-4700-8e05-19e809053861] received
2024-03-21T02:54:00.854894296Z [2024-03-21 02:54:00,854: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4fd17d0e-2d28-47a7-b9d2-1a5a92715548] received
2024-03-21T02:54:00.876622846Z [2024-03-21 02:54:00,876: INFO/ForkPoolWorker-1] [7e498c43-d57f-4700-8e05-19e809053861] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:54:00.886023966Z [2024-03-21 02:54:00,885: INFO/ForkPoolWorker-2] [4fd17d0e-2d28-47a7-b9d2-1a5a92715548] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:54:01.232099601Z [2024-03-21 02:54:01,227: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:54:01.263109401Z [2024-03-21 02:54:01,259: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:54:01.285482980Z [2024-03-21 02:54:01,281: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:54:01.395268663Z [2024-03-21 02:54:01,391: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:54:01.554224479Z [2024-03-21 02:54:01,553: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:54:01.607566149Z [2024-03-21 02:54:01,606: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T02:54:01.611674760Z [2024-03-21 02:54:01,611: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:54:01.646627073Z [2024-03-21 02:54:01,646: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:54:01.649166727Z [2024-03-21 02:54:01,648: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:54:01.649466586Z [2024-03-21 02:54:01,649: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:54:01.650094720Z [2024-03-21 02:54:01,649: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T02:54:01.650313886Z [2024-03-21 02:54:01,650: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:54:01.757646578Z [2024-03-21 02:54:01,757: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:54:02.113401990Z [2024-03-21 02:54:02,113: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[79b6c646-9383-4dba-8e87-181172ad3ec2] succeeded in 1.2781739639995067s: None
2024-03-21T02:54:02.502918551Z [2024-03-21 02:54:02,502: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4fd17d0e-2d28-47a7-b9d2-1a5a92715548] succeeded in 1.6436334849986451s: None
2024-03-21T02:54:02.744245773Z [2024-03-21 02:54:02,743: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:54:02.753785472Z [2024-03-21 02:54:02,752: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:54:02.764392643Z [2024-03-21 02:54:02,763: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:54:02.767880525Z [2024-03-21 02:54:02,767: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:54:02.784914045Z [2024-03-21 02:54:02,784: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:54:02.786935935Z [2024-03-21 02:54:02,786: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:54:02.787038985Z [2024-03-21 02:54:02,786: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:54:02.787205331Z [2024-03-21 02:54:02,786: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:54:02.787305251Z [2024-03-21 02:54:02,787: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:54:02.787701470Z [2024-03-21 02:54:02,787: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:54:02.787781896Z [2024-03-21 02:54:02,787: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:54:02.795839699Z [2024-03-21 02:54:02,795: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:54:02.797498627Z [2024-03-21 02:54:02,797: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:54:02.797651871Z [2024-03-21 02:54:02,797: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:54:02.797857502Z [2024-03-21 02:54:02,797: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:54:02.797968933Z [2024-03-21 02:54:02,797: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:54:02.798309710Z [2024-03-21 02:54:02,798: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:54:02.798441042Z [2024-03-21 02:54:02,798: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:54:02.896825437Z [2024-03-21 02:54:02,896: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:54:02.899825253Z [2024-03-21 02:54:02,899: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:54:05.367470636Z [2024-03-21 02:54:05,367: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7e498c43-d57f-4700-8e05-19e809053861] succeeded in 4.510784481000883s: None
2024-03-21T02:54:05.509431736Z [2024-03-21 02:54:05,508: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7c7bf2b0-973a-44e4-b617-a00106599ddb] succeeded in 4.671402054000282s: None
2024-03-21T02:55:00.330062601Z [2024-03-21 02:55:00,329: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8512243-dae1-4c5a-95f5-551260f5d956] received
2024-03-21T02:55:00.333548217Z [2024-03-21 02:55:00,333: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42d6ca7b-e4aa-45a3-8ee0-0a985a12b2a4] received
2024-03-21T02:55:00.338312471Z [2024-03-21 02:55:00,338: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0732197b-a249-4c83-996c-7ded518097dc] received
2024-03-21T02:55:00.347277469Z [2024-03-21 02:55:00,347: INFO/ForkPoolWorker-15] [b8512243-dae1-4c5a-95f5-551260f5d956] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:55:00.347728562Z [2024-03-21 02:55:00,347: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54ba762e-a392-46a8-ba1a-79ac248fc8b3] received
2024-03-21T02:55:00.349229769Z [2024-03-21 02:55:00,348: INFO/ForkPoolWorker-16] [42d6ca7b-e4aa-45a3-8ee0-0a985a12b2a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:55:00.358805101Z [2024-03-21 02:55:00,358: INFO/ForkPoolWorker-2] [54ba762e-a392-46a8-ba1a-79ac248fc8b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:55:00.364139385Z [2024-03-21 02:55:00,362: INFO/ForkPoolWorker-1] [0732197b-a249-4c83-996c-7ded518097dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:55:00.691102016Z [2024-03-21 02:55:00,687: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:55:00.754970026Z [2024-03-21 02:55:00,751: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:55:00.763491460Z [2024-03-21 02:55:00,755: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:55:00.771218671Z [2024-03-21 02:55:00,767: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:55:00.968812671Z [2024-03-21 02:55:00,968: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T02:55:00.972768931Z [2024-03-21 02:55:00,972: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:55:01.023181351Z [2024-03-21 02:55:01,022: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:55:01.025476918Z [2024-03-21 02:55:01,025: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:55:01.025604459Z [2024-03-21 02:55:01,025: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:55:01.025666725Z [2024-03-21 02:55:01,025: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T02:55:01.026010356Z [2024-03-21 02:55:01,025: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:55:01.158191248Z [2024-03-21 02:55:01,157: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:55:01.847857830Z [2024-03-21 02:55:01,847: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[42d6ca7b-e4aa-45a3-8ee0-0a985a12b2a4] succeeded in 1.5105690700002015s: None
2024-03-21T02:55:02.109606133Z [2024-03-21 02:55:02,109: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T02:55:02.113321886Z [2024-03-21 02:55:02,112: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:55:02.141753758Z [2024-03-21 02:55:02,141: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:55:02.143376035Z [2024-03-21 02:55:02,143: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:55:02.143401899Z [2024-03-21 02:55:02,143: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:55:02.143505566Z [2024-03-21 02:55:02,143: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:55:02.143704893Z [2024-03-21 02:55:02,143: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T02:55:02.143989271Z [2024-03-21 02:55:02,143: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:55:02.144037418Z [2024-03-21 02:55:02,143: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:55:02.195753469Z [2024-03-21 02:55:02,195: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:55:02.199431909Z [2024-03-21 02:55:02,198: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:55:02.227750581Z [2024-03-21 02:55:02,227: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:55:02.232611651Z [2024-03-21 02:55:02,230: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:55:02.232632879Z [2024-03-21 02:55:02,230: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:55:02.232637969Z [2024-03-21 02:55:02,231: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:55:02.232643122Z [2024-03-21 02:55:02,231: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:55:02.232647660Z [2024-03-21 02:55:02,232: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:55:02.235741747Z [2024-03-21 02:55:02,232: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:55:02.235757688Z [2024-03-21 02:55:02,235: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:55:02.422436280Z [2024-03-21 02:55:02,422: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:55:02.597951292Z [2024-03-21 02:55:02,597: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:55:02.603377643Z [2024-03-21 02:55:02,602: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:55:02.635597111Z [2024-03-21 02:55:02,635: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:55:02.636923946Z [2024-03-21 02:55:02,636: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:55:02.637044037Z [2024-03-21 02:55:02,636: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:55:02.637092864Z [2024-03-21 02:55:02,636: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:55:02.637105544Z [2024-03-21 02:55:02,637: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:55:02.637395370Z [2024-03-21 02:55:02,637: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:55:02.637411204Z [2024-03-21 02:55:02,637: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:55:02.768882572Z [2024-03-21 02:55:02,768: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T02:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:55:03.490535184Z [2024-03-21 02:55:03,489: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0732197b-a249-4c83-996c-7ded518097dc] succeeded in 3.138878800000384s: None
2024-03-21T02:55:04.197859380Z [2024-03-21 02:55:04,197: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b8512243-dae1-4c5a-95f5-551260f5d956] succeeded in 3.8625016119985958s: None
2024-03-21T02:55:04.353873380Z [2024-03-21 02:55:04,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58da0e65-bad6-4e59-a7cc-eabed84e1e61] received
2024-03-21T02:55:04.366202234Z [2024-03-21 02:55:04,365: INFO/ForkPoolWorker-15] [58da0e65-bad6-4e59-a7cc-eabed84e1e61] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:55:04.719977624Z [2024-03-21 02:55:04,715: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:55:05.050367069Z [2024-03-21 02:55:05,049: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[54ba762e-a392-46a8-ba1a-79ac248fc8b3] succeeded in 4.699973505999878s: None
2024-03-21T02:55:05.934004761Z [2024-03-21 02:55:05,933: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:55:05.937300268Z [2024-03-21 02:55:05,936: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:55:05.961235455Z [2024-03-21 02:55:05,960: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:55:05.962732511Z [2024-03-21 02:55:05,962: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:55:05.962772165Z [2024-03-21 02:55:05,962: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:55:05.962915905Z [2024-03-21 02:55:05,962: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:55:05.962959150Z [2024-03-21 02:55:05,962: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:55:05.963271577Z [2024-03-21 02:55:05,963: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:55:05.963335499Z [2024-03-21 02:55:05,963: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:55:06.044167237Z [2024-03-21 02:55:06,043: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T02:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:55:06.650360908Z [2024-03-21 02:55:06,649: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[58da0e65-bad6-4e59-a7cc-eabed84e1e61] succeeded in 2.2929113789996336s: None
2024-03-21T02:55:07.147807169Z [2024-03-21 02:55:07,147: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7228285-6847-41e2-b527-ed631dab1e39] received
2024-03-21T02:55:07.161102288Z [2024-03-21 02:55:07,160: INFO/ForkPoolWorker-15] [f7228285-6847-41e2-b527-ed631dab1e39] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T02:55:07.481737387Z [2024-03-21 02:55:07,478: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:55:08.659526341Z [2024-03-21 02:55:08,659: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:55:08.663097415Z [2024-03-21 02:55:08,662: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:55:08.691044036Z [2024-03-21 02:55:08,690: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:55:08.693123696Z [2024-03-21 02:55:08,692: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:55:08.693190668Z [2024-03-21 02:55:08,693: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:55:08.693472736Z [2024-03-21 02:55:08,693: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:55:08.693592109Z [2024-03-21 02:55:08,693: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:55:08.694033784Z [2024-03-21 02:55:08,693: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:55:08.694143994Z [2024-03-21 02:55:08,694: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:55:08.811108823Z [2024-03-21 02:55:08,810: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T02:50:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:55:10.312328073Z [2024-03-21 02:55:10,311: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f7228285-6847-41e2-b527-ed631dab1e39] succeeded in 3.161944567000319s: None
2024-03-21T02:55:10.559479776Z [2024-03-21 02:55:10,559: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f141d92b-e687-4d13-bd58-666d4daa4a45] received
2024-03-21T02:55:10.566831391Z [2024-03-21 02:55:10,566: INFO/ForkPoolWorker-15] [f141d92b-e687-4d13-bd58-666d4daa4a45] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T02:55:10.954557408Z [2024-03-21 02:55:10,950: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T02:55:12.347418058Z [2024-03-21 02:55:12,347: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:55:12.351646719Z [2024-03-21 02:55:12,351: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:55:12.395616490Z [2024-03-21 02:55:12,395: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:55:12.397120644Z [2024-03-21 02:55:12,396: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:55:12.397263648Z [2024-03-21 02:55:12,397: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:55:12.397460077Z [2024-03-21 02:55:12,397: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:55:12.397608031Z [2024-03-21 02:55:12,397: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:55:12.397936569Z [2024-03-21 02:55:12,397: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T02:55:12.398061484Z [2024-03-21 02:55:12,397: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:55:12.488501266Z [2024-03-21 02:55:12,488: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T02:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:55:13.079162377Z [2024-03-21 02:55:13,078: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f141d92b-e687-4d13-bd58-666d4daa4a45] succeeded in 2.5180092840000725s: None
2024-03-21T02:56:00.422200824Z [2024-03-21 02:56:00,421: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[611dcd2b-b62d-43a0-b378-cbb9f673abb7] received
2024-03-21T02:56:00.426172791Z [2024-03-21 02:56:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15734a59-55e8-4ce8-9748-d4f2ee3f50dd] received
2024-03-21T02:56:00.429903331Z [2024-03-21 02:56:00,429: INFO/ForkPoolWorker-15] [611dcd2b-b62d-43a0-b378-cbb9f673abb7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:56:00.437475186Z [2024-03-21 02:56:00,437: INFO/ForkPoolWorker-16] [15734a59-55e8-4ce8-9748-d4f2ee3f50dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:56:00.463888971Z [2024-03-21 02:56:00,463: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16b5f38a-05c5-4029-aff7-7c6751a2bb46] received
2024-03-21T02:56:00.467019982Z [2024-03-21 02:56:00,466: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dff699de-c3e1-4ae6-be31-67510136348f] received
2024-03-21T02:56:00.475223803Z [2024-03-21 02:56:00,474: INFO/ForkPoolWorker-2] [dff699de-c3e1-4ae6-be31-67510136348f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:56:00.482374715Z [2024-03-21 02:56:00,482: INFO/ForkPoolWorker-1] [16b5f38a-05c5-4029-aff7-7c6751a2bb46] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:56:00.872953031Z [2024-03-21 02:56:00,867: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:56:00.877878494Z [2024-03-21 02:56:00,868: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:56:00.904005099Z [2024-03-21 02:56:00,900: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:56:00.975496324Z [2024-03-21 02:56:00,972: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:56:01.114076507Z [2024-03-21 02:56:01,113: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T02:56:01.128701398Z [2024-03-21 02:56:01,128: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:56:01.177447747Z [2024-03-21 02:56:01,177: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:56:01.180654252Z [2024-03-21 02:56:01,180: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:56:01.180982862Z [2024-03-21 02:56:01,180: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:56:01.181211326Z [2024-03-21 02:56:01,180: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T02:56:01.181707173Z [2024-03-21 02:56:01,181: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:56:01.314816666Z [2024-03-21 02:56:01,314: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:56:01.333645042Z [2024-03-21 02:56:01,333: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:56:02.055755237Z [2024-03-21 02:56:02,055: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[611dcd2b-b62d-43a0-b378-cbb9f673abb7] succeeded in 1.631113806999565s: None
2024-03-21T02:56:02.057239767Z [2024-03-21 02:56:02,056: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[dff699de-c3e1-4ae6-be31-67510136348f] succeeded in 1.5884900909986754s: None
2024-03-21T02:56:02.268482580Z [2024-03-21 02:56:02,267: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:56:02.280038844Z [2024-03-21 02:56:02,274: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:56:02.352916288Z [2024-03-21 02:56:02,352: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:56:02.354982770Z [2024-03-21 02:56:02,354: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:56:02.355053774Z [2024-03-21 02:56:02,354: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:56:02.355311858Z [2024-03-21 02:56:02,354: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:56:02.355388140Z [2024-03-21 02:56:02,355: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:56:02.355695700Z [2024-03-21 02:56:02,355: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:56:02.355754004Z [2024-03-21 02:56:02,355: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:56:02.468407894Z [2024-03-21 02:56:02,467: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:56:02.471670102Z [2024-03-21 02:56:02,471: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:56:02.501511423Z [2024-03-21 02:56:02,501: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:56:02.503250324Z [2024-03-21 02:56:02,502: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:56:02.503326802Z [2024-03-21 02:56:02,503: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:56:02.503436366Z [2024-03-21 02:56:02,503: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:56:02.503446995Z [2024-03-21 02:56:02,503: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:56:02.503509084Z [2024-03-21 02:56:02,503: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:56:02.503825376Z [2024-03-21 02:56:02,503: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:56:02.503913519Z [2024-03-21 02:56:02,503: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:56:02.633887210Z [2024-03-21 02:56:02,631: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:56:05.532771370Z [2024-03-21 02:56:05,532: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[16b5f38a-05c5-4029-aff7-7c6751a2bb46] succeeded in 5.066456975999245s: None
2024-03-21T02:56:05.683176420Z [2024-03-21 02:56:05,682: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[15734a59-55e8-4ce8-9748-d4f2ee3f50dd] succeeded in 5.2530292559986265s: None
2024-03-21T02:57:00.317698946Z [2024-03-21 02:57:00,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb14dbf3-01f2-4b24-a0be-3c23db26d7c8] received
2024-03-21T02:57:00.328076701Z [2024-03-21 02:57:00,327: INFO/ForkPoolWorker-15] [cb14dbf3-01f2-4b24-a0be-3c23db26d7c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:57:00.328734091Z [2024-03-21 02:57:00,328: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6fb8da8f-fd05-4164-98b0-5b08c37c3ce3] received
2024-03-21T02:57:00.337190949Z [2024-03-21 02:57:00,336: INFO/ForkPoolWorker-16] [6fb8da8f-fd05-4164-98b0-5b08c37c3ce3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:57:00.349520646Z [2024-03-21 02:57:00,348: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[472a625c-13e8-4b74-bbc3-cdb73e5bfec1] received
2024-03-21T02:57:00.359709379Z [2024-03-21 02:57:00,359: INFO/ForkPoolWorker-1] [472a625c-13e8-4b74-bbc3-cdb73e5bfec1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:57:00.654109396Z [2024-03-21 02:57:00,649: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:57:00.667053272Z [2024-03-21 02:57:00,663: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:57:00.698576494Z [2024-03-21 02:57:00,694: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:57:00.866595691Z [2024-03-21 02:57:00,866: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T02:57:00.871127302Z [2024-03-21 02:57:00,870: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:57:00.922738704Z [2024-03-21 02:57:00,922: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:57:00.923750594Z [2024-03-21 02:57:00,923: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:57:00.923794090Z [2024-03-21 02:57:00,923: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:57:00.923805738Z [2024-03-21 02:57:00,923: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T02:57:00.924150227Z [2024-03-21 02:57:00,923: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:57:01.036082374Z [2024-03-21 02:57:01,035: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:57:01.739280981Z [2024-03-21 02:57:01,738: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[472a625c-13e8-4b74-bbc3-cdb73e5bfec1] succeeded in 1.3851607329997933s: None
2024-03-21T02:57:01.850358579Z [2024-03-21 02:57:01,849: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:57:01.853972714Z [2024-03-21 02:57:01,853: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:57:01.879865282Z [2024-03-21 02:57:01,879: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:57:01.883559492Z [2024-03-21 02:57:01,883: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:57:01.883625710Z [2024-03-21 02:57:01,883: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:57:01.884496260Z [2024-03-21 02:57:01,883: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:57:01.884550783Z [2024-03-21 02:57:01,884: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:57:01.885086416Z [2024-03-21 02:57:01,884: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:57:01.885303471Z [2024-03-21 02:57:01,885: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:57:02.017968807Z [2024-03-21 02:57:02,017: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:57:02.121619075Z [2024-03-21 02:57:02,120: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:57:02.125606039Z [2024-03-21 02:57:02,124: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:57:02.168865014Z [2024-03-21 02:57:02,168: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:57:02.171712206Z [2024-03-21 02:57:02,171: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:57:02.172066760Z [2024-03-21 02:57:02,171: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:57:02.172698178Z [2024-03-21 02:57:02,171: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:57:02.172987843Z [2024-03-21 02:57:02,172: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:57:02.173951356Z [2024-03-21 02:57:02,173: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:57:02.173975042Z [2024-03-21 02:57:02,173: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:57:02.288017594Z [2024-03-21 02:57:02,287: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:57:04.263764697Z [2024-03-21 02:57:04,263: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6fb8da8f-fd05-4164-98b0-5b08c37c3ce3] succeeded in 3.9331669119983417s: None
2024-03-21T02:57:04.993147001Z [2024-03-21 02:57:04,992: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cb14dbf3-01f2-4b24-a0be-3c23db26d7c8] succeeded in 4.67165997399934s: None
2024-03-21T02:58:01.296896669Z [2024-03-21 02:58:01,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f823b192-3cfe-44f1-96cf-e3811139d65b] received
2024-03-21T02:58:01.298864935Z [2024-03-21 02:58:01,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37c5d9bf-31f1-4b00-a10d-73828309b074] received
2024-03-21T02:58:01.311514925Z [2024-03-21 02:58:01,311: INFO/ForkPoolWorker-15] [f823b192-3cfe-44f1-96cf-e3811139d65b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T02:58:01.311762003Z [2024-03-21 02:58:01,311: INFO/ForkPoolWorker-16] [37c5d9bf-31f1-4b00-a10d-73828309b074] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:58:01.325173579Z [2024-03-21 02:58:01,324: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3903de9a-708f-4352-8557-3b443047343b] received
2024-03-21T02:58:01.330043813Z [2024-03-21 02:58:01,329: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02c725cf-42ac-4100-8011-c20b73328381] received
2024-03-21T02:58:01.341929809Z [2024-03-21 02:58:01,340: INFO/ForkPoolWorker-2] [02c725cf-42ac-4100-8011-c20b73328381] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:58:01.346187861Z [2024-03-21 02:58:01,344: INFO/ForkPoolWorker-1] [3903de9a-708f-4352-8557-3b443047343b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:58:01.659473672Z [2024-03-21 02:58:01,656: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T02:58:01.705889636Z [2024-03-21 02:58:01,702: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:58:01.710188235Z [2024-03-21 02:58:01,706: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:58:01.714007751Z [2024-03-21 02:58:01,710: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:58:01.963016808Z [2024-03-21 02:58:01,962: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:58:01.984212843Z [2024-03-21 02:58:01,981: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T02:58:01.989953850Z [2024-03-21 02:58:01,989: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:58:02.026053895Z [2024-03-21 02:58:02,025: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T02:58:02.029288080Z [2024-03-21 02:58:02,028: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:58:02.029529622Z [2024-03-21 02:58:02,029: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:58:02.029677684Z [2024-03-21 02:58:02,029: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T02:58:02.032798991Z [2024-03-21 02:58:02,032: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:58:02.125759859Z [2024-03-21 02:58:02,125: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:58:02.721480314Z [2024-03-21 02:58:02,721: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f823b192-3cfe-44f1-96cf-e3811139d65b] succeeded in 1.4230438739996316s: None
2024-03-21T02:58:02.961895602Z [2024-03-21 02:58:02,961: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[02c725cf-42ac-4100-8011-c20b73328381] succeeded in 1.6286919509984727s: None
2024-03-21T02:58:03.411562901Z [2024-03-21 02:58:03,411: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:58:03.414956825Z [2024-03-21 02:58:03,414: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:58:03.437489144Z [2024-03-21 02:58:03,437: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:58:03.438767483Z [2024-03-21 02:58:03,438: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:58:03.438852063Z [2024-03-21 02:58:03,438: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:58:03.438873400Z [2024-03-21 02:58:03,438: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:58:03.438880120Z [2024-03-21 02:58:03,438: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:58:03.439298730Z [2024-03-21 02:58:03,439: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:58:03.439340671Z [2024-03-21 02:58:03,439: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:58:03.538196470Z [2024-03-21 02:58:03,537: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T02:58:03.538994884Z [2024-03-21 02:58:03,538: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:58:03.542120379Z [2024-03-21 02:58:03,541: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:58:03.571457804Z [2024-03-21 02:58:03,571: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:58:03.573582652Z [2024-03-21 02:58:03,573: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:58:03.574040845Z [2024-03-21 02:58:03,573: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:58:03.574319513Z [2024-03-21 02:58:03,574: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:58:03.574499454Z [2024-03-21 02:58:03,574: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T02:58:03.575051657Z [2024-03-21 02:58:03,574: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:58:03.575280927Z [2024-03-21 02:58:03,575: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:58:03.674715676Z [2024-03-21 02:58:03,674: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:58:07.384480388Z [2024-03-21 02:58:07,383: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[37c5d9bf-31f1-4b00-a10d-73828309b074] succeeded in 6.082898837999892s: None
2024-03-21T02:58:08.237312979Z [2024-03-21 02:58:08,236: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3903de9a-708f-4352-8557-3b443047343b] succeeded in 6.910077311998975s: None
2024-03-21T02:59:00.324928696Z [2024-03-21 02:59:00,324: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db5b8f20-da94-4176-afcd-f9507c8ae3bf] received
2024-03-21T02:59:00.326525326Z [2024-03-21 02:59:00,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f99b0d6b-a82b-4760-a9b6-4de2df1b26d2] received
2024-03-21T02:59:00.328008978Z [2024-03-21 02:59:00,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8a52a8a-00dd-43b9-9af5-da3ebb06d34f] received
2024-03-21T02:59:00.335536803Z [2024-03-21 02:59:00,335: INFO/ForkPoolWorker-16] [f99b0d6b-a82b-4760-a9b6-4de2df1b26d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T02:59:00.336225757Z [2024-03-21 02:59:00,335: INFO/ForkPoolWorker-15] [db5b8f20-da94-4176-afcd-f9507c8ae3bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T02:59:00.336937718Z [2024-03-21 02:59:00,336: INFO/ForkPoolWorker-1] [c8a52a8a-00dd-43b9-9af5-da3ebb06d34f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T02:59:00.649464185Z [2024-03-21 02:59:00,646: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T02:59:00.681274447Z [2024-03-21 02:59:00,677: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T02:59:00.711860445Z [2024-03-21 02:59:00,707: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T02:59:00.818934241Z [2024-03-21 02:59:00,818: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T02:59:00.823045366Z [2024-03-21 02:59:00,822: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:59:00.850775850Z [2024-03-21 02:59:00,850: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T02:59:00.851818884Z [2024-03-21 02:59:00,851: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T02:59:00.851919334Z [2024-03-21 02:59:00,851: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T02:59:00.851943057Z [2024-03-21 02:59:00,851: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T02:59:00.852172566Z [2024-03-21 02:59:00,852: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T02:59:00.966793558Z [2024-03-21 02:59:00,965: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:59:01.646404495Z [2024-03-21 02:59:01,645: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c8a52a8a-00dd-43b9-9af5-da3ebb06d34f] succeeded in 1.3167515549994278s: None
2024-03-21T02:59:01.944824649Z [2024-03-21 02:59:01,944: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T02:59:01.948376835Z [2024-03-21 02:59:01,947: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:59:01.972360733Z [2024-03-21 02:59:01,972: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T02:59:01.973807896Z [2024-03-21 02:59:01,972: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T02:59:01.974365559Z [2024-03-21 02:59:01,974: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:59:01.974422885Z [2024-03-21 02:59:01,974: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:59:01.974650274Z [2024-03-21 02:59:01,974: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:59:01.975641437Z [2024-03-21 02:59:01,974: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T02:59:01.976068925Z [2024-03-21 02:59:01,975: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T02:59:01.976638885Z [2024-03-21 02:59:01,976: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:59:01.976896568Z [2024-03-21 02:59:01,976: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T02:59:01.997832742Z [2024-03-21 02:59:01,997: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T02:59:01.999379000Z [2024-03-21 02:59:01,999: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T02:59:01.999397052Z [2024-03-21 02:59:01,999: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T02:59:01.999522150Z [2024-03-21 02:59:01,999: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T02:59:01.999556918Z [2024-03-21 02:59:01,999: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T02:59:01.999879394Z [2024-03-21 02:59:01,999: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T02:59:01.999897345Z [2024-03-21 02:59:01,999: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T02:59:02.100127854Z [2024-03-21 02:59:02,099: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:59:02.102726079Z [2024-03-21 02:59:02,102: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T02:59:03.593779218Z [2024-03-21 02:59:03,593: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[db5b8f20-da94-4176-afcd-f9507c8ae3bf] succeeded in 3.2661520459987514s: None
2024-03-21T02:59:04.098371500Z [2024-03-21 02:59:04,097: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f99b0d6b-a82b-4760-a9b6-4de2df1b26d2] succeeded in 3.770250808000128s: None
2024-03-21T03:00:00.415007108Z [2024-03-21 03:00:00,414: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6372c7e-ea2a-40f2-b9ad-c7439d5f8ca0] received
2024-03-21T03:00:00.425309083Z [2024-03-21 03:00:00,424: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1faa24d2-8001-496f-a68c-ab110e70d744] received
2024-03-21T03:00:00.427870708Z [2024-03-21 03:00:00,427: INFO/ForkPoolWorker-15] [e6372c7e-ea2a-40f2-b9ad-c7439d5f8ca0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:00:00.438317688Z [2024-03-21 03:00:00,438: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5a2eb06-988f-4634-9313-821f2f9b3225] received
2024-03-21T03:00:00.438516721Z [2024-03-21 03:00:00,438: INFO/ForkPoolWorker-16] [1faa24d2-8001-496f-a68c-ab110e70d744] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:00:00.447291923Z [2024-03-21 03:00:00,446: INFO/ForkPoolWorker-1] [f5a2eb06-988f-4634-9313-821f2f9b3225] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:00:00.447664087Z [2024-03-21 03:00:00,447: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02d58fcc-57d3-4a34-b306-5b1bf03e8638] received
2024-03-21T03:00:00.460872901Z [2024-03-21 03:00:00,460: INFO/ForkPoolWorker-2] [02d58fcc-57d3-4a34-b306-5b1bf03e8638] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T03:00:00.464893770Z [2024-03-21 03:00:00,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c935a5f-91db-4215-b05e-de7fadf26382] received
2024-03-21T03:00:00.491990419Z [2024-03-21 03:00:00,491: INFO/ForkPoolWorker-3] [3c935a5f-91db-4215-b05e-de7fadf26382] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:00:00.861104091Z [2024-03-21 03:00:00,857: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:00:01.067351017Z [2024-03-21 03:00:01,063: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:00:01.139250872Z [2024-03-21 03:00:01,135: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T03:00:01.250878304Z [2024-03-21 03:00:01,250: INFO/ForkPoolWorker-3] Getting SDNC list
2024-03-21T03:00:01.255110190Z [2024-03-21 03:00:01,254: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:00:01.348083273Z [2024-03-21 03:00:01,347: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-21T03:00:01.361008437Z [2024-03-21 03:00:01,360: INFO/ForkPoolWorker-3] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:00:01.364727610Z [2024-03-21 03:00:01,364: INFO/ForkPoolWorker-3] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:00:01.364876993Z [2024-03-21 03:00:01,364: INFO/ForkPoolWorker-3] Getting SDNC list OK
2024-03-21T03:00:01.365288608Z [2024-03-21 03:00:01,365: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:00:01.483750637Z [2024-03-21 03:00:01,483: INFO/ForkPoolWorker-2] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T02:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:00:01.499391285Z [2024-03-21 03:00:01,494: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:00:01.751539518Z [2024-03-21 03:00:01,751: INFO/ForkPoolWorker-3] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T02:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:00:01.902458956Z [2024-03-21 03:00:01,896: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:00:02.672879026Z [2024-03-21 03:00:02,669: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[02d58fcc-57d3-4a34-b306-5b1bf03e8638] succeeded in 2.2192235229995276s: None
2024-03-21T03:00:02.959506433Z [2024-03-21 03:00:02,959: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[3c935a5f-91db-4215-b05e-de7fadf26382] succeeded in 2.488410796999233s: None
2024-03-21T03:00:03.515593227Z [2024-03-21 03:00:03,515: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:00:03.519334894Z [2024-03-21 03:00:03,518: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:00:03.540503757Z [2024-03-21 03:00:03,540: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:00:03.542105328Z [2024-03-21 03:00:03,541: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:00:03.542131226Z [2024-03-21 03:00:03,542: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:00:03.542324176Z [2024-03-21 03:00:03,542: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:00:03.542476972Z [2024-03-21 03:00:03,542: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:00:03.543161563Z [2024-03-21 03:00:03,542: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:00:03.543184350Z [2024-03-21 03:00:03,543: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:00:03.630659317Z [2024-03-21 03:00:03,630: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:00:03.634351204Z [2024-03-21 03:00:03,633: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:00:03.652997538Z [2024-03-21 03:00:03,652: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T02:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:00:03.657516205Z [2024-03-21 03:00:03,657: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:00:03.661683783Z [2024-03-21 03:00:03,661: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:00:03.661934894Z [2024-03-21 03:00:03,661: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:00:03.662270857Z [2024-03-21 03:00:03,661: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:00:03.662462094Z [2024-03-21 03:00:03,662: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:00:03.662929738Z [2024-03-21 03:00:03,662: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:00:03.663214632Z [2024-03-21 03:00:03,662: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:00:03.760732590Z [2024-03-21 03:00:03,760: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T02:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:00:03.772043340Z [2024-03-21 03:00:03,771: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:00:03.775760999Z [2024-03-21 03:00:03,775: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:00:03.795417759Z [2024-03-21 03:00:03,795: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:00:03.796999476Z [2024-03-21 03:00:03,796: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:00:03.797135822Z [2024-03-21 03:00:03,796: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:00:03.797373091Z [2024-03-21 03:00:03,797: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:00:03.797485114Z [2024-03-21 03:00:03,797: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:00:03.798174152Z [2024-03-21 03:00:03,797: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:00:03.798261040Z [2024-03-21 03:00:03,798: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:00:03.890498194Z [2024-03-21 03:00:03,890: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T02:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:00:04.473413959Z [2024-03-21 03:00:04,472: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e6372c7e-ea2a-40f2-b9ad-c7439d5f8ca0] succeeded in 4.054307438998876s: None
2024-03-21T03:00:04.593566277Z [2024-03-21 03:00:04,593: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d003612-4c28-4ad1-90f4-4d59ea7744c0] received
2024-03-21T03:00:04.600851778Z [2024-03-21 03:00:04,600: INFO/ForkPoolWorker-15] [4d003612-4c28-4ad1-90f4-4d59ea7744c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:00:04.909923640Z [2024-03-21 03:00:04,906: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:00:05.623714362Z [2024-03-21 03:00:05,623: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1faa24d2-8001-496f-a68c-ab110e70d744] succeeded in 5.193157223999151s: None
2024-03-21T03:00:05.626732724Z [2024-03-21 03:00:05,626: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f5a2eb06-988f-4634-9313-821f2f9b3225] succeeded in 5.185026794000805s: None
2024-03-21T03:00:06.089239520Z [2024-03-21 03:00:06,088: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:00:06.092653777Z [2024-03-21 03:00:06,092: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:00:06.113305754Z [2024-03-21 03:00:06,113: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:00:06.114777113Z [2024-03-21 03:00:06,114: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:00:06.114794475Z [2024-03-21 03:00:06,114: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:00:06.114973401Z [2024-03-21 03:00:06,114: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:00:06.115031733Z [2024-03-21 03:00:06,114: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:00:06.115368456Z [2024-03-21 03:00:06,115: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:00:06.115433546Z [2024-03-21 03:00:06,115: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:00:06.207259316Z [2024-03-21 03:00:06,206: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T02:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:00:06.883677551Z [2024-03-21 03:00:06,883: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4d003612-4c28-4ad1-90f4-4d59ea7744c0] succeeded in 2.2883613199992396s: None
2024-03-21T03:00:07.339434424Z [2024-03-21 03:00:07,339: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a11ac337-efd8-4da1-a1cc-f62a7822894b] received
2024-03-21T03:00:07.345994242Z [2024-03-21 03:00:07,345: INFO/ForkPoolWorker-15] [a11ac337-efd8-4da1-a1cc-f62a7822894b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T03:00:07.622913705Z [2024-03-21 03:00:07,619: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:00:08.852469032Z [2024-03-21 03:00:08,852: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:00:08.855929883Z [2024-03-21 03:00:08,855: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:00:08.890683370Z [2024-03-21 03:00:08,890: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:00:08.892014851Z [2024-03-21 03:00:08,891: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:00:08.892030156Z [2024-03-21 03:00:08,891: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:00:08.892141671Z [2024-03-21 03:00:08,891: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:00:08.892150069Z [2024-03-21 03:00:08,892: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:00:08.892392341Z [2024-03-21 03:00:08,892: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:00:08.892427931Z [2024-03-21 03:00:08,892: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:00:08.983221593Z [2024-03-21 03:00:08,982: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T02:55:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:00:10.484045824Z [2024-03-21 03:00:10,483: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a11ac337-efd8-4da1-a1cc-f62a7822894b] succeeded in 3.142428650999136s: None
2024-03-21T03:00:10.769998578Z [2024-03-21 03:00:10,769: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f259125e-1ee3-4bce-ad24-b36614bbece2] received
2024-03-21T03:00:10.783097656Z [2024-03-21 03:00:10,782: INFO/ForkPoolWorker-15] [f259125e-1ee3-4bce-ad24-b36614bbece2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:00:11.073898027Z [2024-03-21 03:00:11,070: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:00:12.211371145Z [2024-03-21 03:00:12,210: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:00:12.214682840Z [2024-03-21 03:00:12,214: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:00:12.234624275Z [2024-03-21 03:00:12,234: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:00:12.238103176Z [2024-03-21 03:00:12,235: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:00:12.238134873Z [2024-03-21 03:00:12,236: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:00:12.238140022Z [2024-03-21 03:00:12,236: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:00:12.238143763Z [2024-03-21 03:00:12,236: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:00:12.238146931Z [2024-03-21 03:00:12,236: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:00:12.238150389Z [2024-03-21 03:00:12,236: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:00:12.364760107Z [2024-03-21 03:00:12,364: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T02:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:00:12.995955002Z [2024-03-21 03:00:12,995: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f259125e-1ee3-4bce-ad24-b36614bbece2] succeeded in 2.2223110139984783s: None
2024-03-21T03:01:00.360224950Z [2024-03-21 03:01:00,359: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24d7cd23-e1eb-4749-9230-7a395b097ab9] received
2024-03-21T03:01:00.361889162Z [2024-03-21 03:01:00,361: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0666330-f1d8-48e6-bdea-ac1f1a5102f5] received
2024-03-21T03:01:00.363601610Z [2024-03-21 03:01:00,363: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4610c95f-d004-495a-93eb-dcc06b264e65] received
2024-03-21T03:01:00.368072820Z [2024-03-21 03:01:00,367: INFO/ForkPoolWorker-16] [e0666330-f1d8-48e6-bdea-ac1f1a5102f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:01:00.368903504Z [2024-03-21 03:01:00,368: INFO/ForkPoolWorker-15] [24d7cd23-e1eb-4749-9230-7a395b097ab9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:01:00.372441546Z [2024-03-21 03:01:00,372: INFO/ForkPoolWorker-1] [4610c95f-d004-495a-93eb-dcc06b264e65] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:01:00.671383412Z [2024-03-21 03:01:00,668: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:01:00.703748186Z [2024-03-21 03:01:00,700: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:01:00.727759591Z [2024-03-21 03:01:00,724: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:01:00.880554591Z [2024-03-21 03:01:00,880: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T03:01:00.885537854Z [2024-03-21 03:01:00,885: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:01:00.905132181Z [2024-03-21 03:01:00,904: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:01:00.906196965Z [2024-03-21 03:01:00,905: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:01:00.906373413Z [2024-03-21 03:01:00,906: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:01:00.906503697Z [2024-03-21 03:01:00,906: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T03:01:00.906731600Z [2024-03-21 03:01:00,906: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:01:01.003189584Z [2024-03-21 03:01:01,002: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:01:01.615390439Z [2024-03-21 03:01:01,614: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[24d7cd23-e1eb-4749-9230-7a395b097ab9] succeeded in 1.253198981999958s: None
2024-03-21T03:01:01.884793754Z [2024-03-21 03:01:01,884: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:01:01.888194881Z [2024-03-21 03:01:01,887: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:01:01.918387756Z [2024-03-21 03:01:01,918: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:01:01.920159988Z [2024-03-21 03:01:01,919: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:01:01.920243866Z [2024-03-21 03:01:01,920: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:01:01.920448563Z [2024-03-21 03:01:01,920: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:01:01.920495758Z [2024-03-21 03:01:01,920: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:01:01.920809007Z [2024-03-21 03:01:01,920: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:01:01.920842342Z [2024-03-21 03:01:01,920: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:01:01.955061431Z [2024-03-21 03:01:01,954: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:01:01.958649599Z [2024-03-21 03:01:01,958: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:01:01.981767043Z [2024-03-21 03:01:01,981: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:01:01.983192743Z [2024-03-21 03:01:01,982: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:01:01.983211199Z [2024-03-21 03:01:01,982: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:01:01.983219065Z [2024-03-21 03:01:01,982: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:01:01.983301577Z [2024-03-21 03:01:01,983: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:01:01.983840069Z [2024-03-21 03:01:01,983: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:01:01.984100558Z [2024-03-21 03:01:01,983: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:01:02.017601752Z [2024-03-21 03:01:02,017: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:01:02.089555711Z [2024-03-21 03:01:02,089: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:01:03.883693461Z [2024-03-21 03:01:03,883: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e0666330-f1d8-48e6-bdea-ac1f1a5102f5] succeeded in 3.5201553130009415s: None
2024-03-21T03:01:04.164147552Z [2024-03-21 03:01:04,163: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4610c95f-d004-495a-93eb-dcc06b264e65] succeeded in 3.7980917200002295s: None
2024-03-21T03:02:01.260288404Z [2024-03-21 03:02:01,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa73dc8b-7a2f-4ef9-93da-abe6adc388ac] received
2024-03-21T03:02:01.262533788Z [2024-03-21 03:02:01,262: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ca648fd-650f-4bc2-9553-a5980ecec01c] received
2024-03-21T03:02:01.274072827Z [2024-03-21 03:02:01,273: INFO/ForkPoolWorker-15] [fa73dc8b-7a2f-4ef9-93da-abe6adc388ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T03:02:01.275371313Z [2024-03-21 03:02:01,275: INFO/ForkPoolWorker-16] [1ca648fd-650f-4bc2-9553-a5980ecec01c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:02:01.286399259Z [2024-03-21 03:02:01,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[130829b5-15ae-4040-8f76-cf9468e226a2] received
2024-03-21T03:02:01.293216950Z [2024-03-21 03:02:01,292: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00b6ef4b-eced-4d7f-9056-52d4a7f5a788] received
2024-03-21T03:02:01.301021509Z [2024-03-21 03:02:01,300: INFO/ForkPoolWorker-1] [130829b5-15ae-4040-8f76-cf9468e226a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:02:01.308810375Z [2024-03-21 03:02:01,308: INFO/ForkPoolWorker-2] [00b6ef4b-eced-4d7f-9056-52d4a7f5a788] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:02:01.878323672Z [2024-03-21 03:02:01,870: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T03:02:01.932334536Z [2024-03-21 03:02:01,928: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:02:01.938251892Z [2024-03-21 03:02:01,935: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:02:01.983342829Z [2024-03-21 03:02:01,971: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:02:02.123145226Z [2024-03-21 03:02:02,122: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T03:02:02.127808605Z [2024-03-21 03:02:02,127: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:02:02.161837728Z [2024-03-21 03:02:02,161: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:02:02.165917818Z [2024-03-21 03:02:02,165: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:02:02.166215778Z [2024-03-21 03:02:02,165: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:02:02.166380464Z [2024-03-21 03:02:02,166: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T03:02:02.166668707Z [2024-03-21 03:02:02,166: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:02:02.465630735Z [2024-03-21 03:02:02,465: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:02:02.673584159Z [2024-03-21 03:02:02,673: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T03:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:02:03.526098519Z [2024-03-21 03:02:03,525: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fa73dc8b-7a2f-4ef9-93da-abe6adc388ac] succeeded in 2.2600825800000166s: None
2024-03-21T03:02:03.600220031Z [2024-03-21 03:02:03,599: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[00b6ef4b-eced-4d7f-9056-52d4a7f5a788] succeeded in 2.304466962999868s: None
2024-03-21T03:02:04.030832821Z [2024-03-21 03:02:04,030: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:02:04.034753945Z [2024-03-21 03:02:04,034: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:02:04.076117803Z [2024-03-21 03:02:04,075: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:02:04.078469885Z [2024-03-21 03:02:04,078: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:02:04.078490185Z [2024-03-21 03:02:04,078: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:02:04.078701988Z [2024-03-21 03:02:04,078: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:02:04.078840435Z [2024-03-21 03:02:04,078: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:02:04.079142586Z [2024-03-21 03:02:04,078: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:02:04.079231125Z [2024-03-21 03:02:04,079: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:02:04.139270944Z [2024-03-21 03:02:04,138: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:02:04.142884108Z [2024-03-21 03:02:04,142: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:02:04.163978567Z [2024-03-21 03:02:04,163: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:02:04.165751535Z [2024-03-21 03:02:04,165: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:02:04.165912757Z [2024-03-21 03:02:04,165: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:02:04.166162872Z [2024-03-21 03:02:04,165: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:02:04.166299350Z [2024-03-21 03:02:04,166: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:02:04.166698697Z [2024-03-21 03:02:04,166: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:02:04.166830060Z [2024-03-21 03:02:04,166: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:02:04.202960343Z [2024-03-21 03:02:04,202: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:02:04.290014526Z [2024-03-21 03:02:04,289: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:02:06.806633742Z [2024-03-21 03:02:06,806: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1ca648fd-650f-4bc2-9553-a5980ecec01c] succeeded in 5.542080131999683s: None
2024-03-21T03:02:07.335904547Z [2024-03-21 03:02:07,335: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[130829b5-15ae-4040-8f76-cf9468e226a2] succeeded in 6.046457012000246s: None
2024-03-21T03:03:01.127751578Z [2024-03-21 03:03:01,127: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4829e7ce-8f35-4538-8d5e-cc1eb7fbb1f5] received
2024-03-21T03:03:01.129550214Z [2024-03-21 03:03:01,129: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[976cabd0-bbd5-4f45-85fb-2053b0ae0dfa] received
2024-03-21T03:03:01.135981379Z [2024-03-21 03:03:01,135: INFO/ForkPoolWorker-16] [976cabd0-bbd5-4f45-85fb-2053b0ae0dfa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:03:01.137733801Z [2024-03-21 03:03:01,137: INFO/ForkPoolWorker-15] [4829e7ce-8f35-4538-8d5e-cc1eb7fbb1f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:03:01.138380685Z [2024-03-21 03:03:01,138: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[301e5d5d-916e-49b0-aac9-a3098dfdbc4e] received
2024-03-21T03:03:01.152885343Z [2024-03-21 03:03:01,152: INFO/ForkPoolWorker-1] [301e5d5d-916e-49b0-aac9-a3098dfdbc4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:03:01.460173410Z [2024-03-21 03:03:01,457: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:03:01.469002814Z [2024-03-21 03:03:01,465: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:03:01.518308378Z [2024-03-21 03:03:01,514: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:03:01.680428707Z [2024-03-21 03:03:01,679: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T03:03:01.684612997Z [2024-03-21 03:03:01,684: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:03:01.704537192Z [2024-03-21 03:03:01,704: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:03:01.706056674Z [2024-03-21 03:03:01,705: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:03:01.706217189Z [2024-03-21 03:03:01,705: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:03:01.706326608Z [2024-03-21 03:03:01,706: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T03:03:01.706756276Z [2024-03-21 03:03:01,706: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:03:01.793102165Z [2024-03-21 03:03:01,792: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:03:02.570197152Z [2024-03-21 03:03:02,569: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[976cabd0-bbd5-4f45-85fb-2053b0ae0dfa] succeeded in 1.4390967300005286s: None
2024-03-21T03:03:03.085788264Z [2024-03-21 03:03:03,085: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:03:03.100384122Z [2024-03-21 03:03:03,099: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:03:03.112122047Z [2024-03-21 03:03:03,111: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:03:03.115848844Z [2024-03-21 03:03:03,115: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:03:03.127400380Z [2024-03-21 03:03:03,127: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:03:03.129500772Z [2024-03-21 03:03:03,129: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:03:03.129590086Z [2024-03-21 03:03:03,129: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:03:03.129964681Z [2024-03-21 03:03:03,129: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:03:03.130054165Z [2024-03-21 03:03:03,129: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:03:03.130339757Z [2024-03-21 03:03:03,130: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:03:03.130417616Z [2024-03-21 03:03:03,130: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:03:03.155681782Z [2024-03-21 03:03:03,155: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:03:03.161249409Z [2024-03-21 03:03:03,160: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:03:03.161506184Z [2024-03-21 03:03:03,161: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:03:03.161746756Z [2024-03-21 03:03:03,161: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:03:03.161876711Z [2024-03-21 03:03:03,161: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:03:03.162308877Z [2024-03-21 03:03:03,162: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:03:03.162447312Z [2024-03-21 03:03:03,162: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:03:03.268134108Z [2024-03-21 03:03:03,267: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:03:03.275779543Z [2024-03-21 03:03:03,275: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:03:05.052377804Z [2024-03-21 03:03:05,051: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[301e5d5d-916e-49b0-aac9-a3098dfdbc4e] succeeded in 3.91054971900121s: None
2024-03-21T03:03:05.466704734Z [2024-03-21 03:03:05,466: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4829e7ce-8f35-4538-8d5e-cc1eb7fbb1f5] succeeded in 4.334764192999501s: None
2024-03-21T03:04:00.605894161Z [2024-03-21 03:04:00,605: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12ba8984-ff7e-4870-85c1-55521f9b681c] received
2024-03-21T03:04:00.613785316Z [2024-03-21 03:04:00,613: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7eacef0d-cd10-4138-9759-6b90401058c6] received
2024-03-21T03:04:00.614190547Z [2024-03-21 03:04:00,613: INFO/ForkPoolWorker-15] [12ba8984-ff7e-4870-85c1-55521f9b681c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:04:00.616453092Z [2024-03-21 03:04:00,616: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4e8b42d-f05a-463c-9145-05cbbd045191] received
2024-03-21T03:04:00.622918718Z [2024-03-21 03:04:00,622: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ddd2300-4044-4eca-8fc4-a628c7da31b7] received
2024-03-21T03:04:00.628914789Z [2024-03-21 03:04:00,628: INFO/ForkPoolWorker-16] [7eacef0d-cd10-4138-9759-6b90401058c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:04:00.633333159Z [2024-03-21 03:04:00,631: INFO/ForkPoolWorker-1] [b4e8b42d-f05a-463c-9145-05cbbd045191] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T03:04:00.633358336Z [2024-03-21 03:04:00,632: INFO/ForkPoolWorker-2] [6ddd2300-4044-4eca-8fc4-a628c7da31b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:04:00.967884922Z [2024-03-21 03:04:00,964: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:04:00.999261066Z [2024-03-21 03:04:00,995: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T03:04:01.200462427Z [2024-03-21 03:04:01,196: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:04:01.237068534Z [2024-03-21 03:04:01,228: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:04:01.328205825Z [2024-03-21 03:04:01,327: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T03:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:04:01.436472915Z [2024-03-21 03:04:01,436: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T03:04:01.441246470Z [2024-03-21 03:04:01,440: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:04:01.466791418Z [2024-03-21 03:04:01,466: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:04:01.468184094Z [2024-03-21 03:04:01,467: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:04:01.468413721Z [2024-03-21 03:04:01,468: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:04:01.468481481Z [2024-03-21 03:04:01,468: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T03:04:01.468697092Z [2024-03-21 03:04:01,468: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:04:01.572407105Z [2024-03-21 03:04:01,572: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:04:01.929982567Z [2024-03-21 03:04:01,929: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b4e8b42d-f05a-463c-9145-05cbbd045191] succeeded in 1.3102915750005195s: None
2024-03-21T03:04:02.371372176Z [2024-03-21 03:04:02,371: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7eacef0d-cd10-4138-9759-6b90401058c6] succeeded in 1.7535202099988965s: None
2024-03-21T03:04:02.429845391Z [2024-03-21 03:04:02,429: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:04:02.433475491Z [2024-03-21 03:04:02,432: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:04:02.458247812Z [2024-03-21 03:04:02,457: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:04:02.460349168Z [2024-03-21 03:04:02,460: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:04:02.461507143Z [2024-03-21 03:04:02,460: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:04:02.461660731Z [2024-03-21 03:04:02,461: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:04:02.461697230Z [2024-03-21 03:04:02,461: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:04:02.461987498Z [2024-03-21 03:04:02,461: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:04:02.462016989Z [2024-03-21 03:04:02,461: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:04:02.572053362Z [2024-03-21 03:04:02,571: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:04:02.771062869Z [2024-03-21 03:04:02,770: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T03:04:02.774570316Z [2024-03-21 03:04:02,774: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:04:02.796064778Z [2024-03-21 03:04:02,795: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:04:02.797349956Z [2024-03-21 03:04:02,797: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:04:02.797374988Z [2024-03-21 03:04:02,797: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:04:02.797554249Z [2024-03-21 03:04:02,797: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:04:02.797590501Z [2024-03-21 03:04:02,797: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T03:04:02.797904526Z [2024-03-21 03:04:02,797: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:04:02.797922005Z [2024-03-21 03:04:02,797: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:04:02.883137653Z [2024-03-21 03:04:02,882: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:04:04.059393251Z [2024-03-21 03:04:04,058: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[12ba8984-ff7e-4870-85c1-55521f9b681c] succeeded in 3.451869168000485s: None
2024-03-21T03:04:04.792834288Z [2024-03-21 03:04:04,792: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6ddd2300-4044-4eca-8fc4-a628c7da31b7] succeeded in 4.16735081799925s: None
2024-03-21T03:05:01.042031755Z [2024-03-21 03:05:01,041: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[079844f1-defb-4314-9947-bcba608742a4] received
2024-03-21T03:05:01.048690195Z [2024-03-21 03:05:01,048: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9e70794-2c57-4f1b-b7eb-6bb5fe31c407] received
2024-03-21T03:05:01.049653469Z [2024-03-21 03:05:01,049: INFO/ForkPoolWorker-15] [079844f1-defb-4314-9947-bcba608742a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:05:01.053018090Z [2024-03-21 03:05:01,052: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4878b85-0e99-4c86-9201-e770f7d39234] received
2024-03-21T03:05:01.056115852Z [2024-03-21 03:05:01,055: INFO/ForkPoolWorker-16] [c9e70794-2c57-4f1b-b7eb-6bb5fe31c407] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:05:01.059622178Z [2024-03-21 03:05:01,059: INFO/ForkPoolWorker-1] [a4878b85-0e99-4c86-9201-e770f7d39234] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:05:01.066434424Z [2024-03-21 03:05:01,066: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3dab22f4-1c86-4897-b44d-74e87e82ba34] received
2024-03-21T03:05:01.086020956Z [2024-03-21 03:05:01,085: INFO/ForkPoolWorker-2] [3dab22f4-1c86-4897-b44d-74e87e82ba34] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:05:01.423431595Z [2024-03-21 03:05:01,418: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:05:01.446119478Z [2024-03-21 03:05:01,442: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:05:01.467396703Z [2024-03-21 03:05:01,464: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:05:01.571176631Z [2024-03-21 03:05:01,565: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:05:01.597546523Z [2024-03-21 03:05:01,597: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T03:05:01.601582383Z [2024-03-21 03:05:01,601: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:05:01.625490471Z [2024-03-21 03:05:01,625: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:05:01.629646422Z [2024-03-21 03:05:01,629: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:05:01.629681036Z [2024-03-21 03:05:01,629: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:05:01.632015488Z [2024-03-21 03:05:01,629: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T03:05:01.632040540Z [2024-03-21 03:05:01,629: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:05:01.800449189Z [2024-03-21 03:05:01,800: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:05:02.504615778Z [2024-03-21 03:05:02,504: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3dab22f4-1c86-4897-b44d-74e87e82ba34] succeeded in 1.4360696000003372s: None
2024-03-21T03:05:03.031413796Z [2024-03-21 03:05:03,030: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:05:03.035592153Z [2024-03-21 03:05:03,034: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:05:03.062175629Z [2024-03-21 03:05:03,061: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:05:03.064251266Z [2024-03-21 03:05:03,063: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:05:03.064469119Z [2024-03-21 03:05:03,064: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:05:03.064798009Z [2024-03-21 03:05:03,064: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:05:03.064965049Z [2024-03-21 03:05:03,064: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:05:03.065427436Z [2024-03-21 03:05:03,065: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:05:03.065517540Z [2024-03-21 03:05:03,065: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:05:03.163051364Z [2024-03-21 03:05:03,162: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:05:03.222055410Z [2024-03-21 03:05:03,221: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:05:03.226098853Z [2024-03-21 03:05:03,225: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:05:03.250695368Z [2024-03-21 03:05:03,250: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:05:03.252216840Z [2024-03-21 03:05:03,251: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:05:03.252271088Z [2024-03-21 03:05:03,252: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:05:03.253816375Z [2024-03-21 03:05:03,253: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:05:03.253844620Z [2024-03-21 03:05:03,253: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:05:03.254156442Z [2024-03-21 03:05:03,253: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:05:03.254174337Z [2024-03-21 03:05:03,254: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:05:03.282444445Z [2024-03-21 03:05:03,281: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:05:03.286198896Z [2024-03-21 03:05:03,285: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:05:03.319516904Z [2024-03-21 03:05:03,319: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:05:03.323763394Z [2024-03-21 03:05:03,323: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:05:03.323869778Z [2024-03-21 03:05:03,323: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:05:03.324075520Z [2024-03-21 03:05:03,323: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:05:03.324182740Z [2024-03-21 03:05:03,324: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:05:03.324736308Z [2024-03-21 03:05:03,324: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:05:03.324749808Z [2024-03-21 03:05:03,324: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:05:03.355047517Z [2024-03-21 03:05:03,354: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:05:03.414391913Z [2024-03-21 03:05:03,414: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T03:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:05:04.099130948Z [2024-03-21 03:05:04,098: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[632e4cdb-5887-4a9d-aa53-cfd74fa2492e] received
2024-03-21T03:05:04.107373873Z [2024-03-21 03:05:04,106: INFO/ForkPoolWorker-2] [632e4cdb-5887-4a9d-aa53-cfd74fa2492e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:05:04.180901067Z [2024-03-21 03:05:04,180: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[079844f1-defb-4314-9947-bcba608742a4] succeeded in 3.136561332999918s: None
2024-03-21T03:05:04.464903417Z [2024-03-21 03:05:04,461: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:05:04.837978171Z [2024-03-21 03:05:04,837: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a4878b85-0e99-4c86-9201-e770f7d39234] succeeded in 3.782296409000992s: None
2024-03-21T03:05:05.294172076Z [2024-03-21 03:05:05,293: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c9e70794-2c57-4f1b-b7eb-6bb5fe31c407] succeeded in 4.244157002000065s: None
2024-03-21T03:05:05.736395182Z [2024-03-21 03:05:05,735: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T03:05:05.739729525Z [2024-03-21 03:05:05,739: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:05:05.761351306Z [2024-03-21 03:05:05,761: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:05:05.763734892Z [2024-03-21 03:05:05,763: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:05:05.763855554Z [2024-03-21 03:05:05,763: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:05:05.764059155Z [2024-03-21 03:05:05,763: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:05:05.764158595Z [2024-03-21 03:05:05,764: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T03:05:05.764609847Z [2024-03-21 03:05:05,764: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:05:05.764704424Z [2024-03-21 03:05:05,764: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:05:05.853895232Z [2024-03-21 03:05:05,853: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T03:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:05:06.510723712Z [2024-03-21 03:05:06,510: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[632e4cdb-5887-4a9d-aa53-cfd74fa2492e] succeeded in 2.4096466909995797s: None
2024-03-21T03:05:06.562020179Z [2024-03-21 03:05:06,561: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[351734e8-2209-445d-a30e-cd6e29bae90a] received
2024-03-21T03:05:06.568971757Z [2024-03-21 03:05:06,568: INFO/ForkPoolWorker-15] [351734e8-2209-445d-a30e-cd6e29bae90a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T03:05:06.846624360Z [2024-03-21 03:05:06,843: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:05:07.991584135Z [2024-03-21 03:05:07,991: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:05:07.994883923Z [2024-03-21 03:05:07,994: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:05:08.017473552Z [2024-03-21 03:05:08,017: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:05:08.019083741Z [2024-03-21 03:05:08,018: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:05:08.019116889Z [2024-03-21 03:05:08,018: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:05:08.019237216Z [2024-03-21 03:05:08,019: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:05:08.019251889Z [2024-03-21 03:05:08,019: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:05:08.019708906Z [2024-03-21 03:05:08,019: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:05:08.019745249Z [2024-03-21 03:05:08,019: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:05:08.134931907Z [2024-03-21 03:05:08,134: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T03:00:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:05:09.816249312Z [2024-03-21 03:05:09,815: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[351734e8-2209-445d-a30e-cd6e29bae90a] succeeded in 3.2523617619990546s: None
2024-03-21T03:05:09.957234438Z [2024-03-21 03:05:09,956: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86345b2f-52b6-4b46-b35a-46ea9d39f4c0] received
2024-03-21T03:05:09.970139940Z [2024-03-21 03:05:09,969: INFO/ForkPoolWorker-15] [86345b2f-52b6-4b46-b35a-46ea9d39f4c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:05:10.278913287Z [2024-03-21 03:05:10,275: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:05:11.615846499Z [2024-03-21 03:05:11,615: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:05:11.619517723Z [2024-03-21 03:05:11,618: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:05:11.640674548Z [2024-03-21 03:05:11,640: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:05:11.642228229Z [2024-03-21 03:05:11,641: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:05:11.642408409Z [2024-03-21 03:05:11,642: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:05:11.642596206Z [2024-03-21 03:05:11,642: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:05:11.642736566Z [2024-03-21 03:05:11,642: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:05:11.643039177Z [2024-03-21 03:05:11,642: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:05:11.643081010Z [2024-03-21 03:05:11,642: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:05:11.727321249Z [2024-03-21 03:05:11,726: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T03:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:05:12.371599594Z [2024-03-21 03:05:12,371: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[86345b2f-52b6-4b46-b35a-46ea9d39f4c0] succeeded in 2.4121616939992236s: None
2024-03-21T03:06:00.306392179Z [2024-03-21 03:06:00,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9fa2006-824f-4f78-8cda-b6c61c6cb837] received
2024-03-21T03:06:00.317218931Z [2024-03-21 03:06:00,316: INFO/ForkPoolWorker-15] [e9fa2006-824f-4f78-8cda-b6c61c6cb837] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T03:06:00.318897692Z [2024-03-21 03:06:00,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a07016ef-527a-4518-962e-68f68c6e08fb] received
2024-03-21T03:06:00.320854209Z [2024-03-21 03:06:00,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d475416-3a26-4fea-88bd-7b43a317ed73] received
2024-03-21T03:06:00.326306206Z [2024-03-21 03:06:00,326: INFO/ForkPoolWorker-16] [a07016ef-527a-4518-962e-68f68c6e08fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:06:00.328359045Z [2024-03-21 03:06:00,328: INFO/ForkPoolWorker-1] [4d475416-3a26-4fea-88bd-7b43a317ed73] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:06:00.333393919Z [2024-03-21 03:06:00,333: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[059c0d1b-ed95-4683-96a5-c96fa427857c] received
2024-03-21T03:06:00.349104276Z [2024-03-21 03:06:00,348: INFO/ForkPoolWorker-2] [059c0d1b-ed95-4683-96a5-c96fa427857c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:06:00.691530950Z [2024-03-21 03:06:00,687: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:06:00.700027667Z [2024-03-21 03:06:00,696: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:06:00.703832461Z [2024-03-21 03:06:00,700: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:06:00.706822479Z [2024-03-21 03:06:00,699: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T03:06:01.016922451Z [2024-03-21 03:06:01,016: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T03:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:06:01.025718198Z [2024-03-21 03:06:01,025: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T03:06:01.030108666Z [2024-03-21 03:06:01,029: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:06:01.065519221Z [2024-03-21 03:06:01,065: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:06:01.069274921Z [2024-03-21 03:06:01,068: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:06:01.069491888Z [2024-03-21 03:06:01,069: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:06:01.069729866Z [2024-03-21 03:06:01,069: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T03:06:01.070097522Z [2024-03-21 03:06:01,069: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:06:01.199631808Z [2024-03-21 03:06:01,199: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:06:01.704267681Z [2024-03-21 03:06:01,703: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e9fa2006-824f-4f78-8cda-b6c61c6cb837] succeeded in 1.3960905359999742s: None
2024-03-21T03:06:01.905691289Z [2024-03-21 03:06:01,905: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[059c0d1b-ed95-4683-96a5-c96fa427857c] succeeded in 1.5707654650013865s: None
2024-03-21T03:06:02.343021232Z [2024-03-21 03:06:02,342: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:06:02.346885941Z [2024-03-21 03:06:02,346: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:06:02.444985680Z [2024-03-21 03:06:02,444: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:06:02.446627693Z [2024-03-21 03:06:02,446: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:06:02.446766107Z [2024-03-21 03:06:02,446: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:06:02.446996299Z [2024-03-21 03:06:02,446: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:06:02.447162914Z [2024-03-21 03:06:02,447: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:06:02.447493763Z [2024-03-21 03:06:02,447: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:06:02.447981062Z [2024-03-21 03:06:02,447: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:06:02.485018030Z [2024-03-21 03:06:02,484: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:06:02.489287395Z [2024-03-21 03:06:02,488: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:06:02.548545427Z [2024-03-21 03:06:02,547: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:06:02.553530734Z [2024-03-21 03:06:02,553: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:06:02.553575671Z [2024-03-21 03:06:02,553: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:06:02.554031987Z [2024-03-21 03:06:02,553: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:06:02.554226938Z [2024-03-21 03:06:02,554: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:06:02.554804422Z [2024-03-21 03:06:02,554: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:06:02.555348833Z [2024-03-21 03:06:02,554: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:06:02.563097020Z [2024-03-21 03:06:02,562: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:06:02.669588006Z [2024-03-21 03:06:02,669: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:06:04.521466696Z [2024-03-21 03:06:04,521: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4d475416-3a26-4fea-88bd-7b43a317ed73] succeeded in 4.198986118999528s: None
2024-03-21T03:06:04.601620841Z [2024-03-21 03:06:04,601: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a07016ef-527a-4518-962e-68f68c6e08fb] succeeded in 4.2807323839988385s: None
2024-03-21T03:07:00.966858935Z [2024-03-21 03:07:00,966: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[afccf87c-dcb5-40ae-8591-2e5e2b3c7cb2] received
2024-03-21T03:07:00.971982659Z [2024-03-21 03:07:00,971: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aac439c2-f520-4a4c-bd5d-29a745f5a22f] received
2024-03-21T03:07:00.973711230Z [2024-03-21 03:07:00,973: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c4936cc-98ac-431c-8bcf-d80877f57f02] received
2024-03-21T03:07:00.979994677Z [2024-03-21 03:07:00,979: INFO/ForkPoolWorker-15] [afccf87c-dcb5-40ae-8591-2e5e2b3c7cb2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:07:00.991085207Z [2024-03-21 03:07:00,990: INFO/ForkPoolWorker-1] [7c4936cc-98ac-431c-8bcf-d80877f57f02] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:07:00.991534126Z [2024-03-21 03:07:00,991: INFO/ForkPoolWorker-16] [aac439c2-f520-4a4c-bd5d-29a745f5a22f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:07:01.338974783Z [2024-03-21 03:07:01,335: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:07:01.385231074Z [2024-03-21 03:07:01,381: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:07:01.420332765Z [2024-03-21 03:07:01,416: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:07:01.585896333Z [2024-03-21 03:07:01,585: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T03:07:01.590688311Z [2024-03-21 03:07:01,590: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:07:01.623424208Z [2024-03-21 03:07:01,623: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:07:01.624852442Z [2024-03-21 03:07:01,624: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:07:01.625024458Z [2024-03-21 03:07:01,624: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:07:01.625137356Z [2024-03-21 03:07:01,625: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T03:07:01.625381796Z [2024-03-21 03:07:01,625: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:07:01.736185647Z [2024-03-21 03:07:01,735: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:07:02.644049617Z [2024-03-21 03:07:02,643: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7c4936cc-98ac-431c-8bcf-d80877f57f02] succeeded in 1.6662373010003648s: None
2024-03-21T03:07:02.888591481Z [2024-03-21 03:07:02,888: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:07:02.895632316Z [2024-03-21 03:07:02,895: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:07:02.917683145Z [2024-03-21 03:07:02,917: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:07:02.919061190Z [2024-03-21 03:07:02,918: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:07:02.919384827Z [2024-03-21 03:07:02,919: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:07:02.919582529Z [2024-03-21 03:07:02,919: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:07:02.919700457Z [2024-03-21 03:07:02,919: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:07:02.920031226Z [2024-03-21 03:07:02,919: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:07:02.920150414Z [2024-03-21 03:07:02,920: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:07:02.947712595Z [2024-03-21 03:07:02,947: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:07:02.953684957Z [2024-03-21 03:07:02,952: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:07:02.985899331Z [2024-03-21 03:07:02,985: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:07:02.987686636Z [2024-03-21 03:07:02,987: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:07:02.987723225Z [2024-03-21 03:07:02,987: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:07:02.987843969Z [2024-03-21 03:07:02,987: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:07:02.987876399Z [2024-03-21 03:07:02,987: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:07:02.988422707Z [2024-03-21 03:07:02,987: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:07:02.988549279Z [2024-03-21 03:07:02,988: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:07:03.022830627Z [2024-03-21 03:07:03,022: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:07:03.093228806Z [2024-03-21 03:07:03,092: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:07:04.544449351Z [2024-03-21 03:07:04,543: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aac439c2-f520-4a4c-bd5d-29a745f5a22f] succeeded in 3.570553748999373s: None
2024-03-21T03:07:04.820405292Z [2024-03-21 03:07:04,818: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[afccf87c-dcb5-40ae-8591-2e5e2b3c7cb2] succeeded in 3.8501109100016038s: None
2024-03-21T03:08:00.879935614Z [2024-03-21 03:08:00,879: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[959478fe-befc-4b6e-a9ed-9f29414e9e38] received
2024-03-21T03:08:00.887027417Z [2024-03-21 03:08:00,886: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00deb2fb-9d48-41b2-aa2c-ad83ecb39f5c] received
2024-03-21T03:08:00.891384686Z [2024-03-21 03:08:00,891: INFO/ForkPoolWorker-15] [959478fe-befc-4b6e-a9ed-9f29414e9e38] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T03:08:00.895240258Z [2024-03-21 03:08:00,895: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33cb3dc1-03d9-4917-bb12-77ed69f41ed2] received
2024-03-21T03:08:00.896938979Z [2024-03-21 03:08:00,896: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d867b8ff-1d9d-4423-a5b5-661aa8956f09] received
2024-03-21T03:08:00.905050356Z [2024-03-21 03:08:00,904: INFO/ForkPoolWorker-16] [00deb2fb-9d48-41b2-aa2c-ad83ecb39f5c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:08:00.916245134Z [2024-03-21 03:08:00,915: INFO/ForkPoolWorker-1] [33cb3dc1-03d9-4917-bb12-77ed69f41ed2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:08:00.920428449Z [2024-03-21 03:08:00,916: INFO/ForkPoolWorker-2] [d867b8ff-1d9d-4423-a5b5-661aa8956f09] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:08:01.243048625Z [2024-03-21 03:08:01,239: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:08:01.348325299Z [2024-03-21 03:08:01,344: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:08:01.387364708Z [2024-03-21 03:08:01,382: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:08:01.412214363Z [2024-03-21 03:08:01,409: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T03:08:01.730467799Z [2024-03-21 03:08:01,730: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T03:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:08:01.890680934Z [2024-03-21 03:08:01,890: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T03:08:01.899706888Z [2024-03-21 03:08:01,899: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:08:01.971796848Z [2024-03-21 03:08:01,971: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:08:01.981390412Z [2024-03-21 03:08:01,981: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:08:01.981538933Z [2024-03-21 03:08:01,981: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:08:01.981681394Z [2024-03-21 03:08:01,981: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T03:08:01.981953460Z [2024-03-21 03:08:01,981: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:08:02.155630413Z [2024-03-21 03:08:02,155: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:08:02.621473869Z [2024-03-21 03:08:02,621: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[959478fe-befc-4b6e-a9ed-9f29414e9e38] succeeded in 1.7365632930013817s: None
2024-03-21T03:08:02.932382495Z [2024-03-21 03:08:02,931: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d867b8ff-1d9d-4423-a5b5-661aa8956f09] succeeded in 2.024154188000466s: None
2024-03-21T03:08:02.946030539Z [2024-03-21 03:08:02,945: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:08:02.950048840Z [2024-03-21 03:08:02,949: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:08:02.978982729Z [2024-03-21 03:08:02,978: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:08:02.981564611Z [2024-03-21 03:08:02,981: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:08:02.983217078Z [2024-03-21 03:08:02,982: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:08:02.983460335Z [2024-03-21 03:08:02,983: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:08:02.983642092Z [2024-03-21 03:08:02,983: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:08:02.984165923Z [2024-03-21 03:08:02,983: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:08:02.984352655Z [2024-03-21 03:08:02,984: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:08:03.081460578Z [2024-03-21 03:08:03,081: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:08:03.095147207Z [2024-03-21 03:08:03,094: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:08:03.098675485Z [2024-03-21 03:08:03,098: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:08:03.127550473Z [2024-03-21 03:08:03,127: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:08:03.129027689Z [2024-03-21 03:08:03,128: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:08:03.129186030Z [2024-03-21 03:08:03,129: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:08:03.129466066Z [2024-03-21 03:08:03,129: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:08:03.129660211Z [2024-03-21 03:08:03,129: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:08:03.130888763Z [2024-03-21 03:08:03,130: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:08:03.131086611Z [2024-03-21 03:08:03,130: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:08:03.235451325Z [2024-03-21 03:08:03,235: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:08:04.772491902Z [2024-03-21 03:08:04,770: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[33cb3dc1-03d9-4917-bb12-77ed69f41ed2] succeeded in 3.8648118490000343s: None
2024-03-21T03:08:05.302331882Z [2024-03-21 03:08:05,301: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[00deb2fb-9d48-41b2-aa2c-ad83ecb39f5c] succeeded in 4.413545070001419s: None
2024-03-21T03:09:00.349775493Z [2024-03-21 03:09:00,349: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9afa905-6fcd-4fbf-b17b-47b1ccddef3f] received
2024-03-21T03:09:00.351038400Z [2024-03-21 03:09:00,350: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c7d2019-90a1-4d11-b729-cb81e3814ee4] received
2024-03-21T03:09:00.353455570Z [2024-03-21 03:09:00,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[669d891c-a6e6-47f0-b9cb-bcb6fd6cf48b] received
2024-03-21T03:09:00.357237359Z [2024-03-21 03:09:00,357: INFO/ForkPoolWorker-15] [f9afa905-6fcd-4fbf-b17b-47b1ccddef3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:09:00.361418297Z [2024-03-21 03:09:00,361: INFO/ForkPoolWorker-16] [4c7d2019-90a1-4d11-b729-cb81e3814ee4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:09:00.365196082Z [2024-03-21 03:09:00,364: INFO/ForkPoolWorker-1] [669d891c-a6e6-47f0-b9cb-bcb6fd6cf48b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:09:00.639394730Z [2024-03-21 03:09:00,636: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:09:00.639880240Z [2024-03-21 03:09:00,636: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:09:00.661897783Z [2024-03-21 03:09:00,658: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:09:00.790220548Z [2024-03-21 03:09:00,789: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T03:09:00.794637443Z [2024-03-21 03:09:00,794: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:09:00.823406978Z [2024-03-21 03:09:00,823: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:09:00.825110327Z [2024-03-21 03:09:00,824: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:09:00.825320715Z [2024-03-21 03:09:00,825: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:09:00.825497156Z [2024-03-21 03:09:00,825: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T03:09:00.825827677Z [2024-03-21 03:09:00,825: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:09:00.959001230Z [2024-03-21 03:09:00,958: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:09:01.554361121Z [2024-03-21 03:09:01,553: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f9afa905-6fcd-4fbf-b17b-47b1ccddef3f] succeeded in 1.2021197260000918s: None
2024-03-21T03:09:01.786266105Z [2024-03-21 03:09:01,785: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:09:01.790478007Z [2024-03-21 03:09:01,789: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:09:01.814827060Z [2024-03-21 03:09:01,814: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:09:01.817047284Z [2024-03-21 03:09:01,816: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:09:01.817143088Z [2024-03-21 03:09:01,816: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:09:01.817373092Z [2024-03-21 03:09:01,817: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:09:01.817471708Z [2024-03-21 03:09:01,817: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:09:01.818004563Z [2024-03-21 03:09:01,817: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:09:01.818109286Z [2024-03-21 03:09:01,817: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:09:01.836761383Z [2024-03-21 03:09:01,836: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:09:01.840099924Z [2024-03-21 03:09:01,839: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:09:01.865400808Z [2024-03-21 03:09:01,865: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:09:01.866578821Z [2024-03-21 03:09:01,866: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:09:01.866708708Z [2024-03-21 03:09:01,866: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:09:01.866827673Z [2024-03-21 03:09:01,866: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:09:01.866852092Z [2024-03-21 03:09:01,866: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:09:01.867136048Z [2024-03-21 03:09:01,866: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:09:01.867140050Z [2024-03-21 03:09:01,867: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:09:01.926737602Z [2024-03-21 03:09:01,926: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:09:01.962225578Z [2024-03-21 03:09:01,961: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:09:03.567279708Z [2024-03-21 03:09:03,566: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[669d891c-a6e6-47f0-b9cb-bcb6fd6cf48b] succeeded in 3.211569827999483s: None
2024-03-21T03:09:04.020274970Z [2024-03-21 03:09:04,019: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4c7d2019-90a1-4d11-b729-cb81e3814ee4] succeeded in 3.6679010469997593s: None
2024-03-21T03:10:00.738228664Z [2024-03-21 03:10:00,737: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[686d7aea-1035-4574-b76a-e9d1f50e78a6] received
2024-03-21T03:10:00.740629562Z [2024-03-21 03:10:00,740: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0321a5d2-d1eb-463c-9a25-aeccccb5bef9] received
2024-03-21T03:10:00.748002551Z [2024-03-21 03:10:00,747: INFO/ForkPoolWorker-16] [0321a5d2-d1eb-463c-9a25-aeccccb5bef9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:10:00.748611974Z [2024-03-21 03:10:00,748: INFO/ForkPoolWorker-15] [686d7aea-1035-4574-b76a-e9d1f50e78a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:10:00.760430328Z [2024-03-21 03:10:00,760: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[847ef3ba-4e34-4c34-9b46-28d8e6a9beb8] received
2024-03-21T03:10:00.763308900Z [2024-03-21 03:10:00,763: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c8974a4-00aa-4cf6-9ede-f18abcfdef5f] received
2024-03-21T03:10:00.769548163Z [2024-03-21 03:10:00,769: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c8c3cc8-4c4a-4a88-ac6f-3b174c3da574] received
2024-03-21T03:10:00.784636022Z [2024-03-21 03:10:00,784: INFO/ForkPoolWorker-1] [847ef3ba-4e34-4c34-9b46-28d8e6a9beb8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:10:00.789648450Z [2024-03-21 03:10:00,789: INFO/ForkPoolWorker-2] [9c8974a4-00aa-4cf6-9ede-f18abcfdef5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:10:00.801424459Z [2024-03-21 03:10:00,801: INFO/ForkPoolWorker-3] [9c8c3cc8-4c4a-4a88-ac6f-3b174c3da574] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T03:10:01.172171276Z [2024-03-21 03:10:01,168: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:10:01.206997255Z [2024-03-21 03:10:01,203: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:10:01.212246662Z [2024-03-21 03:10:01,207: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:10:01.370835137Z [2024-03-21 03:10:01,367: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:10:01.376027453Z [2024-03-21 03:10:01,375: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T03:10:01.381854382Z [2024-03-21 03:10:01,381: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:10:01.443738962Z [2024-03-21 03:10:01,435: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T03:10:01.447448081Z [2024-03-21 03:10:01,447: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:10:01.450886481Z [2024-03-21 03:10:01,450: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:10:01.451351154Z [2024-03-21 03:10:01,451: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:10:01.451649331Z [2024-03-21 03:10:01,451: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T03:10:01.452152653Z [2024-03-21 03:10:01,451: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:10:01.621077559Z [2024-03-21 03:10:01,620: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:10:02.138057357Z [2024-03-21 03:10:02,137: INFO/ForkPoolWorker-3] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T03:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:10:02.793242569Z [2024-03-21 03:10:02,792: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[847ef3ba-4e34-4c34-9b46-28d8e6a9beb8] succeeded in 2.0257312920002732s: None
2024-03-21T03:10:03.245000451Z [2024-03-21 03:10:03,244: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:10:03.249565224Z [2024-03-21 03:10:03,249: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:10:03.277565340Z [2024-03-21 03:10:03,277: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[9c8c3cc8-4c4a-4a88-ac6f-3b174c3da574] succeeded in 2.501242745000127s: None
2024-03-21T03:10:03.278282270Z [2024-03-21 03:10:03,277: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:10:03.281675833Z [2024-03-21 03:10:03,281: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:10:03.281981507Z [2024-03-21 03:10:03,281: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:10:03.282321281Z [2024-03-21 03:10:03,282: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:10:03.282627682Z [2024-03-21 03:10:03,282: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:10:03.283159533Z [2024-03-21 03:10:03,283: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:10:03.283346578Z [2024-03-21 03:10:03,283: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:10:03.372907117Z [2024-03-21 03:10:03,372: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:10:03.497507994Z [2024-03-21 03:10:03,497: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:10:03.501133884Z [2024-03-21 03:10:03,500: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:10:03.508998625Z [2024-03-21 03:10:03,508: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T03:10:03.513018034Z [2024-03-21 03:10:03,512: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:10:03.529298432Z [2024-03-21 03:10:03,529: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:10:03.531140473Z [2024-03-21 03:10:03,530: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:10:03.531168556Z [2024-03-21 03:10:03,531: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:10:03.531335133Z [2024-03-21 03:10:03,531: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:10:03.531350890Z [2024-03-21 03:10:03,531: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:10:03.531658283Z [2024-03-21 03:10:03,531: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:10:03.531683807Z [2024-03-21 03:10:03,531: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:10:03.537411399Z [2024-03-21 03:10:03,537: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:10:03.540229194Z [2024-03-21 03:10:03,539: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:10:03.540437358Z [2024-03-21 03:10:03,540: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:10:03.540961045Z [2024-03-21 03:10:03,540: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:10:03.541133002Z [2024-03-21 03:10:03,540: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T03:10:03.541906191Z [2024-03-21 03:10:03,541: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:10:03.542190247Z [2024-03-21 03:10:03,541: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:10:03.630862863Z [2024-03-21 03:10:03,630: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T03:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:10:03.631113447Z [2024-03-21 03:10:03,630: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:10:04.178057354Z [2024-03-21 03:10:04,177: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9c8974a4-00aa-4cf6-9ede-f18abcfdef5f] succeeded in 3.407641023000906s: None
2024-03-21T03:10:04.295937084Z [2024-03-21 03:10:04,295: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44a88524-e456-429a-b00e-d6dad9ad5714] received
2024-03-21T03:10:04.302990394Z [2024-03-21 03:10:04,302: INFO/ForkPoolWorker-1] [44a88524-e456-429a-b00e-d6dad9ad5714] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:10:04.725796209Z [2024-03-21 03:10:04,722: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:10:05.445693565Z [2024-03-21 03:10:05,445: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0321a5d2-d1eb-463c-9a25-aeccccb5bef9] succeeded in 4.702537016000861s: None
2024-03-21T03:10:05.481071066Z [2024-03-21 03:10:05,480: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[686d7aea-1035-4574-b76a-e9d1f50e78a6] succeeded in 4.738804949000041s: None
2024-03-21T03:10:06.063069770Z [2024-03-21 03:10:06,062: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:10:06.066730573Z [2024-03-21 03:10:06,066: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:10:06.091333774Z [2024-03-21 03:10:06,090: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:10:06.094719085Z [2024-03-21 03:10:06,094: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:10:06.095295138Z [2024-03-21 03:10:06,094: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:10:06.095800135Z [2024-03-21 03:10:06,095: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:10:06.096081680Z [2024-03-21 03:10:06,095: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:10:06.097098066Z [2024-03-21 03:10:06,096: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:10:06.097862607Z [2024-03-21 03:10:06,097: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:10:06.238721077Z [2024-03-21 03:10:06,238: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T03:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:10:07.052120099Z [2024-03-21 03:10:07,051: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[44a88524-e456-429a-b00e-d6dad9ad5714] succeeded in 2.7545834650009056s: None
2024-03-21T03:10:08.070952741Z [2024-03-21 03:10:08,070: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aaceda70-7cce-4114-b139-0ead1d2ab133] received
2024-03-21T03:10:08.081703836Z [2024-03-21 03:10:08,081: INFO/ForkPoolWorker-15] [aaceda70-7cce-4114-b139-0ead1d2ab133] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T03:10:08.370440111Z [2024-03-21 03:10:08,366: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:10:09.727244002Z [2024-03-21 03:10:09,726: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:10:09.730754669Z [2024-03-21 03:10:09,730: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:10:09.753883662Z [2024-03-21 03:10:09,753: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:10:09.755610972Z [2024-03-21 03:10:09,755: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:10:09.755716790Z [2024-03-21 03:10:09,755: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:10:09.755908716Z [2024-03-21 03:10:09,755: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:10:09.756088755Z [2024-03-21 03:10:09,755: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:10:09.757015744Z [2024-03-21 03:10:09,756: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:10:09.757053784Z [2024-03-21 03:10:09,756: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:10:09.870662149Z [2024-03-21 03:10:09,870: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T03:05:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:10:11.415530037Z [2024-03-21 03:10:11,415: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aaceda70-7cce-4114-b139-0ead1d2ab133] succeeded in 3.342570404998696s: None
2024-03-21T03:10:11.798545459Z [2024-03-21 03:10:11,798: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be6810c6-b3e2-4536-93d5-9af316ae90c3] received
2024-03-21T03:10:11.806327251Z [2024-03-21 03:10:11,805: INFO/ForkPoolWorker-15] [be6810c6-b3e2-4536-93d5-9af316ae90c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:10:12.089874416Z [2024-03-21 03:10:12,086: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:10:13.261845712Z [2024-03-21 03:10:13,261: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:10:13.265454329Z [2024-03-21 03:10:13,264: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:10:13.282458973Z [2024-03-21 03:10:13,282: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:10:13.283717251Z [2024-03-21 03:10:13,283: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:10:13.283734452Z [2024-03-21 03:10:13,283: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:10:13.283841678Z [2024-03-21 03:10:13,283: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:10:13.283854756Z [2024-03-21 03:10:13,283: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:10:13.284092644Z [2024-03-21 03:10:13,283: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:10:13.284111080Z [2024-03-21 03:10:13,284: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:10:13.377523905Z [2024-03-21 03:10:13,377: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T03:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:10:13.913104484Z [2024-03-21 03:10:13,912: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[be6810c6-b3e2-4536-93d5-9af316ae90c3] succeeded in 2.1127374949992372s: None
2024-03-21T03:11:01.169642192Z [2024-03-21 03:11:01,169: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6888d55-1567-470a-adf4-d9e149ae013b] received
2024-03-21T03:11:01.177486564Z [2024-03-21 03:11:01,177: INFO/ForkPoolWorker-15] [c6888d55-1567-470a-adf4-d9e149ae013b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:11:01.181235788Z [2024-03-21 03:11:01,180: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a780d8fc-a17d-4b9c-95bb-a6b028078497] received
2024-03-21T03:11:01.188143817Z [2024-03-21 03:11:01,187: INFO/ForkPoolWorker-16] [a780d8fc-a17d-4b9c-95bb-a6b028078497] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:11:01.188354210Z [2024-03-21 03:11:01,188: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[955a5acb-ba5b-4164-b288-c536dc3fbe7e] received
2024-03-21T03:11:01.202942989Z [2024-03-21 03:11:01,202: INFO/ForkPoolWorker-1] [955a5acb-ba5b-4164-b288-c536dc3fbe7e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:11:01.496465572Z [2024-03-21 03:11:01,493: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:11:01.524331083Z [2024-03-21 03:11:01,521: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:11:01.540334797Z [2024-03-21 03:11:01,537: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:11:01.710102295Z [2024-03-21 03:11:01,709: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T03:11:01.717704144Z [2024-03-21 03:11:01,716: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:11:01.753494797Z [2024-03-21 03:11:01,753: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:11:01.754774245Z [2024-03-21 03:11:01,754: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:11:01.754973526Z [2024-03-21 03:11:01,754: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:11:01.755019595Z [2024-03-21 03:11:01,754: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T03:11:01.755330516Z [2024-03-21 03:11:01,755: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:11:01.895299911Z [2024-03-21 03:11:01,894: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:11:02.888479477Z [2024-03-21 03:11:02,887: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a780d8fc-a17d-4b9c-95bb-a6b028078497] succeeded in 1.7049173840005096s: None
2024-03-21T03:11:02.979652806Z [2024-03-21 03:11:02,979: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:11:02.984146257Z [2024-03-21 03:11:02,983: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:11:03.029206351Z [2024-03-21 03:11:03,028: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:11:03.031352567Z [2024-03-21 03:11:03,031: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:11:03.031467099Z [2024-03-21 03:11:03,031: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:11:03.031885397Z [2024-03-21 03:11:03,031: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:11:03.032042619Z [2024-03-21 03:11:03,031: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:11:03.032476829Z [2024-03-21 03:11:03,032: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:11:03.033105329Z [2024-03-21 03:11:03,032: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:11:03.084896696Z [2024-03-21 03:11:03,080: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:11:03.090391472Z [2024-03-21 03:11:03,089: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:11:03.121588740Z [2024-03-21 03:11:03,121: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:11:03.123116575Z [2024-03-21 03:11:03,122: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:11:03.123207588Z [2024-03-21 03:11:03,123: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:11:03.123362378Z [2024-03-21 03:11:03,123: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:11:03.123455801Z [2024-03-21 03:11:03,123: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:11:03.123770051Z [2024-03-21 03:11:03,123: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:11:03.123905754Z [2024-03-21 03:11:03,123: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:11:03.183797622Z [2024-03-21 03:11:03,183: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:11:03.248762664Z [2024-03-21 03:11:03,248: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:11:06.994367094Z [2024-03-21 03:11:06,993: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[955a5acb-ba5b-4164-b288-c536dc3fbe7e] succeeded in 5.803251138999258s: None
2024-03-21T03:11:08.428618587Z [2024-03-21 03:11:08,428: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c6888d55-1567-470a-adf4-d9e149ae013b] succeeded in 7.256823785000961s: None
2024-03-21T03:12:00.527137608Z [2024-03-21 03:12:00,526: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23bb4a93-fd38-4d39-8d8f-72e2fbb088db] received
2024-03-21T03:12:00.535563037Z [2024-03-21 03:12:00,535: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5b222c8-c72c-4f39-b316-06c5317231bc] received
2024-03-21T03:12:00.537912461Z [2024-03-21 03:12:00,537: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[721923c6-51ea-48ba-b121-1158ea407b50] received
2024-03-21T03:12:00.546556872Z [2024-03-21 03:12:00,545: INFO/ForkPoolWorker-15] [23bb4a93-fd38-4d39-8d8f-72e2fbb088db] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T03:12:00.547504866Z [2024-03-21 03:12:00,546: INFO/ForkPoolWorker-1] [721923c6-51ea-48ba-b121-1158ea407b50] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:12:00.550669346Z [2024-03-21 03:12:00,550: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c885a39-abf9-4df9-9983-192c3343c161] received
2024-03-21T03:12:00.554931846Z [2024-03-21 03:12:00,554: INFO/ForkPoolWorker-16] [d5b222c8-c72c-4f39-b316-06c5317231bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:12:00.557174309Z [2024-03-21 03:12:00,556: INFO/ForkPoolWorker-2] [8c885a39-abf9-4df9-9983-192c3343c161] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:12:00.873163413Z [2024-03-21 03:12:00,870: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T03:12:00.892068841Z [2024-03-21 03:12:00,887: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:12:00.962059748Z [2024-03-21 03:12:00,958: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:12:00.973897212Z [2024-03-21 03:12:00,970: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:12:01.139965956Z [2024-03-21 03:12:01,139: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T03:12:01.144036856Z [2024-03-21 03:12:01,143: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:12:01.164258939Z [2024-03-21 03:12:01,163: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T03:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:12:01.195552333Z [2024-03-21 03:12:01,195: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:12:01.201441489Z [2024-03-21 03:12:01,201: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:12:01.201490862Z [2024-03-21 03:12:01,201: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:12:01.201496219Z [2024-03-21 03:12:01,201: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T03:12:01.201710961Z [2024-03-21 03:12:01,201: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:12:01.313758756Z [2024-03-21 03:12:01,313: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:12:01.819890626Z [2024-03-21 03:12:01,819: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[23bb4a93-fd38-4d39-8d8f-72e2fbb088db] succeeded in 1.2847979920006765s: None
2024-03-21T03:12:02.016243042Z [2024-03-21 03:12:02,015: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8c885a39-abf9-4df9-9983-192c3343c161] succeeded in 1.4639575719993445s: None
2024-03-21T03:12:02.273515498Z [2024-03-21 03:12:02,273: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:12:02.277580683Z [2024-03-21 03:12:02,277: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:12:02.336984158Z [2024-03-21 03:12:02,336: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:12:02.338170574Z [2024-03-21 03:12:02,337: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:12:02.338222467Z [2024-03-21 03:12:02,338: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:12:02.338301400Z [2024-03-21 03:12:02,338: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:12:02.338356329Z [2024-03-21 03:12:02,338: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:12:02.338597924Z [2024-03-21 03:12:02,338: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:12:02.338643606Z [2024-03-21 03:12:02,338: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:12:02.404991786Z [2024-03-21 03:12:02,404: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:12:02.408985716Z [2024-03-21 03:12:02,408: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:12:02.424487740Z [2024-03-21 03:12:02,424: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:12:02.437718298Z [2024-03-21 03:12:02,437: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:12:02.441260000Z [2024-03-21 03:12:02,440: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:12:02.441502853Z [2024-03-21 03:12:02,441: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:12:02.441731177Z [2024-03-21 03:12:02,441: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:12:02.441885638Z [2024-03-21 03:12:02,441: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:12:02.442299038Z [2024-03-21 03:12:02,442: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:12:02.442527347Z [2024-03-21 03:12:02,442: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:12:02.530226517Z [2024-03-21 03:12:02,529: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:12:03.247905492Z [2024-03-21 03:12:03,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ea3bd07-007e-453e-ade6-6d6a881d8400] received
2024-03-21T03:12:03.255539911Z [2024-03-21 03:12:03,255: INFO/ForkPoolWorker-15] [3ea3bd07-007e-453e-ade6-6d6a881d8400] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240321031202_295223', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py']
2024-03-21T03:12:03.563979690Z [2024-03-21 03:12:03,560: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py
2024-03-21T03:12:03.891975758Z [2024-03-21 03:12:03,891: INFO/ForkPoolWorker-15] Running <TaskInstance: scaleout_vdu.main_task scaleout_vdu_20240321031202_295223 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:12:04.091414228Z [2024-03-21 03:12:04,090: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[721923c6-51ea-48ba-b121-1158ea407b50] succeeded in 3.5506680800008326s: None
2024-03-21T03:12:04.437601605Z [2024-03-21 03:12:04,437: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d5b222c8-c72c-4f39-b316-06c5317231bc] succeeded in 3.8929370250007196s: None
2024-03-21T03:12:04.494489699Z [2024-03-21 03:12:04,494: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3ea3bd07-007e-453e-ade6-6d6a881d8400] succeeded in 1.2439616350002325s: None
2024-03-21T03:13:00.870593815Z [2024-03-21 03:13:00,870: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b1168a6-4e5f-4e25-a682-fff91c2be8d8] received
2024-03-21T03:13:00.878435594Z [2024-03-21 03:13:00,878: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[060dbdbf-9c6c-41fc-a859-963fe7555eb9] received
2024-03-21T03:13:00.879773886Z [2024-03-21 03:13:00,879: INFO/ForkPoolWorker-15] [5b1168a6-4e5f-4e25-a682-fff91c2be8d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:13:00.888285706Z [2024-03-21 03:13:00,888: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e54e69a-4c44-4faa-b6ef-9413c0d0eb0a] received
2024-03-21T03:13:00.888758182Z [2024-03-21 03:13:00,888: INFO/ForkPoolWorker-16] [060dbdbf-9c6c-41fc-a859-963fe7555eb9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:13:00.895831713Z [2024-03-21 03:13:00,895: INFO/ForkPoolWorker-1] [2e54e69a-4c44-4faa-b6ef-9413c0d0eb0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:13:01.200302604Z [2024-03-21 03:13:01,197: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:13:01.206738494Z [2024-03-21 03:13:01,203: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:13:01.221283467Z [2024-03-21 03:13:01,217: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:13:01.392471029Z [2024-03-21 03:13:01,392: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T03:13:01.396557070Z [2024-03-21 03:13:01,396: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:13:01.422961608Z [2024-03-21 03:13:01,422: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:13:01.423999521Z [2024-03-21 03:13:01,423: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:13:01.424150422Z [2024-03-21 03:13:01,423: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:13:01.424228463Z [2024-03-21 03:13:01,424: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T03:13:01.424559381Z [2024-03-21 03:13:01,424: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:13:01.552107830Z [2024-03-21 03:13:01,551: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:13:02.142848475Z [2024-03-21 03:13:02,142: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2e54e69a-4c44-4faa-b6ef-9413c0d0eb0a] succeeded in 1.2522329940002237s: None
2024-03-21T03:13:02.502977784Z [2024-03-21 03:13:02,502: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:13:02.506531721Z [2024-03-21 03:13:02,505: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:13:02.515309354Z [2024-03-21 03:13:02,514: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:13:02.519541631Z [2024-03-21 03:13:02,519: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:13:02.528961024Z [2024-03-21 03:13:02,528: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:13:02.530846573Z [2024-03-21 03:13:02,530: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:13:02.530863754Z [2024-03-21 03:13:02,530: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:13:02.531114090Z [2024-03-21 03:13:02,530: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:13:02.531236156Z [2024-03-21 03:13:02,531: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:13:02.531565972Z [2024-03-21 03:13:02,531: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:13:02.531708213Z [2024-03-21 03:13:02,531: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:13:02.551234344Z [2024-03-21 03:13:02,550: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:13:02.553261314Z [2024-03-21 03:13:02,552: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:13:02.553427793Z [2024-03-21 03:13:02,553: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:13:02.553743630Z [2024-03-21 03:13:02,553: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:13:02.553957819Z [2024-03-21 03:13:02,553: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:13:02.554436093Z [2024-03-21 03:13:02,554: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:13:02.554665764Z [2024-03-21 03:13:02,554: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:13:02.627646688Z [2024-03-21 03:13:02,627: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:13:02.681272783Z [2024-03-21 03:13:02,680: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:13:05.192028299Z [2024-03-21 03:13:05,191: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[060dbdbf-9c6c-41fc-a859-963fe7555eb9] succeeded in 4.3116496080001525s: None
2024-03-21T03:13:05.206175106Z [2024-03-21 03:13:05,205: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5b1168a6-4e5f-4e25-a682-fff91c2be8d8] succeeded in 4.332626606999838s: None
2024-03-21T03:14:00.910620241Z [2024-03-21 03:14:00,910: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f706b9bb-2546-4d9d-a4bc-1aa1c963744c] received
2024-03-21T03:14:00.915010750Z [2024-03-21 03:14:00,914: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f087fbfe-7eb9-487f-8bf6-089ee57f7877] received
2024-03-21T03:14:00.916700832Z [2024-03-21 03:14:00,916: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa8148c4-cdf1-4360-b37c-cc933bfff460] received
2024-03-21T03:14:00.924085858Z [2024-03-21 03:14:00,923: INFO/ForkPoolWorker-1] [aa8148c4-cdf1-4360-b37c-cc933bfff460] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:14:00.924768835Z [2024-03-21 03:14:00,924: INFO/ForkPoolWorker-16] [f087fbfe-7eb9-487f-8bf6-089ee57f7877] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:14:00.926327959Z [2024-03-21 03:14:00,926: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[555aceda-dfc5-44c7-8bc1-e8db8635a622] received
2024-03-21T03:14:00.928236926Z [2024-03-21 03:14:00,927: INFO/ForkPoolWorker-15] [f706b9bb-2546-4d9d-a4bc-1aa1c963744c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T03:14:00.938698717Z [2024-03-21 03:14:00,938: INFO/ForkPoolWorker-2] [555aceda-dfc5-44c7-8bc1-e8db8635a622] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:14:01.232628676Z [2024-03-21 03:14:01,229: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:14:01.289586749Z [2024-03-21 03:14:01,286: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T03:14:01.439894870Z [2024-03-21 03:14:01,434: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:14:01.453166762Z [2024-03-21 03:14:01,447: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:14:01.586680801Z [2024-03-21 03:14:01,586: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T03:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:14:01.647138514Z [2024-03-21 03:14:01,643: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T03:14:01.665069485Z [2024-03-21 03:14:01,664: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:14:01.721830047Z [2024-03-21 03:14:01,721: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:14:01.725606116Z [2024-03-21 03:14:01,725: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:14:01.725829491Z [2024-03-21 03:14:01,725: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:14:01.725975959Z [2024-03-21 03:14:01,725: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T03:14:01.726335011Z [2024-03-21 03:14:01,726: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:14:01.853801338Z [2024-03-21 03:14:01,853: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:14:02.325460862Z [2024-03-21 03:14:02,324: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f706b9bb-2546-4d9d-a4bc-1aa1c963744c] succeeded in 1.4127169379989937s: None
2024-03-21T03:14:02.550521331Z [2024-03-21 03:14:02,550: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[555aceda-dfc5-44c7-8bc1-e8db8635a622] succeeded in 1.6206314209994162s: None
2024-03-21T03:14:02.780089382Z [2024-03-21 03:14:02,779: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:14:02.785061128Z [2024-03-21 03:14:02,784: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:14:02.818674389Z [2024-03-21 03:14:02,818: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:14:02.820749198Z [2024-03-21 03:14:02,820: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:14:02.820802396Z [2024-03-21 03:14:02,820: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:14:02.821014315Z [2024-03-21 03:14:02,820: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:14:02.821063082Z [2024-03-21 03:14:02,820: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:14:02.821469006Z [2024-03-21 03:14:02,821: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:14:02.821566487Z [2024-03-21 03:14:02,821: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:14:02.935132220Z [2024-03-21 03:14:02,934: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:14:02.949689236Z [2024-03-21 03:14:02,949: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:14:02.953312683Z [2024-03-21 03:14:02,952: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:14:02.972848986Z [2024-03-21 03:14:02,972: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:14:02.974691945Z [2024-03-21 03:14:02,974: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:14:02.974912285Z [2024-03-21 03:14:02,974: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:14:02.975130523Z [2024-03-21 03:14:02,974: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:14:02.975278941Z [2024-03-21 03:14:02,975: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:14:02.975720550Z [2024-03-21 03:14:02,975: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:14:02.975879512Z [2024-03-21 03:14:02,975: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:14:03.095254400Z [2024-03-21 03:14:03,094: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:14:04.972374053Z [2024-03-21 03:14:04,971: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aa8148c4-cdf1-4360-b37c-cc933bfff460] succeeded in 4.054389942000853s: None
2024-03-21T03:14:06.106939652Z [2024-03-21 03:14:06,106: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f087fbfe-7eb9-487f-8bf6-089ee57f7877] succeeded in 5.190358413001377s: None
2024-03-21T03:15:00.540371915Z [2024-03-21 03:15:00,539: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ab2f943-9fe3-42c9-bbea-9e840f4bc77e] received
2024-03-21T03:15:00.543526242Z [2024-03-21 03:15:00,543: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d04d36e1-0c26-4b6f-a47b-c91c48d8208a] received
2024-03-21T03:15:00.551887761Z [2024-03-21 03:15:00,551: INFO/ForkPoolWorker-15] [7ab2f943-9fe3-42c9-bbea-9e840f4bc77e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:15:00.554609419Z [2024-03-21 03:15:00,554: INFO/ForkPoolWorker-16] [d04d36e1-0c26-4b6f-a47b-c91c48d8208a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:15:00.565935104Z [2024-03-21 03:15:00,565: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b4ab282-9b87-4913-a1ed-28bcb695e229] received
2024-03-21T03:15:00.568698148Z [2024-03-21 03:15:00,568: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60ef7899-dbb6-4c83-8578-d84237f41a3a] received
2024-03-21T03:15:00.586494232Z [2024-03-21 03:15:00,586: INFO/ForkPoolWorker-1] [5b4ab282-9b87-4913-a1ed-28bcb695e229] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:15:00.586608141Z [2024-03-21 03:15:00,586: INFO/ForkPoolWorker-2] [60ef7899-dbb6-4c83-8578-d84237f41a3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:15:00.934960479Z [2024-03-21 03:15:00,931: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:15:00.935271581Z [2024-03-21 03:15:00,928: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:15:00.971601119Z [2024-03-21 03:15:00,968: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:15:00.976471994Z [2024-03-21 03:15:00,972: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:15:01.171748446Z [2024-03-21 03:15:01,171: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T03:15:01.175719963Z [2024-03-21 03:15:01,175: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:15:01.213373684Z [2024-03-21 03:15:01,213: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:15:01.217285088Z [2024-03-21 03:15:01,216: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:15:01.217333675Z [2024-03-21 03:15:01,217: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:15:01.217422928Z [2024-03-21 03:15:01,217: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T03:15:01.217738023Z [2024-03-21 03:15:01,217: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:15:01.318485826Z [2024-03-21 03:15:01,318: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:15:02.099629161Z [2024-03-21 03:15:02,099: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d04d36e1-0c26-4b6f-a47b-c91c48d8208a] succeeded in 1.551750197999354s: None
2024-03-21T03:15:02.539091260Z [2024-03-21 03:15:02,538: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:15:02.544803575Z [2024-03-21 03:15:02,544: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:15:02.567774371Z [2024-03-21 03:15:02,567: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:15:02.569695689Z [2024-03-21 03:15:02,569: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:15:02.569874984Z [2024-03-21 03:15:02,569: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:15:02.570107503Z [2024-03-21 03:15:02,569: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:15:02.570548576Z [2024-03-21 03:15:02,570: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:15:02.571145783Z [2024-03-21 03:15:02,570: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:15:02.571302648Z [2024-03-21 03:15:02,571: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:15:02.612418513Z [2024-03-21 03:15:02,611: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:15:02.616035467Z [2024-03-21 03:15:02,615: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:15:02.645097776Z [2024-03-21 03:15:02,644: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:15:02.647844115Z [2024-03-21 03:15:02,647: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:15:02.647947470Z [2024-03-21 03:15:02,647: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:15:02.648148208Z [2024-03-21 03:15:02,647: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:15:02.648234576Z [2024-03-21 03:15:02,648: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:15:02.648719597Z [2024-03-21 03:15:02,648: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:15:02.648792650Z [2024-03-21 03:15:02,648: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:15:02.676088215Z [2024-03-21 03:15:02,675: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T03:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:15:02.733262478Z [2024-03-21 03:15:02,732: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:15:02.737306207Z [2024-03-21 03:15:02,736: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T03:15:02.741255011Z [2024-03-21 03:15:02,740: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:15:02.765099765Z [2024-03-21 03:15:02,764: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:15:02.768297332Z [2024-03-21 03:15:02,767: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:15:02.768682832Z [2024-03-21 03:15:02,768: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:15:02.769159576Z [2024-03-21 03:15:02,768: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:15:02.769438330Z [2024-03-21 03:15:02,769: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T03:15:02.769907689Z [2024-03-21 03:15:02,769: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:15:02.770221371Z [2024-03-21 03:15:02,770: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:15:02.933569825Z [2024-03-21 03:15:02,933: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:15:03.555830959Z [2024-03-21 03:15:03,555: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3506f4d-9f0c-4ff7-8098-27178c8f0d7a] received
2024-03-21T03:15:03.574408215Z [2024-03-21 03:15:03,573: INFO/ForkPoolWorker-16] [e3506f4d-9f0c-4ff7-8098-27178c8f0d7a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:15:03.581765689Z [2024-03-21 03:15:03,581: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5b4ab282-9b87-4913-a1ed-28bcb695e229] succeeded in 3.0125932060000196s: None
2024-03-21T03:15:03.863503998Z [2024-03-21 03:15:03,860: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:15:04.470264949Z [2024-03-21 03:15:04,469: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7ab2f943-9fe3-42c9-bbea-9e840f4bc77e] succeeded in 3.9250859250005306s: None
2024-03-21T03:15:04.984673104Z [2024-03-21 03:15:04,984: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[60ef7899-dbb6-4c83-8578-d84237f41a3a] succeeded in 4.408427444999688s: None
2024-03-21T03:15:05.264763598Z [2024-03-21 03:15:05,264: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:15:05.268412794Z [2024-03-21 03:15:05,267: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:15:05.293116366Z [2024-03-21 03:15:05,292: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:15:05.295434252Z [2024-03-21 03:15:05,295: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:15:05.295636225Z [2024-03-21 03:15:05,295: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:15:05.295911408Z [2024-03-21 03:15:05,295: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:15:05.296058206Z [2024-03-21 03:15:05,295: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:15:05.296614676Z [2024-03-21 03:15:05,296: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:15:05.296807805Z [2024-03-21 03:15:05,296: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:15:05.393762868Z [2024-03-21 03:15:05,393: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T03:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:15:06.045522012Z [2024-03-21 03:15:06,040: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e3506f4d-9f0c-4ff7-8098-27178c8f0d7a] succeeded in 2.48006171400084s: None
2024-03-21T03:15:06.056796437Z [2024-03-21 03:15:06,056: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a25cd05-2a9c-4000-b193-6ef1ae2286e4] received
2024-03-21T03:15:06.064543425Z [2024-03-21 03:15:06,064: INFO/ForkPoolWorker-15] [1a25cd05-2a9c-4000-b193-6ef1ae2286e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T03:15:06.454932315Z [2024-03-21 03:15:06,451: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:15:07.546702981Z [2024-03-21 03:15:07,546: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:15:07.549990733Z [2024-03-21 03:15:07,549: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:15:07.571817375Z [2024-03-21 03:15:07,571: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:15:07.574467635Z [2024-03-21 03:15:07,574: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:15:07.574807772Z [2024-03-21 03:15:07,574: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:15:07.575214972Z [2024-03-21 03:15:07,574: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:15:07.575478724Z [2024-03-21 03:15:07,575: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:15:07.576218915Z [2024-03-21 03:15:07,575: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:15:07.576463292Z [2024-03-21 03:15:07,576: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:15:07.684256001Z [2024-03-21 03:15:07,683: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T03:10:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:15:09.671898890Z [2024-03-21 03:15:09,671: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1a25cd05-2a9c-4000-b193-6ef1ae2286e4] succeeded in 3.6132608040006744s: None
2024-03-21T03:15:09.692170683Z [2024-03-21 03:15:09,691: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9b4652b-6cbf-4801-ad1b-cb3bfd2a8a83] received
2024-03-21T03:15:09.701814147Z [2024-03-21 03:15:09,701: INFO/ForkPoolWorker-15] [a9b4652b-6cbf-4801-ad1b-cb3bfd2a8a83] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:15:10.009822403Z [2024-03-21 03:15:10,006: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:15:11.149075682Z [2024-03-21 03:15:11,148: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:15:11.152347508Z [2024-03-21 03:15:11,151: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:15:11.167688833Z [2024-03-21 03:15:11,167: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:15:11.168867079Z [2024-03-21 03:15:11,168: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:15:11.168886436Z [2024-03-21 03:15:11,168: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:15:11.169014703Z [2024-03-21 03:15:11,168: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:15:11.169059883Z [2024-03-21 03:15:11,168: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:15:11.169401397Z [2024-03-21 03:15:11,169: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:15:11.169505314Z [2024-03-21 03:15:11,169: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:15:11.256478936Z [2024-03-21 03:15:11,256: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T03:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:15:11.844747074Z [2024-03-21 03:15:11,844: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a9b4652b-6cbf-4801-ad1b-cb3bfd2a8a83] succeeded in 2.1489808590013126s: None
2024-03-21T03:16:00.450190455Z [2024-03-21 03:16:00,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9785f89c-7945-4fbf-b618-9e2463f11bf0] received
2024-03-21T03:16:00.457157847Z [2024-03-21 03:16:00,456: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aea9bca3-5df1-4034-9c14-57d652f7e4ab] received
2024-03-21T03:16:00.458002693Z [2024-03-21 03:16:00,457: INFO/ForkPoolWorker-15] [9785f89c-7945-4fbf-b618-9e2463f11bf0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T03:16:00.471419058Z [2024-03-21 03:16:00,471: INFO/ForkPoolWorker-16] [aea9bca3-5df1-4034-9c14-57d652f7e4ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:16:00.473106895Z [2024-03-21 03:16:00,472: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[042959f0-de01-4632-be16-1be89eff2a09] received
2024-03-21T03:16:00.475483906Z [2024-03-21 03:16:00,475: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c091e2e-affb-4753-aedf-f01190aabb16] received
2024-03-21T03:16:00.479720677Z [2024-03-21 03:16:00,479: INFO/ForkPoolWorker-1] [042959f0-de01-4632-be16-1be89eff2a09] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:16:00.490458580Z [2024-03-21 03:16:00,490: INFO/ForkPoolWorker-2] [4c091e2e-affb-4753-aedf-f01190aabb16] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:16:00.752328274Z [2024-03-21 03:16:00,749: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T03:16:00.811005407Z [2024-03-21 03:16:00,807: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:16:00.971152626Z [2024-03-21 03:16:00,967: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:16:00.977405881Z [2024-03-21 03:16:00,973: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:16:01.034556209Z [2024-03-21 03:16:01,034: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T03:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:16:01.187422431Z [2024-03-21 03:16:01,186: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T03:16:01.191504567Z [2024-03-21 03:16:01,191: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:16:01.220018446Z [2024-03-21 03:16:01,219: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:16:01.221531494Z [2024-03-21 03:16:01,221: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:16:01.221759821Z [2024-03-21 03:16:01,221: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:16:01.221841515Z [2024-03-21 03:16:01,221: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T03:16:01.222270992Z [2024-03-21 03:16:01,222: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:16:01.354714059Z [2024-03-21 03:16:01,354: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:16:01.706661388Z [2024-03-21 03:16:01,705: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9785f89c-7945-4fbf-b618-9e2463f11bf0] succeeded in 1.2538057299989305s: None
2024-03-21T03:16:02.027511652Z [2024-03-21 03:16:02,027: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4c091e2e-affb-4753-aedf-f01190aabb16] succeeded in 1.5495601870006794s: None
2024-03-21T03:16:02.337570682Z [2024-03-21 03:16:02,337: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:16:02.342715755Z [2024-03-21 03:16:02,342: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:16:02.367300065Z [2024-03-21 03:16:02,367: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:16:02.369274775Z [2024-03-21 03:16:02,369: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:16:02.369439750Z [2024-03-21 03:16:02,369: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:16:02.369610835Z [2024-03-21 03:16:02,369: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:16:02.369754976Z [2024-03-21 03:16:02,369: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:16:02.370054831Z [2024-03-21 03:16:02,369: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:16:02.370148673Z [2024-03-21 03:16:02,370: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:16:02.393047859Z [2024-03-21 03:16:02,392: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:16:02.399914199Z [2024-03-21 03:16:02,399: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:16:02.443389777Z [2024-03-21 03:16:02,443: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:16:02.445644489Z [2024-03-21 03:16:02,445: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:16:02.445827940Z [2024-03-21 03:16:02,445: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:16:02.446124777Z [2024-03-21 03:16:02,445: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:16:02.446297306Z [2024-03-21 03:16:02,446: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:16:02.446846526Z [2024-03-21 03:16:02,446: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:16:02.447200910Z [2024-03-21 03:16:02,446: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:16:02.489041152Z [2024-03-21 03:16:02,488: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:16:02.573880241Z [2024-03-21 03:16:02,573: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:16:03.273872758Z [2024-03-21 03:16:03,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87e795aa-9302-44da-b5e2-172e0c41bd9a] received
2024-03-21T03:16:03.284166371Z [2024-03-21 03:16:03,283: INFO/ForkPoolWorker-15] [87e795aa-9302-44da-b5e2-172e0c41bd9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240321031602_165431', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py']
2024-03-21T03:16:03.645722247Z [2024-03-21 03:16:03,642: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py
2024-03-21T03:16:03.945452102Z [2024-03-21 03:16:03,945: INFO/ForkPoolWorker-15] Running <TaskInstance: scaleout_vdu.main_task scaleout_vdu_20240321031602_165431 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:16:04.372960551Z [2024-03-21 03:16:04,372: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[042959f0-de01-4632-be16-1be89eff2a09] succeeded in 3.8982842580007855s: None
2024-03-21T03:16:04.520858110Z [2024-03-21 03:16:04,520: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[87e795aa-9302-44da-b5e2-172e0c41bd9a] succeeded in 1.2435440979988925s: None
2024-03-21T03:16:04.676950363Z [2024-03-21 03:16:04,676: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aea9bca3-5df1-4034-9c14-57d652f7e4ab] succeeded in 4.217421731000286s: None
2024-03-21T03:17:00.311667572Z [2024-03-21 03:17:00,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[149d00e8-4afe-4b0e-8def-63c20ee5f6fd] received
2024-03-21T03:17:00.313177419Z [2024-03-21 03:17:00,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e462623a-820b-44ce-95ec-28ba7a558238] received
2024-03-21T03:17:00.320580042Z [2024-03-21 03:17:00,320: INFO/ForkPoolWorker-15] [149d00e8-4afe-4b0e-8def-63c20ee5f6fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:17:00.326188681Z [2024-03-21 03:17:00,319: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c526aa6-89e0-4cf5-9380-5b3295bca2e5] received
2024-03-21T03:17:00.328946612Z [2024-03-21 03:17:00,328: INFO/ForkPoolWorker-16] [e462623a-820b-44ce-95ec-28ba7a558238] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:17:00.334469061Z [2024-03-21 03:17:00,334: INFO/ForkPoolWorker-1] [0c526aa6-89e0-4cf5-9380-5b3295bca2e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:17:00.618746411Z [2024-03-21 03:17:00,615: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:17:00.622944738Z [2024-03-21 03:17:00,619: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:17:00.639007980Z [2024-03-21 03:17:00,635: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:17:00.805478913Z [2024-03-21 03:17:00,805: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T03:17:00.809912356Z [2024-03-21 03:17:00,809: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:17:00.835776687Z [2024-03-21 03:17:00,835: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:17:00.837708254Z [2024-03-21 03:17:00,837: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:17:00.838026246Z [2024-03-21 03:17:00,837: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:17:00.838185502Z [2024-03-21 03:17:00,837: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T03:17:00.838715637Z [2024-03-21 03:17:00,838: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:17:00.960339803Z [2024-03-21 03:17:00,959: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:17:01.619930674Z [2024-03-21 03:17:01,619: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0c526aa6-89e0-4cf5-9380-5b3295bca2e5] succeeded in 1.291760288999285s: None
2024-03-21T03:17:01.968630613Z [2024-03-21 03:17:01,968: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:17:01.972481052Z [2024-03-21 03:17:01,971: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:17:01.998933157Z [2024-03-21 03:17:01,998: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:17:02.000523610Z [2024-03-21 03:17:02,000: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:17:02.000541360Z [2024-03-21 03:17:02,000: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:17:02.002251623Z [2024-03-21 03:17:02,000: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:17:02.002282274Z [2024-03-21 03:17:02,002: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:17:02.003236747Z [2024-03-21 03:17:02,002: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:17:02.003296706Z [2024-03-21 03:17:02,003: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:17:02.021289393Z [2024-03-21 03:17:02,020: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:17:02.024835341Z [2024-03-21 03:17:02,024: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:17:02.043027587Z [2024-03-21 03:17:02,042: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:17:02.045515075Z [2024-03-21 03:17:02,045: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:17:02.045536851Z [2024-03-21 03:17:02,045: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:17:02.045724406Z [2024-03-21 03:17:02,045: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:17:02.045833868Z [2024-03-21 03:17:02,045: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:17:02.046344500Z [2024-03-21 03:17:02,046: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:17:02.046382933Z [2024-03-21 03:17:02,046: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:17:02.095257975Z [2024-03-21 03:17:02,094: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:17:02.136463460Z [2024-03-21 03:17:02,136: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:17:03.684271646Z [2024-03-21 03:17:03,683: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[149d00e8-4afe-4b0e-8def-63c20ee5f6fd] succeeded in 3.3685287080006674s: None
2024-03-21T03:17:04.286772235Z [2024-03-21 03:17:04,286: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e462623a-820b-44ce-95ec-28ba7a558238] succeeded in 3.9688864559993817s: None
2024-03-21T03:18:01.221707659Z [2024-03-21 03:18:01,221: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[193ec053-c867-4d52-b2bd-9efb046aeaa8] received
2024-03-21T03:18:01.225004220Z [2024-03-21 03:18:01,224: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86d6734b-8b20-4ab0-bdd9-9cff1c268a68] received
2024-03-21T03:18:01.232528157Z [2024-03-21 03:18:01,232: INFO/ForkPoolWorker-15] [193ec053-c867-4d52-b2bd-9efb046aeaa8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:18:01.235113177Z [2024-03-21 03:18:01,234: INFO/ForkPoolWorker-16] [86d6734b-8b20-4ab0-bdd9-9cff1c268a68] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:18:01.244474456Z [2024-03-21 03:18:01,244: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1857c8a9-0efb-410d-afcb-bdb94cdae5f5] received
2024-03-21T03:18:01.248218466Z [2024-03-21 03:18:01,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d351f1e4-0084-4ea6-8af2-8d5015f16233] received
2024-03-21T03:18:01.266299580Z [2024-03-21 03:18:01,265: INFO/ForkPoolWorker-2] [d351f1e4-0084-4ea6-8af2-8d5015f16233] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:18:01.266788441Z [2024-03-21 03:18:01,266: INFO/ForkPoolWorker-1] [1857c8a9-0efb-410d-afcb-bdb94cdae5f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T03:18:01.832840635Z [2024-03-21 03:18:01,825: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:18:01.833693841Z [2024-03-21 03:18:01,827: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:18:01.843337445Z [2024-03-21 03:18:01,838: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:18:01.869525117Z [2024-03-21 03:18:01,863: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T03:18:02.191957220Z [2024-03-21 03:18:02,191: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T03:18:02.196132759Z [2024-03-21 03:18:02,195: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:18:02.229665529Z [2024-03-21 03:18:02,229: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:18:02.233276409Z [2024-03-21 03:18:02,231: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:18:02.240454000Z [2024-03-21 03:18:02,233: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:18:02.240478944Z [2024-03-21 03:18:02,238: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T03:18:02.240487220Z [2024-03-21 03:18:02,238: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:18:02.356472139Z [2024-03-21 03:18:02,350: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T03:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:18:02.535333278Z [2024-03-21 03:18:02,535: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:18:03.461364179Z [2024-03-21 03:18:03,460: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1857c8a9-0efb-410d-afcb-bdb94cdae5f5] succeeded in 2.2143734949986538s: None
2024-03-21T03:18:03.533595344Z [2024-03-21 03:18:03,533: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[86d6734b-8b20-4ab0-bdd9-9cff1c268a68] succeeded in 2.3051871370007575s: None
2024-03-21T03:18:03.643441333Z [2024-03-21 03:18:03,643: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:18:03.647324253Z [2024-03-21 03:18:03,646: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:18:03.677905925Z [2024-03-21 03:18:03,677: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:18:03.679442595Z [2024-03-21 03:18:03,679: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:18:03.679455165Z [2024-03-21 03:18:03,679: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:18:03.679552207Z [2024-03-21 03:18:03,679: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:18:03.679601501Z [2024-03-21 03:18:03,679: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:18:03.680053460Z [2024-03-21 03:18:03,679: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:18:03.680099088Z [2024-03-21 03:18:03,679: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:18:03.699322827Z [2024-03-21 03:18:03,698: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T03:18:03.703459026Z [2024-03-21 03:18:03,702: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:18:03.732279547Z [2024-03-21 03:18:03,732: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:18:03.733542803Z [2024-03-21 03:18:03,733: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:18:03.733967191Z [2024-03-21 03:18:03,733: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:18:03.734313163Z [2024-03-21 03:18:03,734: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:18:03.734810571Z [2024-03-21 03:18:03,734: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T03:18:03.735097355Z [2024-03-21 03:18:03,734: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:18:03.735479173Z [2024-03-21 03:18:03,735: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:18:03.768753820Z [2024-03-21 03:18:03,768: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:18:03.818911172Z [2024-03-21 03:18:03,818: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:18:06.516411760Z [2024-03-21 03:18:06,515: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[193ec053-c867-4d52-b2bd-9efb046aeaa8] succeeded in 5.289955356998689s: None
2024-03-21T03:18:07.353613096Z [2024-03-21 03:18:07,353: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d351f1e4-0084-4ea6-8af2-8d5015f16233] succeeded in 6.1029441639984725s: None
2024-03-21T03:19:00.470826385Z [2024-03-21 03:19:00,470: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d66a936a-3a76-4352-bc56-455327ce4250] received
2024-03-21T03:19:00.474575481Z [2024-03-21 03:19:00,474: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1f10915-6e99-4bd0-8f1f-d846851b7b7c] received
2024-03-21T03:19:00.480000938Z [2024-03-21 03:19:00,479: INFO/ForkPoolWorker-15] [d66a936a-3a76-4352-bc56-455327ce4250] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:19:00.481057223Z [2024-03-21 03:19:00,480: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f00457d-c474-4359-b0f7-e4b260de435c] received
2024-03-21T03:19:00.485981429Z [2024-03-21 03:19:00,485: INFO/ForkPoolWorker-16] [b1f10915-6e99-4bd0-8f1f-d846851b7b7c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:19:00.490055007Z [2024-03-21 03:19:00,489: INFO/ForkPoolWorker-1] [2f00457d-c474-4359-b0f7-e4b260de435c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:19:00.766932477Z [2024-03-21 03:19:00,763: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:19:00.787680475Z [2024-03-21 03:19:00,784: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:19:00.820186196Z [2024-03-21 03:19:00,817: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:19:01.003100900Z [2024-03-21 03:19:01,000: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T03:19:01.008214301Z [2024-03-21 03:19:01,007: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:19:01.034659249Z [2024-03-21 03:19:01,034: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:19:01.035827354Z [2024-03-21 03:19:01,035: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:19:01.035942262Z [2024-03-21 03:19:01,035: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:19:01.035978176Z [2024-03-21 03:19:01,035: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T03:19:01.036287294Z [2024-03-21 03:19:01,036: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:19:01.148222384Z [2024-03-21 03:19:01,147: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:19:01.956674564Z [2024-03-21 03:19:01,956: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2f00457d-c474-4359-b0f7-e4b260de435c] succeeded in 1.4738306750004995s: None
2024-03-21T03:19:02.230656099Z [2024-03-21 03:19:02,230: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:19:02.239657280Z [2024-03-21 03:19:02,237: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:19:02.239695449Z [2024-03-21 03:19:02,238: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:19:02.247984246Z [2024-03-21 03:19:02,247: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:19:02.319095357Z [2024-03-21 03:19:02,318: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:19:02.321241337Z [2024-03-21 03:19:02,320: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:19:02.321264870Z [2024-03-21 03:19:02,321: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:19:02.321532032Z [2024-03-21 03:19:02,321: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:19:02.321910715Z [2024-03-21 03:19:02,321: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:19:02.322415968Z [2024-03-21 03:19:02,322: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:19:02.322573385Z [2024-03-21 03:19:02,322: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:19:02.410003946Z [2024-03-21 03:19:02,409: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:19:02.411609989Z [2024-03-21 03:19:02,411: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:19:02.411633752Z [2024-03-21 03:19:02,411: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:19:02.411840728Z [2024-03-21 03:19:02,411: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:19:02.411989433Z [2024-03-21 03:19:02,411: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:19:02.412338410Z [2024-03-21 03:19:02,412: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:19:02.412474456Z [2024-03-21 03:19:02,412: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:19:02.482438282Z [2024-03-21 03:19:02,482: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:19:02.541830583Z [2024-03-21 03:19:02,541: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:19:04.481658578Z [2024-03-21 03:19:04,481: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d66a936a-3a76-4352-bc56-455327ce4250] succeeded in 4.00843801299925s: None
2024-03-21T03:19:04.498983194Z [2024-03-21 03:19:04,498: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b1f10915-6e99-4bd0-8f1f-d846851b7b7c] succeeded in 4.0223573870007385s: None
2024-03-21T03:20:00.857763789Z [2024-03-21 03:20:00,857: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88ea09d2-10b1-44dd-95df-f10f54be947c] received
2024-03-21T03:20:00.864099944Z [2024-03-21 03:20:00,863: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3ea7852-6273-46df-9986-c4a48d1b4fd6] received
2024-03-21T03:20:00.865300457Z [2024-03-21 03:20:00,865: INFO/ForkPoolWorker-15] [88ea09d2-10b1-44dd-95df-f10f54be947c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:20:00.875586735Z [2024-03-21 03:20:00,875: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2fd6de3a-89a1-44d4-9cf5-fcff81e9dd34] received
2024-03-21T03:20:00.880097152Z [2024-03-21 03:20:00,879: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e11d2a4e-4726-4fbc-bdaa-bcc2a798016a] received
2024-03-21T03:20:00.880747881Z [2024-03-21 03:20:00,878: INFO/ForkPoolWorker-16] [f3ea7852-6273-46df-9986-c4a48d1b4fd6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T03:20:00.882643752Z [2024-03-21 03:20:00,882: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5275e1a-1f80-4fad-892f-9cffa22def5e] received
2024-03-21T03:20:00.883537273Z [2024-03-21 03:20:00,883: INFO/ForkPoolWorker-1] [2fd6de3a-89a1-44d4-9cf5-fcff81e9dd34] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:20:00.888603149Z [2024-03-21 03:20:00,887: INFO/ForkPoolWorker-2] [e11d2a4e-4726-4fbc-bdaa-bcc2a798016a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:20:00.900165854Z [2024-03-21 03:20:00,899: INFO/ForkPoolWorker-3] [e5275e1a-1f80-4fad-892f-9cffa22def5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:20:01.305869037Z [2024-03-21 03:20:01,302: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:20:01.309661841Z [2024-03-21 03:20:01,303: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:20:01.321773276Z [2024-03-21 03:20:01,318: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T03:20:01.339203611Z [2024-03-21 03:20:01,331: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:20:01.383928120Z [2024-03-21 03:20:01,371: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:20:01.520006466Z [2024-03-21 03:20:01,519: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T03:20:01.532707282Z [2024-03-21 03:20:01,532: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:20:01.569375978Z [2024-03-21 03:20:01,569: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:20:01.571624592Z [2024-03-21 03:20:01,571: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:20:01.572098295Z [2024-03-21 03:20:01,571: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:20:01.572119464Z [2024-03-21 03:20:01,571: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T03:20:01.572331241Z [2024-03-21 03:20:01,572: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:20:01.681609517Z [2024-03-21 03:20:01,681: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:20:01.751702475Z [2024-03-21 03:20:01,751: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T03:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:20:02.593807139Z [2024-03-21 03:20:02,593: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2fd6de3a-89a1-44d4-9cf5-fcff81e9dd34] succeeded in 1.7159553740002593s: None
2024-03-21T03:20:02.743553616Z [2024-03-21 03:20:02,743: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f3ea7852-6273-46df-9986-c4a48d1b4fd6] succeeded in 1.8774310699991474s: None
2024-03-21T03:20:03.065738964Z [2024-03-21 03:20:03,065: INFO/ForkPoolWorker-3] Getting VIM list
2024-03-21T03:20:03.072739943Z [2024-03-21 03:20:03,071: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:20:03.109168370Z [2024-03-21 03:20:03,108: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-21T03:20:03.111317289Z [2024-03-21 03:20:03,111: INFO/ForkPoolWorker-3] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:20:03.111414479Z [2024-03-21 03:20:03,111: INFO/ForkPoolWorker-3] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:20:03.111687714Z [2024-03-21 03:20:03,111: INFO/ForkPoolWorker-3] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:20:03.111757650Z [2024-03-21 03:20:03,111: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-03-21T03:20:03.112203639Z [2024-03-21 03:20:03,112: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:20:03.112302285Z [2024-03-21 03:20:03,112: INFO/ForkPoolWorker-3] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:20:03.160297135Z [2024-03-21 03:20:03,159: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T03:20:03.163804823Z [2024-03-21 03:20:03,163: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:20:03.188606630Z [2024-03-21 03:20:03,188: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:20:03.190438928Z [2024-03-21 03:20:03,190: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:20:03.190487888Z [2024-03-21 03:20:03,190: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:20:03.190798648Z [2024-03-21 03:20:03,190: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:20:03.190841214Z [2024-03-21 03:20:03,190: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T03:20:03.191443505Z [2024-03-21 03:20:03,191: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:20:03.191674422Z [2024-03-21 03:20:03,191: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:20:03.213910163Z [2024-03-21 03:20:03,213: INFO/ForkPoolWorker-3] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:20:03.251080165Z [2024-03-21 03:20:03,250: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:20:03.254497152Z [2024-03-21 03:20:03,254: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:20:03.281476742Z [2024-03-21 03:20:03,281: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:20:03.282747326Z [2024-03-21 03:20:03,282: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:20:03.282763162Z [2024-03-21 03:20:03,282: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:20:03.282876117Z [2024-03-21 03:20:03,282: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:20:03.282891353Z [2024-03-21 03:20:03,282: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:20:03.283167896Z [2024-03-21 03:20:03,283: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:20:03.283180747Z [2024-03-21 03:20:03,283: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:20:03.289921513Z [2024-03-21 03:20:03,289: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:20:03.387067666Z [2024-03-21 03:20:03,386: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T03:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:20:03.978694407Z [2024-03-21 03:20:03,978: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef60c947-bd72-49eb-9442-4c0f24e9bd7a] received
2024-03-21T03:20:03.986044492Z [2024-03-21 03:20:03,985: INFO/ForkPoolWorker-16] [ef60c947-bd72-49eb-9442-4c0f24e9bd7a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:20:04.042783125Z [2024-03-21 03:20:04,042: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[88ea09d2-10b1-44dd-95df-f10f54be947c] succeeded in 3.183053074999407s: None
2024-03-21T03:20:04.277956202Z [2024-03-21 03:20:04,274: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:20:04.791869318Z [2024-03-21 03:20:04,791: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[e5275e1a-1f80-4fad-892f-9cffa22def5e] succeeded in 3.901946844000122s: None
2024-03-21T03:20:05.136392930Z [2024-03-21 03:20:05,135: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e11d2a4e-4726-4fbc-bdaa-bcc2a798016a] succeeded in 4.25458552300006s: None
2024-03-21T03:20:05.582499301Z [2024-03-21 03:20:05,582: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:20:05.586040104Z [2024-03-21 03:20:05,585: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:20:05.606103932Z [2024-03-21 03:20:05,605: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:20:05.607545139Z [2024-03-21 03:20:05,607: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:20:05.607664857Z [2024-03-21 03:20:05,607: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:20:05.607973969Z [2024-03-21 03:20:05,607: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:20:05.608274460Z [2024-03-21 03:20:05,608: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:20:05.608649162Z [2024-03-21 03:20:05,608: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:20:05.608749274Z [2024-03-21 03:20:05,608: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:20:05.705882531Z [2024-03-21 03:20:05,705: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T03:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:20:06.362772097Z [2024-03-21 03:20:06,362: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ef60c947-bd72-49eb-9442-4c0f24e9bd7a] succeeded in 2.3822209409991046s: None
2024-03-21T03:20:06.588639059Z [2024-03-21 03:20:06,584: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77c416f6-55fd-47af-9914-2aedf5790d22] received
2024-03-21T03:20:06.599003693Z [2024-03-21 03:20:06,598: INFO/ForkPoolWorker-15] [77c416f6-55fd-47af-9914-2aedf5790d22] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T03:20:06.916901357Z [2024-03-21 03:20:06,913: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:20:08.102852925Z [2024-03-21 03:20:08,102: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:20:08.106437034Z [2024-03-21 03:20:08,105: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:20:08.136864333Z [2024-03-21 03:20:08,136: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:20:08.142158730Z [2024-03-21 03:20:08,141: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:20:08.142415796Z [2024-03-21 03:20:08,142: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:20:08.142696892Z [2024-03-21 03:20:08,142: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:20:08.142897903Z [2024-03-21 03:20:08,142: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:20:08.143351169Z [2024-03-21 03:20:08,143: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:20:08.143603053Z [2024-03-21 03:20:08,143: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:20:08.258942040Z [2024-03-21 03:20:08,258: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T03:15:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:20:09.648550614Z [2024-03-21 03:20:09,648: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[77c416f6-55fd-47af-9914-2aedf5790d22] succeeded in 3.0607682409990957s: None
2024-03-21T03:20:10.070726435Z [2024-03-21 03:20:10,070: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72fd6049-9e54-4a48-ac43-f47c34321282] received
2024-03-21T03:20:10.088509237Z [2024-03-21 03:20:10,088: INFO/ForkPoolWorker-15] [72fd6049-9e54-4a48-ac43-f47c34321282] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:20:10.420141759Z [2024-03-21 03:20:10,415: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:20:11.565260720Z [2024-03-21 03:20:11,564: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:20:11.568644185Z [2024-03-21 03:20:11,568: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:20:11.592516960Z [2024-03-21 03:20:11,592: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:20:11.594001977Z [2024-03-21 03:20:11,593: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:20:11.594186011Z [2024-03-21 03:20:11,594: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:20:11.594430589Z [2024-03-21 03:20:11,594: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:20:11.594596348Z [2024-03-21 03:20:11,594: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:20:11.595009735Z [2024-03-21 03:20:11,594: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:20:11.595216973Z [2024-03-21 03:20:11,595: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:20:11.682679003Z [2024-03-21 03:20:11,682: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T03:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:20:12.210020215Z [2024-03-21 03:20:12,209: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[72fd6049-9e54-4a48-ac43-f47c34321282] succeeded in 2.135303193001164s: None
2024-03-21T03:21:00.657930875Z [2024-03-21 03:21:00,657: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[610ede32-3bdf-43cb-af14-72460261cbfd] received
2024-03-21T03:21:00.660941410Z [2024-03-21 03:21:00,660: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[140881ae-62a3-494b-88e4-904af7a72709] received
2024-03-21T03:21:00.666608269Z [2024-03-21 03:21:00,666: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[686d4df9-e129-4b1e-98f6-507208734118] received
2024-03-21T03:21:00.668550657Z [2024-03-21 03:21:00,668: INFO/ForkPoolWorker-16] [140881ae-62a3-494b-88e4-904af7a72709] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:21:00.678089824Z [2024-03-21 03:21:00,677: INFO/ForkPoolWorker-1] [686d4df9-e129-4b1e-98f6-507208734118] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:21:00.679480507Z [2024-03-21 03:21:00,679: INFO/ForkPoolWorker-15] [610ede32-3bdf-43cb-af14-72460261cbfd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:21:01.138704401Z [2024-03-21 03:21:01,132: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:21:01.164983204Z [2024-03-21 03:21:01,161: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:21:01.243716609Z [2024-03-21 03:21:01,240: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:21:01.335171118Z [2024-03-21 03:21:01,334: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T03:21:01.339941894Z [2024-03-21 03:21:01,339: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:21:01.369823673Z [2024-03-21 03:21:01,369: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:21:01.373104180Z [2024-03-21 03:21:01,372: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:21:01.373287005Z [2024-03-21 03:21:01,373: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:21:01.373418969Z [2024-03-21 03:21:01,373: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T03:21:01.373721035Z [2024-03-21 03:21:01,373: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:21:01.470972078Z [2024-03-21 03:21:01,470: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:21:02.186652640Z [2024-03-21 03:21:02,186: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[140881ae-62a3-494b-88e4-904af7a72709] succeeded in 1.523965713000507s: None
2024-03-21T03:21:02.604035314Z [2024-03-21 03:21:02,603: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:21:02.610083692Z [2024-03-21 03:21:02,607: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:21:02.629417738Z [2024-03-21 03:21:02,629: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:21:02.630755541Z [2024-03-21 03:21:02,630: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:21:02.630791862Z [2024-03-21 03:21:02,630: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:21:02.630924167Z [2024-03-21 03:21:02,630: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:21:02.630967156Z [2024-03-21 03:21:02,630: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:21:02.631430025Z [2024-03-21 03:21:02,631: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:21:02.631476191Z [2024-03-21 03:21:02,631: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:21:02.643404387Z [2024-03-21 03:21:02,643: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:21:02.646875058Z [2024-03-21 03:21:02,646: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:21:02.665492321Z [2024-03-21 03:21:02,665: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:21:02.666770536Z [2024-03-21 03:21:02,666: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:21:02.666787458Z [2024-03-21 03:21:02,666: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:21:02.666956308Z [2024-03-21 03:21:02,666: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:21:02.666973066Z [2024-03-21 03:21:02,666: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:21:02.667236180Z [2024-03-21 03:21:02,667: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:21:02.667372448Z [2024-03-21 03:21:02,667: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:21:02.718890177Z [2024-03-21 03:21:02,715: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:21:02.755460188Z [2024-03-21 03:21:02,755: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:21:04.527328395Z [2024-03-21 03:21:04,526: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[686d4df9-e129-4b1e-98f6-507208734118] succeeded in 3.8580257419998816s: None
2024-03-21T03:21:04.901245517Z [2024-03-21 03:21:04,900: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[610ede32-3bdf-43cb-af14-72460261cbfd] succeeded in 4.239209803999984s: None
2024-03-21T03:22:00.599620908Z [2024-03-21 03:22:00,599: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3b01128-f720-42ae-90bb-ec50613af93a] received
2024-03-21T03:22:00.601667987Z [2024-03-21 03:22:00,601: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a5bec330-b549-4514-81e4-83ffdf085c04] received
2024-03-21T03:22:00.604832020Z [2024-03-21 03:22:00,604: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4796e84-ea56-4c9f-a14e-3c6488c466c9] received
2024-03-21T03:22:00.608393876Z [2024-03-21 03:22:00,608: INFO/ForkPoolWorker-15] [d3b01128-f720-42ae-90bb-ec50613af93a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T03:22:00.608708044Z [2024-03-21 03:22:00,608: INFO/ForkPoolWorker-16] [a5bec330-b549-4514-81e4-83ffdf085c04] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:22:00.609937406Z [2024-03-21 03:22:00,609: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[939870dd-7f74-448b-ade4-a8030f467104] received
2024-03-21T03:22:00.624895859Z [2024-03-21 03:22:00,624: INFO/ForkPoolWorker-1] [d4796e84-ea56-4c9f-a14e-3c6488c466c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:22:00.625171653Z [2024-03-21 03:22:00,624: INFO/ForkPoolWorker-2] [939870dd-7f74-448b-ade4-a8030f467104] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:22:00.926253411Z [2024-03-21 03:22:00,923: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T03:22:00.961009974Z [2024-03-21 03:22:00,957: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:22:01.069858744Z [2024-03-21 03:22:01,066: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:22:01.167669631Z [2024-03-21 03:22:01,164: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:22:01.224756279Z [2024-03-21 03:22:01,224: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T03:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:22:01.372770835Z [2024-03-21 03:22:01,372: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T03:22:01.376924913Z [2024-03-21 03:22:01,376: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:22:01.414699655Z [2024-03-21 03:22:01,414: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:22:01.415835029Z [2024-03-21 03:22:01,415: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:22:01.416022983Z [2024-03-21 03:22:01,415: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:22:01.416156233Z [2024-03-21 03:22:01,415: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T03:22:01.417150973Z [2024-03-21 03:22:01,416: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:22:01.542907346Z [2024-03-21 03:22:01,542: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:22:01.837122879Z [2024-03-21 03:22:01,836: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d3b01128-f720-42ae-90bb-ec50613af93a] succeeded in 1.2337097019990324s: None
2024-03-21T03:22:02.399274349Z [2024-03-21 03:22:02,398: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[939870dd-7f74-448b-ade4-a8030f467104] succeeded in 1.7875830559987662s: None
2024-03-21T03:22:02.490229523Z [2024-03-21 03:22:02,489: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:22:02.493857593Z [2024-03-21 03:22:02,493: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:22:02.514467899Z [2024-03-21 03:22:02,514: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:22:02.515829681Z [2024-03-21 03:22:02,515: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:22:02.515970307Z [2024-03-21 03:22:02,515: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:22:02.516153486Z [2024-03-21 03:22:02,515: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:22:02.516245720Z [2024-03-21 03:22:02,516: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:22:02.516905246Z [2024-03-21 03:22:02,516: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:22:02.517071030Z [2024-03-21 03:22:02,516: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:22:02.601512994Z [2024-03-21 03:22:02,601: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:22:02.652822360Z [2024-03-21 03:22:02,652: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:22:02.655924590Z [2024-03-21 03:22:02,655: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:22:02.689168366Z [2024-03-21 03:22:02,688: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:22:02.692982669Z [2024-03-21 03:22:02,692: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:22:02.693035084Z [2024-03-21 03:22:02,692: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:22:02.693343460Z [2024-03-21 03:22:02,693: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:22:02.693512484Z [2024-03-21 03:22:02,693: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:22:02.693987702Z [2024-03-21 03:22:02,693: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:22:02.694059122Z [2024-03-21 03:22:02,693: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:22:02.801067718Z [2024-03-21 03:22:02,800: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:22:04.509333940Z [2024-03-21 03:22:04,508: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d4796e84-ea56-4c9f-a14e-3c6488c466c9] succeeded in 3.9001598639988515s: None
2024-03-21T03:22:04.646879800Z [2024-03-21 03:22:04,646: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a5bec330-b549-4514-81e4-83ffdf085c04] succeeded in 4.043702934000976s: None
2024-03-21T03:23:00.375465194Z [2024-03-21 03:23:00,375: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e7cbdb8-cc6c-4ba7-b67d-348406ec8d77] received
2024-03-21T03:23:00.377945695Z [2024-03-21 03:23:00,377: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7755ece7-0155-46e8-b419-317b2507985e] received
2024-03-21T03:23:00.379926120Z [2024-03-21 03:23:00,379: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc04f5e1-b8c8-4cbf-b374-f2b8e5ec7b82] received
2024-03-21T03:23:00.382459398Z [2024-03-21 03:23:00,382: INFO/ForkPoolWorker-15] [9e7cbdb8-cc6c-4ba7-b67d-348406ec8d77] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:23:00.389530479Z [2024-03-21 03:23:00,389: INFO/ForkPoolWorker-1] [cc04f5e1-b8c8-4cbf-b374-f2b8e5ec7b82] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:23:00.390081666Z [2024-03-21 03:23:00,389: INFO/ForkPoolWorker-16] [7755ece7-0155-46e8-b419-317b2507985e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:23:00.676670649Z [2024-03-21 03:23:00,673: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:23:00.702392403Z [2024-03-21 03:23:00,699: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:23:00.726101700Z [2024-03-21 03:23:00,722: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:23:00.908976252Z [2024-03-21 03:23:00,908: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T03:23:00.913139825Z [2024-03-21 03:23:00,912: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:23:00.937783647Z [2024-03-21 03:23:00,937: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:23:00.939304285Z [2024-03-21 03:23:00,939: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:23:00.939564575Z [2024-03-21 03:23:00,939: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:23:00.939761610Z [2024-03-21 03:23:00,939: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T03:23:00.940497860Z [2024-03-21 03:23:00,940: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:23:01.061134444Z [2024-03-21 03:23:01,060: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:23:01.697969862Z [2024-03-21 03:23:01,697: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cc04f5e1-b8c8-4cbf-b374-f2b8e5ec7b82] succeeded in 1.3165224410004157s: None
2024-03-21T03:23:01.934738094Z [2024-03-21 03:23:01,934: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:23:01.938993275Z [2024-03-21 03:23:01,938: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:23:01.972614899Z [2024-03-21 03:23:01,972: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:23:01.977046922Z [2024-03-21 03:23:01,976: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:23:01.977473812Z [2024-03-21 03:23:01,977: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:23:01.977783685Z [2024-03-21 03:23:01,977: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:23:01.977800697Z [2024-03-21 03:23:01,977: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:23:01.978225656Z [2024-03-21 03:23:01,978: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:23:01.978239205Z [2024-03-21 03:23:01,978: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:23:02.065632962Z [2024-03-21 03:23:02,065: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:23:02.073022367Z [2024-03-21 03:23:02,072: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:23:02.095983171Z [2024-03-21 03:23:02,095: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:23:02.098112398Z [2024-03-21 03:23:02,097: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:23:02.098793432Z [2024-03-21 03:23:02,098: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:23:02.099041378Z [2024-03-21 03:23:02,098: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:23:02.099318954Z [2024-03-21 03:23:02,099: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:23:02.099534771Z [2024-03-21 03:23:02,099: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:23:02.100170080Z [2024-03-21 03:23:02,099: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:23:02.100485163Z [2024-03-21 03:23:02,100: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:23:02.205957681Z [2024-03-21 03:23:02,205: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:23:03.949385222Z [2024-03-21 03:23:03,948: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9e7cbdb8-cc6c-4ba7-b67d-348406ec8d77] succeeded in 3.572235023999383s: None
2024-03-21T03:23:04.167179001Z [2024-03-21 03:23:04,166: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7755ece7-0155-46e8-b419-317b2507985e] succeeded in 3.7855600920011057s: None
2024-03-21T03:24:01.250051870Z [2024-03-21 03:24:01,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8bdc5a2-8c56-481c-93c9-5dec6942e84e] received
2024-03-21T03:24:01.252977658Z [2024-03-21 03:24:01,252: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9cf16110-3c6d-49bf-a902-bb9deab1dbdc] received
2024-03-21T03:24:01.261215037Z [2024-03-21 03:24:01,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f68637d-919d-41f9-8886-a75cdcacf824] received
2024-03-21T03:24:01.264197164Z [2024-03-21 03:24:01,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72d62f3c-e472-425b-83eb-45687897f076] received
2024-03-21T03:24:01.271761126Z [2024-03-21 03:24:01,271: INFO/ForkPoolWorker-15] [c8bdc5a2-8c56-481c-93c9-5dec6942e84e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T03:24:01.271834763Z [2024-03-21 03:24:01,270: INFO/ForkPoolWorker-16] [9cf16110-3c6d-49bf-a902-bb9deab1dbdc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:24:01.275023911Z [2024-03-21 03:24:01,274: INFO/ForkPoolWorker-1] [9f68637d-919d-41f9-8886-a75cdcacf824] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:24:01.285244012Z [2024-03-21 03:24:01,284: INFO/ForkPoolWorker-2] [72d62f3c-e472-425b-83eb-45687897f076] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:24:01.630760055Z [2024-03-21 03:24:01,626: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:24:01.631833568Z [2024-03-21 03:24:01,628: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T03:24:01.859060469Z [2024-03-21 03:24:01,855: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:24:01.952565145Z [2024-03-21 03:24:01,948: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:24:01.977035276Z [2024-03-21 03:24:01,976: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T03:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:24:02.296486674Z [2024-03-21 03:24:02,291: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T03:24:02.299386994Z [2024-03-21 03:24:02,298: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:24:02.376275621Z [2024-03-21 03:24:02,375: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:24:02.379823079Z [2024-03-21 03:24:02,379: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:24:02.421268126Z [2024-03-21 03:24:02,420: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:24:02.422007957Z [2024-03-21 03:24:02,421: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T03:24:02.422654928Z [2024-03-21 03:24:02,422: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:24:02.582047393Z [2024-03-21 03:24:02,581: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:24:02.755741537Z [2024-03-21 03:24:02,755: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c8bdc5a2-8c56-481c-93c9-5dec6942e84e] succeeded in 1.5005629950010189s: None
2024-03-21T03:24:03.352440959Z [2024-03-21 03:24:03,351: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[72d62f3c-e472-425b-83eb-45687897f076] succeeded in 2.08320500300033s: None
2024-03-21T03:24:03.491555237Z [2024-03-21 03:24:03,491: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:24:03.495340096Z [2024-03-21 03:24:03,494: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:24:03.521414736Z [2024-03-21 03:24:03,521: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:24:03.523501305Z [2024-03-21 03:24:03,523: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:24:03.523517756Z [2024-03-21 03:24:03,523: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:24:03.523743617Z [2024-03-21 03:24:03,523: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:24:03.523945927Z [2024-03-21 03:24:03,523: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:24:03.524539514Z [2024-03-21 03:24:03,524: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:24:03.524720689Z [2024-03-21 03:24:03,524: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:24:03.590967027Z [2024-03-21 03:24:03,590: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:24:03.594586744Z [2024-03-21 03:24:03,594: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:24:03.618292997Z [2024-03-21 03:24:03,618: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:24:03.619863098Z [2024-03-21 03:24:03,619: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:24:03.620155409Z [2024-03-21 03:24:03,619: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:24:03.620491538Z [2024-03-21 03:24:03,620: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:24:03.620707749Z [2024-03-21 03:24:03,620: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:24:03.621309014Z [2024-03-21 03:24:03,620: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:24:03.621484607Z [2024-03-21 03:24:03,621: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:24:03.643654519Z [2024-03-21 03:24:03,643: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:24:03.697327573Z [2024-03-21 03:24:03,697: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:24:05.627537212Z [2024-03-21 03:24:05,626: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9f68637d-919d-41f9-8886-a75cdcacf824] succeeded in 4.363384343001599s: None
2024-03-21T03:24:05.906595322Z [2024-03-21 03:24:05,906: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9cf16110-3c6d-49bf-a902-bb9deab1dbdc] succeeded in 4.651705914999184s: None
2024-03-21T03:25:00.796469532Z [2024-03-21 03:25:00,796: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d73feee-ad5f-48cc-a9f6-7699ac4a84f3] received
2024-03-21T03:25:00.801711748Z [2024-03-21 03:25:00,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a427499f-3bfa-4ce5-8b3f-d71ce0131725] received
2024-03-21T03:25:00.805656312Z [2024-03-21 03:25:00,804: INFO/ForkPoolWorker-15] [5d73feee-ad5f-48cc-a9f6-7699ac4a84f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:25:00.812076300Z [2024-03-21 03:25:00,811: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9aef103d-e93c-41e5-9b83-5e7d46ab9804] received
2024-03-21T03:25:00.821132152Z [2024-03-21 03:25:00,820: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74816e9b-bd16-4982-8f9e-036a148660ad] received
2024-03-21T03:25:00.822195114Z [2024-03-21 03:25:00,821: INFO/ForkPoolWorker-16] [a427499f-3bfa-4ce5-8b3f-d71ce0131725] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:25:00.826828087Z [2024-03-21 03:25:00,826: INFO/ForkPoolWorker-1] [9aef103d-e93c-41e5-9b83-5e7d46ab9804] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:25:00.828686150Z [2024-03-21 03:25:00,828: INFO/ForkPoolWorker-2] [74816e9b-bd16-4982-8f9e-036a148660ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:25:01.162240894Z [2024-03-21 03:25:01,158: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:25:01.239556466Z [2024-03-21 03:25:01,232: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:25:01.296800203Z [2024-03-21 03:25:01,293: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:25:01.330584050Z [2024-03-21 03:25:01,327: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:25:01.412345138Z [2024-03-21 03:25:01,411: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T03:25:01.417455376Z [2024-03-21 03:25:01,416: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:25:01.445784129Z [2024-03-21 03:25:01,445: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:25:01.449258177Z [2024-03-21 03:25:01,448: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:25:01.449395381Z [2024-03-21 03:25:01,449: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:25:01.449468488Z [2024-03-21 03:25:01,449: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T03:25:01.449760675Z [2024-03-21 03:25:01,449: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:25:01.552820372Z [2024-03-21 03:25:01,552: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:25:02.109882529Z [2024-03-21 03:25:02,109: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a427499f-3bfa-4ce5-8b3f-d71ce0131725] succeeded in 1.3023886350001703s: None
2024-03-21T03:25:02.694834295Z [2024-03-21 03:25:02,694: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:25:02.701223636Z [2024-03-21 03:25:02,700: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:25:02.726645339Z [2024-03-21 03:25:02,726: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:25:02.728239119Z [2024-03-21 03:25:02,727: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:25:02.728615188Z [2024-03-21 03:25:02,728: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:25:02.729033471Z [2024-03-21 03:25:02,728: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:25:02.729197657Z [2024-03-21 03:25:02,729: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:25:02.729605010Z [2024-03-21 03:25:02,729: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:25:02.729756526Z [2024-03-21 03:25:02,729: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:25:02.810848259Z [2024-03-21 03:25:02,810: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T03:25:02.816528445Z [2024-03-21 03:25:02,814: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:25:02.832395664Z [2024-03-21 03:25:02,832: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:25:02.842392492Z [2024-03-21 03:25:02,842: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:25:02.844196687Z [2024-03-21 03:25:02,843: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:25:02.844300876Z [2024-03-21 03:25:02,844: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:25:02.844651010Z [2024-03-21 03:25:02,844: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:25:02.844806983Z [2024-03-21 03:25:02,844: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T03:25:02.845261399Z [2024-03-21 03:25:02,845: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:25:02.845403108Z [2024-03-21 03:25:02,845: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:25:02.943370116Z [2024-03-21 03:25:02,943: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:25:03.001270934Z [2024-03-21 03:25:03,000: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:25:03.006690929Z [2024-03-21 03:25:03,006: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:25:03.029366340Z [2024-03-21 03:25:03,029: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:25:03.031150514Z [2024-03-21 03:25:03,030: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:25:03.031165462Z [2024-03-21 03:25:03,031: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:25:03.031421527Z [2024-03-21 03:25:03,031: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:25:03.031432951Z [2024-03-21 03:25:03,031: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:25:03.031681975Z [2024-03-21 03:25:03,031: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:25:03.031731698Z [2024-03-21 03:25:03,031: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:25:03.146722504Z [2024-03-21 03:25:03,146: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T03:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:25:03.882734256Z [2024-03-21 03:25:03,882: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9aef103d-e93c-41e5-9b83-5e7d46ab9804] succeeded in 3.0688593339982617s: None
2024-03-21T03:25:04.521345613Z [2024-03-21 03:25:04,520: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5d73feee-ad5f-48cc-a9f6-7699ac4a84f3] succeeded in 3.722441019001053s: None
2024-03-21T03:25:04.826874551Z [2024-03-21 03:25:04,826: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fdf111c-6371-492b-8531-349baa8ba665] received
2024-03-21T03:25:04.843490388Z [2024-03-21 03:25:04,843: INFO/ForkPoolWorker-15] [9fdf111c-6371-492b-8531-349baa8ba665] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:25:05.003018754Z [2024-03-21 03:25:05,000: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[74816e9b-bd16-4982-8f9e-036a148660ad] succeeded in 4.1772409259992855s: None
2024-03-21T03:25:05.229787399Z [2024-03-21 03:25:05,226: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:25:06.383954523Z [2024-03-21 03:25:06,383: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:25:06.388042514Z [2024-03-21 03:25:06,387: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:25:06.407600000Z [2024-03-21 03:25:06,407: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:25:06.408721206Z [2024-03-21 03:25:06,408: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:25:06.408734899Z [2024-03-21 03:25:06,408: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:25:06.408857695Z [2024-03-21 03:25:06,408: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:25:06.408874019Z [2024-03-21 03:25:06,408: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:25:06.409103708Z [2024-03-21 03:25:06,408: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:25:06.409204210Z [2024-03-21 03:25:06,409: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:25:06.492646017Z [2024-03-21 03:25:06,492: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T03:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:25:07.084392709Z [2024-03-21 03:25:07,083: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9fdf111c-6371-492b-8531-349baa8ba665] succeeded in 2.2539367959998344s: None
2024-03-21T03:25:07.692714807Z [2024-03-21 03:25:07,692: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df45d8e4-ae5f-441d-b975-066503cf8dd9] received
2024-03-21T03:25:07.705118551Z [2024-03-21 03:25:07,703: INFO/ForkPoolWorker-15] [df45d8e4-ae5f-441d-b975-066503cf8dd9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T03:25:07.999221856Z [2024-03-21 03:25:07,996: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:25:09.136401317Z [2024-03-21 03:25:09,136: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:25:09.139915164Z [2024-03-21 03:25:09,139: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:25:09.159426454Z [2024-03-21 03:25:09,159: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:25:09.161299240Z [2024-03-21 03:25:09,161: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:25:09.161423987Z [2024-03-21 03:25:09,161: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:25:09.161561360Z [2024-03-21 03:25:09,161: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:25:09.161617846Z [2024-03-21 03:25:09,161: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:25:09.162068593Z [2024-03-21 03:25:09,161: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:25:09.162184618Z [2024-03-21 03:25:09,162: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:25:09.242265872Z [2024-03-21 03:25:09,241: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T03:20:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:25:10.629301661Z [2024-03-21 03:25:10,628: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[df45d8e4-ae5f-441d-b975-066503cf8dd9] succeeded in 2.9325561900004686s: None
2024-03-21T03:25:11.132019079Z [2024-03-21 03:25:11,130: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cef4fca6-d7b1-4f5c-b81f-ef352a1252da] received
2024-03-21T03:25:11.140710184Z [2024-03-21 03:25:11,139: INFO/ForkPoolWorker-15] [cef4fca6-d7b1-4f5c-b81f-ef352a1252da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:25:11.423913397Z [2024-03-21 03:25:11,420: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:25:12.618426036Z [2024-03-21 03:25:12,617: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:25:12.622746460Z [2024-03-21 03:25:12,622: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:25:12.649104257Z [2024-03-21 03:25:12,648: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:25:12.650814841Z [2024-03-21 03:25:12,650: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:25:12.650831290Z [2024-03-21 03:25:12,650: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:25:12.651014939Z [2024-03-21 03:25:12,650: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:25:12.651089698Z [2024-03-21 03:25:12,650: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:25:12.651476825Z [2024-03-21 03:25:12,651: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:25:12.651544245Z [2024-03-21 03:25:12,651: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:25:12.780145614Z [2024-03-21 03:25:12,779: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T03:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:25:13.466449924Z [2024-03-21 03:25:13,465: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cef4fca6-d7b1-4f5c-b81f-ef352a1252da] succeeded in 2.3327760889987985s: None
2024-03-21T03:26:01.149220584Z [2024-03-21 03:26:01,148: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88cef35d-3faa-4fa9-b6c9-8b520e3cca08] received
2024-03-21T03:26:01.152694260Z [2024-03-21 03:26:01,152: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b5f5cc6-6c62-4e8a-ba26-7866b97882ef] received
2024-03-21T03:26:01.155657059Z [2024-03-21 03:26:01,155: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5df0ef2a-32b7-4ab8-8c31-8c9ca4c22fa8] received
2024-03-21T03:26:01.159465528Z [2024-03-21 03:26:01,159: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7235a79-5491-43d9-9323-031b4a06de30] received
2024-03-21T03:26:01.161367498Z [2024-03-21 03:26:01,160: INFO/ForkPoolWorker-15] [88cef35d-3faa-4fa9-b6c9-8b520e3cca08] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:26:01.163225579Z [2024-03-21 03:26:01,162: INFO/ForkPoolWorker-16] [1b5f5cc6-6c62-4e8a-ba26-7866b97882ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T03:26:01.169698527Z [2024-03-21 03:26:01,169: INFO/ForkPoolWorker-1] [5df0ef2a-32b7-4ab8-8c31-8c9ca4c22fa8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:26:01.177907439Z [2024-03-21 03:26:01,177: INFO/ForkPoolWorker-2] [e7235a79-5491-43d9-9323-031b4a06de30] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:26:01.617548223Z [2024-03-21 03:26:01,613: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:26:01.644883952Z [2024-03-21 03:26:01,628: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:26:01.683643096Z [2024-03-21 03:26:01,680: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:26:01.700347398Z [2024-03-21 03:26:01,696: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T03:26:01.807293549Z [2024-03-21 03:26:01,806: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T03:26:01.811676815Z [2024-03-21 03:26:01,811: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:26:01.847832159Z [2024-03-21 03:26:01,847: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:26:01.850423082Z [2024-03-21 03:26:01,850: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:26:01.850661664Z [2024-03-21 03:26:01,850: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:26:01.850874586Z [2024-03-21 03:26:01,850: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T03:26:01.851177559Z [2024-03-21 03:26:01,851: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:26:01.988258046Z [2024-03-21 03:26:01,987: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:26:02.105248213Z [2024-03-21 03:26:02,104: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T03:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:26:02.890117603Z [2024-03-21 03:26:02,889: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5df0ef2a-32b7-4ab8-8c31-8c9ca4c22fa8] succeeded in 1.7321289630017418s: None
2024-03-21T03:26:02.955574156Z [2024-03-21 03:26:02,955: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1b5f5cc6-6c62-4e8a-ba26-7866b97882ef] succeeded in 1.8004000340006314s: None
2024-03-21T03:26:03.262972602Z [2024-03-21 03:26:03,262: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T03:26:03.266660076Z [2024-03-21 03:26:03,266: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:26:03.290204370Z [2024-03-21 03:26:03,289: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:26:03.292538240Z [2024-03-21 03:26:03,292: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:26:03.292553505Z [2024-03-21 03:26:03,292: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:26:03.292734127Z [2024-03-21 03:26:03,292: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:26:03.292743065Z [2024-03-21 03:26:03,292: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T03:26:03.293168874Z [2024-03-21 03:26:03,292: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:26:03.293182129Z [2024-03-21 03:26:03,293: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:26:03.409830738Z [2024-03-21 03:26:03,409: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:26:03.496929518Z [2024-03-21 03:26:03,496: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:26:03.500412630Z [2024-03-21 03:26:03,499: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:26:03.533064914Z [2024-03-21 03:26:03,532: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:26:03.535500180Z [2024-03-21 03:26:03,535: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:26:03.535575183Z [2024-03-21 03:26:03,535: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:26:03.535805033Z [2024-03-21 03:26:03,535: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:26:03.535973557Z [2024-03-21 03:26:03,535: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:26:03.536378107Z [2024-03-21 03:26:03,536: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:26:03.536459405Z [2024-03-21 03:26:03,536: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:26:03.641958363Z [2024-03-21 03:26:03,641: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:26:05.929918005Z [2024-03-21 03:26:05,929: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e7235a79-5491-43d9-9323-031b4a06de30] succeeded in 4.7663462849995994s: None
2024-03-21T03:26:06.062433125Z [2024-03-21 03:26:06,061: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[88cef35d-3faa-4fa9-b6c9-8b520e3cca08] succeeded in 4.907953605001239s: None
2024-03-21T03:26:56.480522032Z [2024-03-21 03:26:56,480: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9aa959e7-879e-4556-bbaf-9810645e44a1] received
2024-03-21T03:26:56.505006850Z [2024-03-21 03:26:56,504: INFO/ForkPoolWorker-15] [9aa959e7-879e-4556-bbaf-9810645e44a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240321032655_624924', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py']
2024-03-21T03:26:56.798031700Z [2024-03-21 03:26:56,794: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py
2024-03-21T03:26:57.070199726Z [2024-03-21 03:26:57,069: INFO/ForkPoolWorker-15] Running <TaskInstance: vdu_alarm.main_task vdu_alarm_20240321032655_624924 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:26:57.806477802Z [2024-03-21 03:26:57,806: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9aa959e7-879e-4556-bbaf-9810645e44a1] succeeded in 1.3214836310016835s: None
2024-03-21T03:27:00.584405318Z [2024-03-21 03:27:00,584: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b7a26e8-6b6a-403d-813e-45ee0eea2ffa] received
2024-03-21T03:27:00.586845761Z [2024-03-21 03:27:00,586: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7e417a4-d708-4368-a76d-c91287e3fdd8] received
2024-03-21T03:27:00.589965927Z [2024-03-21 03:27:00,589: INFO/ForkPoolWorker-15] [0b7a26e8-6b6a-403d-813e-45ee0eea2ffa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:27:00.592505042Z [2024-03-21 03:27:00,592: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c7cfc03-e5ab-4914-b78c-900526346abd] received
2024-03-21T03:27:00.593989032Z [2024-03-21 03:27:00,593: INFO/ForkPoolWorker-16] [b7e417a4-d708-4368-a76d-c91287e3fdd8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:27:00.605060279Z [2024-03-21 03:27:00,604: INFO/ForkPoolWorker-1] [7c7cfc03-e5ab-4914-b78c-900526346abd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:27:00.908897790Z [2024-03-21 03:27:00,899: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:27:00.933786808Z [2024-03-21 03:27:00,930: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:27:00.965117710Z [2024-03-21 03:27:00,962: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:27:01.170375413Z [2024-03-21 03:27:01,169: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T03:27:01.177813828Z [2024-03-21 03:27:01,177: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:27:01.229193682Z [2024-03-21 03:27:01,228: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:27:01.233063125Z [2024-03-21 03:27:01,232: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:27:01.233191491Z [2024-03-21 03:27:01,232: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:27:01.233268230Z [2024-03-21 03:27:01,233: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T03:27:01.233571937Z [2024-03-21 03:27:01,233: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:27:01.379023829Z [2024-03-21 03:27:01,378: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:27:02.113285784Z [2024-03-21 03:27:02,112: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7c7cfc03-e5ab-4914-b78c-900526346abd] succeeded in 1.5174032559989428s: None
2024-03-21T03:27:02.472689835Z [2024-03-21 03:27:02,472: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:27:02.476210664Z [2024-03-21 03:27:02,475: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:27:02.499996519Z [2024-03-21 03:27:02,499: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:27:02.501835537Z [2024-03-21 03:27:02,501: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:27:02.501872594Z [2024-03-21 03:27:02,501: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:27:02.501940407Z [2024-03-21 03:27:02,501: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:27:02.501963542Z [2024-03-21 03:27:02,501: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:27:02.502317686Z [2024-03-21 03:27:02,502: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:27:02.502385400Z [2024-03-21 03:27:02,502: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:27:02.564843353Z [2024-03-21 03:27:02,564: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:27:02.574986169Z [2024-03-21 03:27:02,574: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:27:02.595388321Z [2024-03-21 03:27:02,594: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:27:02.613280976Z [2024-03-21 03:27:02,613: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:27:02.618753518Z [2024-03-21 03:27:02,618: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:27:02.619129553Z [2024-03-21 03:27:02,618: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:27:02.619474007Z [2024-03-21 03:27:02,619: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:27:02.619761078Z [2024-03-21 03:27:02,619: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:27:02.620448715Z [2024-03-21 03:27:02,620: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:27:02.620646721Z [2024-03-21 03:27:02,620: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:27:02.734781086Z [2024-03-21 03:27:02,734: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:27:04.467523022Z [2024-03-21 03:27:04,467: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b7e417a4-d708-4368-a76d-c91287e3fdd8] succeeded in 3.878482748999886s: None
2024-03-21T03:27:04.685035680Z [2024-03-21 03:27:04,684: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0b7a26e8-6b6a-403d-813e-45ee0eea2ffa] succeeded in 4.0989024190002965s: None
2024-03-21T03:28:00.511943407Z [2024-03-21 03:28:00,511: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c0296cc-3c90-42de-9317-9b21d016386d] received
2024-03-21T03:28:00.516414309Z [2024-03-21 03:28:00,515: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5bb86dbf-e790-4df3-98a5-5c269a7d21e9] received
2024-03-21T03:28:00.524288320Z [2024-03-21 03:28:00,523: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aec343cb-e18b-42e5-afa4-1d7fccae6c63] received
2024-03-21T03:28:00.524655929Z [2024-03-21 03:28:00,524: INFO/ForkPoolWorker-15] [3c0296cc-3c90-42de-9317-9b21d016386d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T03:28:00.528405075Z [2024-03-21 03:28:00,528: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9b9cd17-a190-4af2-821b-d0c30eb7755b] received
2024-03-21T03:28:00.528599913Z [2024-03-21 03:28:00,528: INFO/ForkPoolWorker-16] [5bb86dbf-e790-4df3-98a5-5c269a7d21e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:28:00.541575104Z [2024-03-21 03:28:00,541: INFO/ForkPoolWorker-1] [aec343cb-e18b-42e5-afa4-1d7fccae6c63] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:28:00.542565707Z [2024-03-21 03:28:00,542: INFO/ForkPoolWorker-2] [f9b9cd17-a190-4af2-821b-d0c30eb7755b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:28:00.906490375Z [2024-03-21 03:28:00,894: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:28:00.961438092Z [2024-03-21 03:28:00,949: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:28:00.995103964Z [2024-03-21 03:28:00,986: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:28:00.999076061Z [2024-03-21 03:28:00,996: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T03:28:01.382969498Z [2024-03-21 03:28:01,382: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T03:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:28:01.533713798Z [2024-03-21 03:28:01,533: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T03:28:01.543809988Z [2024-03-21 03:28:01,543: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:28:01.637139899Z [2024-03-21 03:28:01,636: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:28:01.644429576Z [2024-03-21 03:28:01,644: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:28:01.644508413Z [2024-03-21 03:28:01,644: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:28:01.644531701Z [2024-03-21 03:28:01,644: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T03:28:01.644803004Z [2024-03-21 03:28:01,644: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:28:01.755968337Z [2024-03-21 03:28:01,755: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:28:02.563493289Z [2024-03-21 03:28:02,562: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3c0296cc-3c90-42de-9317-9b21d016386d] succeeded in 2.0453219459996035s: None
2024-03-21T03:28:02.839843584Z [2024-03-21 03:28:02,839: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f9b9cd17-a190-4af2-821b-d0c30eb7755b] succeeded in 2.306103301998519s: None
2024-03-21T03:28:03.098240389Z [2024-03-21 03:28:03,097: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:28:03.102432691Z [2024-03-21 03:28:03,101: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:28:03.143774294Z [2024-03-21 03:28:03,143: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:28:03.149423209Z [2024-03-21 03:28:03,149: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:28:03.149451169Z [2024-03-21 03:28:03,149: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:28:03.149554995Z [2024-03-21 03:28:03,149: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:28:03.149630391Z [2024-03-21 03:28:03,149: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:28:03.150258497Z [2024-03-21 03:28:03,150: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:28:03.150675530Z [2024-03-21 03:28:03,150: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:28:03.163705880Z [2024-03-21 03:28:03,163: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:28:03.167361645Z [2024-03-21 03:28:03,166: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:28:03.195141038Z [2024-03-21 03:28:03,194: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:28:03.197295706Z [2024-03-21 03:28:03,196: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:28:03.197500016Z [2024-03-21 03:28:03,197: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:28:03.197710480Z [2024-03-21 03:28:03,197: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:28:03.197817565Z [2024-03-21 03:28:03,197: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:28:03.198154279Z [2024-03-21 03:28:03,198: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:28:03.198247900Z [2024-03-21 03:28:03,198: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:28:03.248037474Z [2024-03-21 03:28:03,247: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:28:03.302123439Z [2024-03-21 03:28:03,301: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:28:05.503176480Z [2024-03-21 03:28:05,502: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5bb86dbf-e790-4df3-98a5-5c269a7d21e9] succeeded in 4.984593777000555s: None
2024-03-21T03:28:05.571121961Z [2024-03-21 03:28:05,570: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aec343cb-e18b-42e5-afa4-1d7fccae6c63] succeeded in 5.04466029499963s: None
2024-03-21T03:29:00.247579657Z [2024-03-21 03:29:00,246: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17fed3fc-b8d1-4271-b778-eb712ce9a596] received
2024-03-21T03:29:00.255913269Z [2024-03-21 03:29:00,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28b9f88c-7a5a-42b1-a63c-07d4b740c48d] received
2024-03-21T03:29:00.259288013Z [2024-03-21 03:29:00,258: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7dec2bf0-2fe9-401d-935d-bbcb54dbdee7] received
2024-03-21T03:29:00.261330169Z [2024-03-21 03:29:00,261: INFO/ForkPoolWorker-15] [17fed3fc-b8d1-4271-b778-eb712ce9a596] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:29:00.272119303Z [2024-03-21 03:29:00,271: INFO/ForkPoolWorker-1] [7dec2bf0-2fe9-401d-935d-bbcb54dbdee7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:29:00.273556796Z [2024-03-21 03:29:00,273: INFO/ForkPoolWorker-16] [28b9f88c-7a5a-42b1-a63c-07d4b740c48d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:29:00.561970271Z [2024-03-21 03:29:00,558: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:29:00.637392929Z [2024-03-21 03:29:00,634: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:29:00.757619860Z [2024-03-21 03:29:00,745: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:29:00.840032076Z [2024-03-21 03:29:00,839: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T03:29:00.849878502Z [2024-03-21 03:29:00,849: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:29:00.897309940Z [2024-03-21 03:29:00,897: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:29:00.900979220Z [2024-03-21 03:29:00,900: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:29:00.902535267Z [2024-03-21 03:29:00,902: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:29:00.902708948Z [2024-03-21 03:29:00,902: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T03:29:00.903025125Z [2024-03-21 03:29:00,902: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:29:01.030597475Z [2024-03-21 03:29:01,030: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:29:01.729409132Z [2024-03-21 03:29:01,729: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7dec2bf0-2fe9-401d-935d-bbcb54dbdee7] succeeded in 1.4671037160005653s: None
2024-03-21T03:29:01.890571410Z [2024-03-21 03:29:01,890: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:29:01.895165927Z [2024-03-21 03:29:01,894: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:29:01.919951844Z [2024-03-21 03:29:01,919: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:29:01.921429876Z [2024-03-21 03:29:01,921: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:29:01.921573159Z [2024-03-21 03:29:01,921: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:29:01.921811310Z [2024-03-21 03:29:01,921: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:29:01.921908151Z [2024-03-21 03:29:01,921: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:29:01.922376360Z [2024-03-21 03:29:01,922: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:29:01.922517715Z [2024-03-21 03:29:01,922: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:29:02.016431183Z [2024-03-21 03:29:02,016: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:29:02.155500241Z [2024-03-21 03:29:02,155: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:29:02.159051371Z [2024-03-21 03:29:02,158: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:29:02.179745876Z [2024-03-21 03:29:02,179: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:29:02.181172571Z [2024-03-21 03:29:02,180: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:29:02.181210915Z [2024-03-21 03:29:02,181: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:29:02.181304092Z [2024-03-21 03:29:02,181: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:29:02.181329322Z [2024-03-21 03:29:02,181: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:29:02.181590163Z [2024-03-21 03:29:02,181: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:29:02.181603028Z [2024-03-21 03:29:02,181: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:29:02.308202985Z [2024-03-21 03:29:02,305: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:29:04.217557847Z [2024-03-21 03:29:04,217: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[17fed3fc-b8d1-4271-b778-eb712ce9a596] succeeded in 3.9662239459994453s: None
2024-03-21T03:29:04.940902829Z [2024-03-21 03:29:04,940: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[28b9f88c-7a5a-42b1-a63c-07d4b740c48d] succeeded in 4.680304164001427s: None
2024-03-21T03:30:01.203471377Z [2024-03-21 03:30:01,203: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02e79663-d70b-40e9-aa5f-3c340b122162] received
2024-03-21T03:30:01.210086814Z [2024-03-21 03:30:01,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f8dcd34-34da-4009-a078-d9e5d1c630cc] received
2024-03-21T03:30:01.212056580Z [2024-03-21 03:30:01,211: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a1f92be-eeb7-4d8e-aba1-bbf7b35f39ea] received
2024-03-21T03:30:01.215091891Z [2024-03-21 03:30:01,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ff1e686-076b-41cb-b1fd-dd8ea57d2a82] received
2024-03-21T03:30:01.217047643Z [2024-03-21 03:30:01,216: INFO/ForkPoolWorker-15] [02e79663-d70b-40e9-aa5f-3c340b122162] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:30:01.222195852Z [2024-03-21 03:30:01,221: INFO/ForkPoolWorker-1] [0a1f92be-eeb7-4d8e-aba1-bbf7b35f39ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T03:30:01.222723113Z [2024-03-21 03:30:01,221: INFO/ForkPoolWorker-16] [3f8dcd34-34da-4009-a078-d9e5d1c630cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:30:01.230290946Z [2024-03-21 03:30:01,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e25da051-78b2-43eb-acf9-09034569392c] received
2024-03-21T03:30:01.245279773Z [2024-03-21 03:30:01,245: INFO/ForkPoolWorker-2] [7ff1e686-076b-41cb-b1fd-dd8ea57d2a82] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:30:01.248099871Z [2024-03-21 03:30:01,247: INFO/ForkPoolWorker-3] [e25da051-78b2-43eb-acf9-09034569392c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:30:01.766026677Z [2024-03-21 03:30:01,762: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:30:01.778122606Z [2024-03-21 03:30:01,774: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:30:01.794344383Z [2024-03-21 03:30:01,785: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T03:30:01.879643553Z [2024-03-21 03:30:01,874: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:30:02.058846184Z [2024-03-21 03:30:02,055: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:30:02.270434225Z [2024-03-21 03:30:02,270: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T03:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:30:02.332698808Z [2024-03-21 03:30:02,329: INFO/ForkPoolWorker-3] Getting SDNC list
2024-03-21T03:30:02.343774322Z [2024-03-21 03:30:02,343: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:30:02.474887792Z [2024-03-21 03:30:02,474: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-03-21T03:30:02.480375859Z [2024-03-21 03:30:02,479: INFO/ForkPoolWorker-3] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:30:02.480412365Z [2024-03-21 03:30:02,480: INFO/ForkPoolWorker-3] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:30:02.480444741Z [2024-03-21 03:30:02,480: INFO/ForkPoolWorker-3] Getting SDNC list OK
2024-03-21T03:30:02.480683635Z [2024-03-21 03:30:02,480: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:30:02.587578503Z [2024-03-21 03:30:02,587: INFO/ForkPoolWorker-3] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:30:03.449068592Z [2024-03-21 03:30:03,448: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0a1f92be-eeb7-4d8e-aba1-bbf7b35f39ea] succeeded in 2.235259256000063s: None
2024-03-21T03:30:03.839587407Z [2024-03-21 03:30:03,839: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[e25da051-78b2-43eb-acf9-09034569392c] succeeded in 2.6062938859995484s: None
2024-03-21T03:30:03.926981069Z [2024-03-21 03:30:03,926: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:30:03.931092747Z [2024-03-21 03:30:03,930: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:30:03.995076484Z [2024-03-21 03:30:03,994: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:30:03.997270342Z [2024-03-21 03:30:03,996: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:30:03.997305397Z [2024-03-21 03:30:03,997: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:30:03.997556177Z [2024-03-21 03:30:03,997: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:30:03.997675246Z [2024-03-21 03:30:03,997: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:30:03.999138208Z [2024-03-21 03:30:03,998: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:30:03.999201896Z [2024-03-21 03:30:03,999: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:30:04.166368502Z [2024-03-21 03:30:04,166: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T03:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:30:04.205484374Z [2024-03-21 03:30:04,205: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T03:30:04.209216881Z [2024-03-21 03:30:04,208: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:30:04.239323662Z [2024-03-21 03:30:04,239: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:30:04.244822990Z [2024-03-21 03:30:04,244: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:30:04.245162764Z [2024-03-21 03:30:04,244: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:30:04.245450381Z [2024-03-21 03:30:04,245: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:30:04.245580409Z [2024-03-21 03:30:04,245: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T03:30:04.245984522Z [2024-03-21 03:30:04,245: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:30:04.246107130Z [2024-03-21 03:30:04,245: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:30:04.343177528Z [2024-03-21 03:30:04,342: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:30:04.472683538Z [2024-03-21 03:30:04,471: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:30:04.479166697Z [2024-03-21 03:30:04,478: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:30:04.538794670Z [2024-03-21 03:30:04,538: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:30:04.540769804Z [2024-03-21 03:30:04,540: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:30:04.540997631Z [2024-03-21 03:30:04,540: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:30:04.541278440Z [2024-03-21 03:30:04,541: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:30:04.548552592Z [2024-03-21 03:30:04,542: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:30:04.548571569Z [2024-03-21 03:30:04,543: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:30:04.548576066Z [2024-03-21 03:30:04,543: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:30:04.712388533Z [2024-03-21 03:30:04,711: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:30:05.022561690Z [2024-03-21 03:30:05,022: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[02e79663-d70b-40e9-aa5f-3c340b122162] succeeded in 3.814005697000539s: None
2024-03-21T03:30:05.665357862Z [2024-03-21 03:30:05,665: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a44a54bd-6ada-4249-847a-f1e577c6915b] received
2024-03-21T03:30:05.674673482Z [2024-03-21 03:30:05,674: INFO/ForkPoolWorker-15] [a44a54bd-6ada-4249-847a-f1e577c6915b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:30:05.955309481Z [2024-03-21 03:30:05,952: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:30:07.058166749Z [2024-03-21 03:30:07,057: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:30:07.061579168Z [2024-03-21 03:30:07,061: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:30:07.080591274Z [2024-03-21 03:30:07,080: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:30:07.082109475Z [2024-03-21 03:30:07,081: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:30:07.082137424Z [2024-03-21 03:30:07,082: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:30:07.082248456Z [2024-03-21 03:30:07,082: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:30:07.082336775Z [2024-03-21 03:30:07,082: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:30:07.082610137Z [2024-03-21 03:30:07,082: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:30:07.082668243Z [2024-03-21 03:30:07,082: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:30:07.170572434Z [2024-03-21 03:30:07,170: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T03:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:30:07.727740639Z [2024-03-21 03:30:07,727: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7ff1e686-076b-41cb-b1fd-dd8ea57d2a82] succeeded in 6.510337319999962s: None
2024-03-21T03:30:07.787859639Z [2024-03-21 03:30:07,787: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a44a54bd-6ada-4249-847a-f1e577c6915b] succeeded in 2.119980272000248s: None
2024-03-21T03:30:08.113244774Z [2024-03-21 03:30:08,112: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d9a218c-3433-4e17-b591-9d17f9d97586] received
2024-03-21T03:30:08.122336839Z [2024-03-21 03:30:08,121: INFO/ForkPoolWorker-15] [2d9a218c-3433-4e17-b591-9d17f9d97586] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T03:30:08.457236723Z [2024-03-21 03:30:08,454: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:30:08.789579324Z [2024-03-21 03:30:08,789: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3f8dcd34-34da-4009-a078-d9e5d1c630cc] succeeded in 7.575814856998477s: None
2024-03-21T03:30:09.678317938Z [2024-03-21 03:30:09,677: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:30:09.681824583Z [2024-03-21 03:30:09,681: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:30:09.729614759Z [2024-03-21 03:30:09,729: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:30:09.731212047Z [2024-03-21 03:30:09,730: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:30:09.731251014Z [2024-03-21 03:30:09,731: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:30:09.731497218Z [2024-03-21 03:30:09,731: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:30:09.731566190Z [2024-03-21 03:30:09,731: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:30:09.732047956Z [2024-03-21 03:30:09,731: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:30:09.732121977Z [2024-03-21 03:30:09,731: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:30:09.879170367Z [2024-03-21 03:30:09,878: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T03:25:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:30:10.434989604Z [2024-03-21 03:30:10,434: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2d9a218c-3433-4e17-b591-9d17f9d97586] succeeded in 2.320129278999957s: None
2024-03-21T03:30:10.691199644Z [2024-03-21 03:30:10,690: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6a62e46-3769-4a76-a5ef-78a71d1c6825] received
2024-03-21T03:30:10.707900997Z [2024-03-21 03:30:10,707: INFO/ForkPoolWorker-15] [a6a62e46-3769-4a76-a5ef-78a71d1c6825] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:30:11.097675156Z [2024-03-21 03:30:11,094: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:30:12.299721132Z [2024-03-21 03:30:12,299: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:30:12.303158679Z [2024-03-21 03:30:12,302: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:30:12.325793228Z [2024-03-21 03:30:12,325: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:30:12.327048379Z [2024-03-21 03:30:12,326: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:30:12.327236479Z [2024-03-21 03:30:12,326: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:30:12.327456069Z [2024-03-21 03:30:12,327: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:30:12.327612372Z [2024-03-21 03:30:12,327: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:30:12.327948144Z [2024-03-21 03:30:12,327: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:30:12.328126383Z [2024-03-21 03:30:12,328: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:30:12.429145939Z [2024-03-21 03:30:12,428: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T03:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:30:12.940949079Z [2024-03-21 03:30:12,940: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a6a62e46-3769-4a76-a5ef-78a71d1c6825] succeeded in 2.2479616700002225s: None
2024-03-21T03:30:55.836336353Z [2024-03-21 03:30:55,836: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05a78046-f0bd-4a91-9f60-a85329221f52] received
2024-03-21T03:30:55.847496839Z [2024-03-21 03:30:55,847: INFO/ForkPoolWorker-15] [05a78046-f0bd-4a91-9f60-a85329221f52] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240321033055_020686', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py']
2024-03-21T03:30:56.204983253Z [2024-03-21 03:30:56,201: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py
2024-03-21T03:30:56.626001148Z [2024-03-21 03:30:56,625: INFO/ForkPoolWorker-15] Running <TaskInstance: vdu_alarm.main_task vdu_alarm_20240321033055_020686 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:30:57.251670305Z [2024-03-21 03:30:57,250: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[05a78046-f0bd-4a91-9f60-a85329221f52] succeeded in 1.409182219998911s: None
2024-03-21T03:31:00.301598434Z [2024-03-21 03:31:00,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d0f53928-d7ce-46fe-9286-8a55b61fc09b] received
2024-03-21T03:31:00.306246045Z [2024-03-21 03:31:00,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[718abd86-6383-4b7d-8fd3-1a9d33fddcbf] received
2024-03-21T03:31:00.313319052Z [2024-03-21 03:31:00,313: INFO/ForkPoolWorker-15] [d0f53928-d7ce-46fe-9286-8a55b61fc09b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:31:00.317907852Z [2024-03-21 03:31:00,317: INFO/ForkPoolWorker-16] [718abd86-6383-4b7d-8fd3-1a9d33fddcbf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:31:00.331719284Z [2024-03-21 03:31:00,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5ef6338-4880-454e-b8c2-3279eefb803f] received
2024-03-21T03:31:00.347864632Z [2024-03-21 03:31:00,347: INFO/ForkPoolWorker-1] [c5ef6338-4880-454e-b8c2-3279eefb803f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:31:00.653420962Z [2024-03-21 03:31:00,647: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:31:00.674438969Z [2024-03-21 03:31:00,670: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:31:00.674531061Z [2024-03-21 03:31:00,670: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:31:00.867718533Z [2024-03-21 03:31:00,867: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T03:31:00.874419467Z [2024-03-21 03:31:00,873: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:31:00.905533847Z [2024-03-21 03:31:00,905: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:31:00.907740835Z [2024-03-21 03:31:00,907: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:31:00.908250416Z [2024-03-21 03:31:00,907: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:31:00.908280315Z [2024-03-21 03:31:00,907: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T03:31:00.909122190Z [2024-03-21 03:31:00,908: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:31:01.060060826Z [2024-03-21 03:31:01,059: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:31:01.851434891Z [2024-03-21 03:31:01,850: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c5ef6338-4880-454e-b8c2-3279eefb803f] succeeded in 1.5139560130010068s: None
2024-03-21T03:31:02.061991627Z [2024-03-21 03:31:02,061: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:31:02.065744750Z [2024-03-21 03:31:02,065: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:31:02.088065160Z [2024-03-21 03:31:02,087: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:31:02.089776497Z [2024-03-21 03:31:02,089: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:31:02.089906709Z [2024-03-21 03:31:02,089: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:31:02.090135596Z [2024-03-21 03:31:02,089: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:31:02.090157742Z [2024-03-21 03:31:02,090: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:31:02.090561426Z [2024-03-21 03:31:02,090: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:31:02.090590673Z [2024-03-21 03:31:02,090: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:31:02.150511660Z [2024-03-21 03:31:02,149: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:31:02.154994150Z [2024-03-21 03:31:02,154: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:31:02.183081260Z [2024-03-21 03:31:02,182: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:31:02.184962234Z [2024-03-21 03:31:02,184: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:31:02.185114953Z [2024-03-21 03:31:02,184: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:31:02.185296925Z [2024-03-21 03:31:02,185: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:31:02.185442205Z [2024-03-21 03:31:02,185: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:31:02.185815588Z [2024-03-21 03:31:02,185: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:31:02.186430756Z [2024-03-21 03:31:02,185: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:31:02.198302879Z [2024-03-21 03:31:02,197: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:31:02.373347906Z [2024-03-21 03:31:02,372: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:31:04.046921317Z [2024-03-21 03:31:04,046: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[718abd86-6383-4b7d-8fd3-1a9d33fddcbf] succeeded in 3.738258990000759s: None
2024-03-21T03:31:04.378375333Z [2024-03-21 03:31:04,377: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d0f53928-d7ce-46fe-9286-8a55b61fc09b] succeeded in 4.072537732001365s: None
2024-03-21T03:32:00.522738144Z [2024-03-21 03:32:00,522: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36d56c7e-68a0-4519-8191-7a7f34f3c714] received
2024-03-21T03:32:00.533008264Z [2024-03-21 03:32:00,532: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03b4f912-cfbe-47bf-b9e4-54a95d1ebaac] received
2024-03-21T03:32:00.533832678Z [2024-03-21 03:32:00,533: INFO/ForkPoolWorker-15] [36d56c7e-68a0-4519-8191-7a7f34f3c714] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T03:32:00.541133246Z [2024-03-21 03:32:00,540: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3b947ca-815b-44c1-acfb-5759ba2c689f] received
2024-03-21T03:32:00.542014309Z [2024-03-21 03:32:00,541: INFO/ForkPoolWorker-16] [03b4f912-cfbe-47bf-b9e4-54a95d1ebaac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:32:00.558440281Z [2024-03-21 03:32:00,558: INFO/ForkPoolWorker-1] [d3b947ca-815b-44c1-acfb-5759ba2c689f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:32:00.563763865Z [2024-03-21 03:32:00,563: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a04a9e18-212a-4aed-abad-00305b02cabe] received
2024-03-21T03:32:00.572893565Z [2024-03-21 03:32:00,572: INFO/ForkPoolWorker-2] [a04a9e18-212a-4aed-abad-00305b02cabe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:32:00.888410207Z [2024-03-21 03:32:00,885: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:32:00.901278899Z [2024-03-21 03:32:00,897: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:32:00.911465085Z [2024-03-21 03:32:00,908: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T03:32:00.979728044Z [2024-03-21 03:32:00,976: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:32:01.154096586Z [2024-03-21 03:32:01,153: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T03:32:01.160581809Z [2024-03-21 03:32:01,160: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:32:01.197279637Z [2024-03-21 03:32:01,197: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:32:01.202222172Z [2024-03-21 03:32:01,201: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:32:01.202313326Z [2024-03-21 03:32:01,202: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:32:01.202413931Z [2024-03-21 03:32:01,202: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T03:32:01.202591627Z [2024-03-21 03:32:01,202: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:32:01.214265238Z [2024-03-21 03:32:01,213: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T03:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:32:01.309300759Z [2024-03-21 03:32:01,309: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:32:01.901443730Z [2024-03-21 03:32:01,898: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[36d56c7e-68a0-4519-8191-7a7f34f3c714] succeeded in 1.3739380049992178s: None
2024-03-21T03:32:01.961568514Z [2024-03-21 03:32:01,961: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d3b947ca-815b-44c1-acfb-5759ba2c689f] succeeded in 1.4146317439990526s: None
2024-03-21T03:32:02.227181279Z [2024-03-21 03:32:02,226: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:32:02.230524864Z [2024-03-21 03:32:02,230: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:32:02.288418186Z [2024-03-21 03:32:02,271: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:32:02.288453834Z [2024-03-21 03:32:02,286: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:32:02.288458624Z [2024-03-21 03:32:02,287: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:32:02.288462761Z [2024-03-21 03:32:02,287: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:32:02.288466985Z [2024-03-21 03:32:02,287: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:32:02.288470313Z [2024-03-21 03:32:02,287: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:32:02.288473570Z [2024-03-21 03:32:02,287: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:32:02.485823670Z [2024-03-21 03:32:02,485: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T03:32:02.494123988Z [2024-03-21 03:32:02,493: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:32:02.497836683Z [2024-03-21 03:32:02,496: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:32:02.528406907Z [2024-03-21 03:32:02,528: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:32:02.529947905Z [2024-03-21 03:32:02,529: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:32:02.530160810Z [2024-03-21 03:32:02,529: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:32:02.530438173Z [2024-03-21 03:32:02,530: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:32:02.530618464Z [2024-03-21 03:32:02,530: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T03:32:02.531121302Z [2024-03-21 03:32:02,530: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:32:02.531316531Z [2024-03-21 03:32:02,531: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:32:02.635977804Z [2024-03-21 03:32:02,635: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:32:04.041202968Z [2024-03-21 03:32:04,040: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[03b4f912-cfbe-47bf-b9e4-54a95d1ebaac] succeeded in 3.5059195550002187s: None
2024-03-21T03:32:04.816706374Z [2024-03-21 03:32:04,816: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a04a9e18-212a-4aed-abad-00305b02cabe] succeeded in 4.25003934400047s: None
2024-03-21T03:33:00.790737135Z [2024-03-21 03:33:00,790: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5591d4ad-a03f-4044-aeb4-05f79e1366a7] received
2024-03-21T03:33:00.800137521Z [2024-03-21 03:33:00,799: INFO/ForkPoolWorker-15] [5591d4ad-a03f-4044-aeb4-05f79e1366a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:33:00.806211048Z [2024-03-21 03:33:00,805: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca4a4cf3-bd55-4519-b57c-1ab5aaad7b44] received
2024-03-21T03:33:00.812441672Z [2024-03-21 03:33:00,812: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0073ebfc-6062-48cc-8d7d-4d67ea9d8ec8] received
2024-03-21T03:33:00.815075976Z [2024-03-21 03:33:00,814: INFO/ForkPoolWorker-16] [ca4a4cf3-bd55-4519-b57c-1ab5aaad7b44] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:33:00.821697716Z [2024-03-21 03:33:00,821: INFO/ForkPoolWorker-1] [0073ebfc-6062-48cc-8d7d-4d67ea9d8ec8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:33:01.202180944Z [2024-03-21 03:33:01,198: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:33:01.223447924Z [2024-03-21 03:33:01,214: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:33:01.339207997Z [2024-03-21 03:33:01,328: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:33:01.453037061Z [2024-03-21 03:33:01,446: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T03:33:01.459988483Z [2024-03-21 03:33:01,459: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:33:01.521851243Z [2024-03-21 03:33:01,521: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:33:01.525866087Z [2024-03-21 03:33:01,525: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:33:01.525925086Z [2024-03-21 03:33:01,525: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:33:01.525931378Z [2024-03-21 03:33:01,525: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T03:33:01.526116510Z [2024-03-21 03:33:01,525: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:33:01.667187962Z [2024-03-21 03:33:01,666: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:33:02.463311446Z [2024-03-21 03:33:02,462: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ca4a4cf3-bd55-4519-b57c-1ab5aaad7b44] succeeded in 1.65538246899996s: None
2024-03-21T03:33:02.771441500Z [2024-03-21 03:33:02,770: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:33:02.775038521Z [2024-03-21 03:33:02,774: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:33:02.802632415Z [2024-03-21 03:33:02,802: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:33:02.804205648Z [2024-03-21 03:33:02,803: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:33:02.804276105Z [2024-03-21 03:33:02,804: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:33:02.804445955Z [2024-03-21 03:33:02,804: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:33:02.804495394Z [2024-03-21 03:33:02,804: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:33:02.804812044Z [2024-03-21 03:33:02,804: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:33:02.804910485Z [2024-03-21 03:33:02,804: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:33:02.924016089Z [2024-03-21 03:33:02,923: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:33:02.927789683Z [2024-03-21 03:33:02,927: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:33:02.945746737Z [2024-03-21 03:33:02,945: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:33:02.954091438Z [2024-03-21 03:33:02,953: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:33:02.956830558Z [2024-03-21 03:33:02,956: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:33:02.956896143Z [2024-03-21 03:33:02,956: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:33:02.957073343Z [2024-03-21 03:33:02,956: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:33:02.957231614Z [2024-03-21 03:33:02,957: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:33:02.957559224Z [2024-03-21 03:33:02,957: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:33:02.957655075Z [2024-03-21 03:33:02,957: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:33:03.078444683Z [2024-03-21 03:33:03,078: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:33:04.588375779Z [2024-03-21 03:33:04,586: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5591d4ad-a03f-4044-aeb4-05f79e1366a7] succeeded in 3.792747049999889s: None
2024-03-21T03:33:05.076233712Z [2024-03-21 03:33:05,075: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0073ebfc-6062-48cc-8d7d-4d67ea9d8ec8] succeeded in 4.259588245999112s: None
2024-03-21T03:34:00.555560823Z [2024-03-21 03:34:00,555: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3c5c931-28bf-4f81-b5fc-d515efdccee2] received
2024-03-21T03:34:00.557872582Z [2024-03-21 03:34:00,557: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8aca16a-b723-49ad-a5b9-f4267ed54562] received
2024-03-21T03:34:00.562568532Z [2024-03-21 03:34:00,562: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33ff200c-995e-4539-b7b1-78218bb94aeb] received
2024-03-21T03:34:00.567352547Z [2024-03-21 03:34:00,567: INFO/ForkPoolWorker-15] [a3c5c931-28bf-4f81-b5fc-d515efdccee2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:34:00.567620975Z [2024-03-21 03:34:00,567: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f90ce9a2-b1c8-41f5-b9e5-96dd9a1c8612] received
2024-03-21T03:34:00.572057978Z [2024-03-21 03:34:00,571: INFO/ForkPoolWorker-16] [e8aca16a-b723-49ad-a5b9-f4267ed54562] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:34:00.578338110Z [2024-03-21 03:34:00,578: INFO/ForkPoolWorker-1] [33ff200c-995e-4539-b7b1-78218bb94aeb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T03:34:00.580493229Z [2024-03-21 03:34:00,580: INFO/ForkPoolWorker-2] [f90ce9a2-b1c8-41f5-b9e5-96dd9a1c8612] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:34:00.949778372Z [2024-03-21 03:34:00,946: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:34:00.950255217Z [2024-03-21 03:34:00,945: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T03:34:01.098160392Z [2024-03-21 03:34:01,092: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:34:01.261922197Z [2024-03-21 03:34:01,253: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:34:01.368862855Z [2024-03-21 03:34:01,368: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T03:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:34:01.453459145Z [2024-03-21 03:34:01,452: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T03:34:01.473233716Z [2024-03-21 03:34:01,458: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:34:01.565910073Z [2024-03-21 03:34:01,565: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:34:01.569417738Z [2024-03-21 03:34:01,569: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:34:01.569626151Z [2024-03-21 03:34:01,569: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:34:01.569743207Z [2024-03-21 03:34:01,569: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T03:34:01.570011965Z [2024-03-21 03:34:01,569: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:34:01.706890486Z [2024-03-21 03:34:01,706: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:34:02.283313417Z [2024-03-21 03:34:02,276: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[33ff200c-995e-4539-b7b1-78218bb94aeb] succeeded in 1.7089515659990866s: None
2024-03-21T03:34:02.615350490Z [2024-03-21 03:34:02,614: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a3c5c931-28bf-4f81-b5fc-d515efdccee2] succeeded in 2.055065589998776s: None
2024-03-21T03:34:02.736124230Z [2024-03-21 03:34:02,735: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T03:34:02.739539120Z [2024-03-21 03:34:02,739: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:34:02.762495365Z [2024-03-21 03:34:02,762: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:34:02.764612789Z [2024-03-21 03:34:02,764: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:34:02.764640464Z [2024-03-21 03:34:02,764: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:34:02.764714373Z [2024-03-21 03:34:02,764: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:34:02.764783694Z [2024-03-21 03:34:02,764: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T03:34:02.765024963Z [2024-03-21 03:34:02,764: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:34:02.765053407Z [2024-03-21 03:34:02,764: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:34:02.844202399Z [2024-03-21 03:34:02,843: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:34:03.242124097Z [2024-03-21 03:34:03,241: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:34:03.245832749Z [2024-03-21 03:34:03,245: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:34:03.284622213Z [2024-03-21 03:34:03,284: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:34:03.286469898Z [2024-03-21 03:34:03,286: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:34:03.286590843Z [2024-03-21 03:34:03,286: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:34:03.286755563Z [2024-03-21 03:34:03,286: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:34:03.286843565Z [2024-03-21 03:34:03,286: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:34:03.287189641Z [2024-03-21 03:34:03,287: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:34:03.287279362Z [2024-03-21 03:34:03,287: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:34:03.405598729Z [2024-03-21 03:34:03,405: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:34:04.888930986Z [2024-03-21 03:34:04,888: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f90ce9a2-b1c8-41f5-b9e5-96dd9a1c8612] succeeded in 4.318687561999468s: None
2024-03-21T03:34:05.937827932Z [2024-03-21 03:34:05,937: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e8aca16a-b723-49ad-a5b9-f4267ed54562] succeeded in 5.376207507999425s: None
2024-03-21T03:35:00.493588147Z [2024-03-21 03:35:00,493: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04f3536f-ea20-400f-b43b-c44c919b9d8a] received
2024-03-21T03:35:00.501666014Z [2024-03-21 03:35:00,501: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c27249e8-1118-48a6-8f55-bd2cf74aa92e] received
2024-03-21T03:35:00.504337789Z [2024-03-21 03:35:00,504: INFO/ForkPoolWorker-15] [04f3536f-ea20-400f-b43b-c44c919b9d8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:35:00.511003948Z [2024-03-21 03:35:00,510: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d026552b-7710-4bb1-9552-a507016eea91] received
2024-03-21T03:35:00.512601439Z [2024-03-21 03:35:00,512: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66b97fb4-ee60-4927-b460-0ec866480343] received
2024-03-21T03:35:00.515410591Z [2024-03-21 03:35:00,515: INFO/ForkPoolWorker-16] [c27249e8-1118-48a6-8f55-bd2cf74aa92e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:35:00.520932404Z [2024-03-21 03:35:00,520: INFO/ForkPoolWorker-1] [d026552b-7710-4bb1-9552-a507016eea91] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:35:00.525463468Z [2024-03-21 03:35:00,525: INFO/ForkPoolWorker-2] [66b97fb4-ee60-4927-b460-0ec866480343] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:35:00.813107384Z [2024-03-21 03:35:00,809: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:35:00.820668955Z [2024-03-21 03:35:00,817: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:35:00.857331423Z [2024-03-21 03:35:00,853: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:35:00.874116402Z [2024-03-21 03:35:00,870: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:35:01.087262134Z [2024-03-21 03:35:01,086: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T03:35:01.092583255Z [2024-03-21 03:35:01,091: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:35:01.125346243Z [2024-03-21 03:35:01,125: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:35:01.129031128Z [2024-03-21 03:35:01,128: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:35:01.129168315Z [2024-03-21 03:35:01,128: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:35:01.129245978Z [2024-03-21 03:35:01,129: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T03:35:01.129669195Z [2024-03-21 03:35:01,129: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:35:01.286822855Z [2024-03-21 03:35:01,286: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:35:02.443849093Z [2024-03-21 03:35:02,443: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d026552b-7710-4bb1-9552-a507016eea91] succeeded in 1.9305093029997806s: None
2024-03-21T03:35:02.545396264Z [2024-03-21 03:35:02,545: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T03:35:02.549675046Z [2024-03-21 03:35:02,549: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:35:02.573981835Z [2024-03-21 03:35:02,573: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:35:02.577564246Z [2024-03-21 03:35:02,577: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:35:02.578186972Z [2024-03-21 03:35:02,577: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:35:02.578473682Z [2024-03-21 03:35:02,578: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:35:02.578605637Z [2024-03-21 03:35:02,578: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T03:35:02.578995436Z [2024-03-21 03:35:02,578: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:35:02.579161947Z [2024-03-21 03:35:02,578: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:35:02.699270507Z [2024-03-21 03:35:02,698: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:35:02.747922801Z [2024-03-21 03:35:02,747: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:35:02.754942720Z [2024-03-21 03:35:02,754: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:35:02.797808849Z [2024-03-21 03:35:02,797: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:35:02.805610541Z [2024-03-21 03:35:02,805: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:35:02.805753283Z [2024-03-21 03:35:02,805: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:35:02.805946020Z [2024-03-21 03:35:02,805: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:35:02.806027823Z [2024-03-21 03:35:02,805: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:35:02.806320634Z [2024-03-21 03:35:02,806: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:35:02.806341124Z [2024-03-21 03:35:02,806: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:35:02.966346602Z [2024-03-21 03:35:02,966: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T03:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:35:02.975590103Z [2024-03-21 03:35:02,975: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:35:02.979197291Z [2024-03-21 03:35:02,978: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:35:03.023440712Z [2024-03-21 03:35:03,023: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:35:03.028408945Z [2024-03-21 03:35:03,028: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:35:03.028435142Z [2024-03-21 03:35:03,028: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:35:03.028499066Z [2024-03-21 03:35:03,028: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:35:03.028506469Z [2024-03-21 03:35:03,028: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:35:03.028810283Z [2024-03-21 03:35:03,028: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:35:03.028870224Z [2024-03-21 03:35:03,028: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:35:03.140487836Z [2024-03-21 03:35:03,140: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:35:03.933375402Z [2024-03-21 03:35:03,932: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[04f3536f-ea20-400f-b43b-c44c919b9d8a] succeeded in 3.43634687300073s: None
2024-03-21T03:35:04.779116731Z [2024-03-21 03:35:04,778: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1723ee2-751b-4afa-bfb7-98c17a9e660d] received
2024-03-21T03:35:04.794738671Z [2024-03-21 03:35:04,794: INFO/ForkPoolWorker-15] [f1723ee2-751b-4afa-bfb7-98c17a9e660d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:35:05.072489315Z [2024-03-21 03:35:05,070: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c27249e8-1118-48a6-8f55-bd2cf74aa92e] succeeded in 4.560452988000179s: None
2024-03-21T03:35:05.299051760Z [2024-03-21 03:35:05,295: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:35:05.304092586Z [2024-03-21 03:35:05,302: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[66b97fb4-ee60-4927-b460-0ec866480343] succeeded in 4.789095007001379s: None
2024-03-21T03:35:06.491864325Z [2024-03-21 03:35:06,491: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:35:06.495241405Z [2024-03-21 03:35:06,494: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:35:06.513280145Z [2024-03-21 03:35:06,513: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:35:06.514479227Z [2024-03-21 03:35:06,514: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:35:06.514595101Z [2024-03-21 03:35:06,514: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:35:06.514771228Z [2024-03-21 03:35:06,514: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:35:06.514978771Z [2024-03-21 03:35:06,514: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:35:06.515238429Z [2024-03-21 03:35:06,515: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:35:06.515413233Z [2024-03-21 03:35:06,515: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:35:06.606508432Z [2024-03-21 03:35:06,606: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T03:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:35:07.234523303Z [2024-03-21 03:35:07,233: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f1723ee2-751b-4afa-bfb7-98c17a9e660d] succeeded in 2.4531957309991412s: None
2024-03-21T03:35:07.415750436Z [2024-03-21 03:35:07,415: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[637b506e-294f-4060-8a22-34ee658c5d3d] received
2024-03-21T03:35:07.423848504Z [2024-03-21 03:35:07,423: INFO/ForkPoolWorker-15] [637b506e-294f-4060-8a22-34ee658c5d3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T03:35:07.708856513Z [2024-03-21 03:35:07,705: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:35:08.893262864Z [2024-03-21 03:35:08,892: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:35:08.896543369Z [2024-03-21 03:35:08,896: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:35:08.922102280Z [2024-03-21 03:35:08,921: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:35:08.923510214Z [2024-03-21 03:35:08,923: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:35:08.923531417Z [2024-03-21 03:35:08,923: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:35:08.923643948Z [2024-03-21 03:35:08,923: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:35:08.923682906Z [2024-03-21 03:35:08,923: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:35:08.923992384Z [2024-03-21 03:35:08,923: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:35:08.924056706Z [2024-03-21 03:35:08,923: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:35:09.015133926Z [2024-03-21 03:35:09,014: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T03:30:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:35:09.576573175Z [2024-03-21 03:35:09,576: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[637b506e-294f-4060-8a22-34ee658c5d3d] succeeded in 2.1583221279997815s: None
2024-03-21T03:35:09.723649396Z [2024-03-21 03:35:09,723: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bebf49e1-b979-46fa-b563-a0229b7f0b75] received
2024-03-21T03:35:09.746704523Z [2024-03-21 03:35:09,746: INFO/ForkPoolWorker-15] [bebf49e1-b979-46fa-b563-a0229b7f0b75] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:35:10.052923898Z [2024-03-21 03:35:10,049: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:35:11.178452331Z [2024-03-21 03:35:11,177: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:35:11.181808819Z [2024-03-21 03:35:11,181: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:35:11.211317617Z [2024-03-21 03:35:11,211: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:35:11.213315415Z [2024-03-21 03:35:11,213: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:35:11.213388838Z [2024-03-21 03:35:11,213: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:35:11.213578302Z [2024-03-21 03:35:11,213: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:35:11.213664177Z [2024-03-21 03:35:11,213: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:35:11.213979546Z [2024-03-21 03:35:11,213: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:35:11.214061777Z [2024-03-21 03:35:11,213: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:35:11.301627445Z [2024-03-21 03:35:11,301: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T03:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:35:11.909081534Z [2024-03-21 03:35:11,908: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bebf49e1-b979-46fa-b563-a0229b7f0b75] succeeded in 2.1839592270007415s: None
2024-03-21T03:36:00.385373075Z [2024-03-21 03:36:00,384: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eab38827-3fd9-48d0-92bc-0191d9db4620] received
2024-03-21T03:36:00.389064279Z [2024-03-21 03:36:00,388: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a20c4a7-61d2-4950-97df-43320c2137d1] received
2024-03-21T03:36:00.402886434Z [2024-03-21 03:36:00,402: INFO/ForkPoolWorker-16] [8a20c4a7-61d2-4950-97df-43320c2137d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:36:00.402925866Z [2024-03-21 03:36:00,402: INFO/ForkPoolWorker-15] [eab38827-3fd9-48d0-92bc-0191d9db4620] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:36:00.404929868Z [2024-03-21 03:36:00,404: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d905473-3acd-4303-8732-b6d8c5b99d86] received
2024-03-21T03:36:00.410990682Z [2024-03-21 03:36:00,410: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da982aee-6fc4-43ac-9509-5ca39f2aae7a] received
2024-03-21T03:36:00.431584623Z [2024-03-21 03:36:00,428: INFO/ForkPoolWorker-1] [1d905473-3acd-4303-8732-b6d8c5b99d86] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T03:36:00.436890370Z [2024-03-21 03:36:00,436: INFO/ForkPoolWorker-2] [da982aee-6fc4-43ac-9509-5ca39f2aae7a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:36:00.740934825Z [2024-03-21 03:36:00,736: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:36:00.838876727Z [2024-03-21 03:36:00,832: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:36:00.885199395Z [2024-03-21 03:36:00,881: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:36:00.886143052Z [2024-03-21 03:36:00,881: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T03:36:01.152004683Z [2024-03-21 03:36:01,151: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T03:36:01.157168779Z [2024-03-21 03:36:01,156: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:36:01.232485799Z [2024-03-21 03:36:01,231: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:36:01.234560556Z [2024-03-21 03:36:01,234: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:36:01.235084338Z [2024-03-21 03:36:01,234: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:36:01.235268111Z [2024-03-21 03:36:01,235: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T03:36:01.235683682Z [2024-03-21 03:36:01,235: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:36:01.508205336Z [2024-03-21 03:36:01,507: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T03:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:36:01.556535124Z [2024-03-21 03:36:01,556: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:36:03.063326959Z [2024-03-21 03:36:03,062: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eab38827-3fd9-48d0-92bc-0191d9db4620] succeeded in 2.6675717900016025s: None
2024-03-21T03:36:03.118833800Z [2024-03-21 03:36:03,118: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1d905473-3acd-4303-8732-b6d8c5b99d86] succeeded in 2.7093512439987535s: None
2024-03-21T03:36:03.326954992Z [2024-03-21 03:36:03,326: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:36:03.330642805Z [2024-03-21 03:36:03,330: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:36:03.367745849Z [2024-03-21 03:36:03,367: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:36:03.372235870Z [2024-03-21 03:36:03,371: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:36:03.372421292Z [2024-03-21 03:36:03,372: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:36:03.373785076Z [2024-03-21 03:36:03,373: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:36:03.373871348Z [2024-03-21 03:36:03,373: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:36:03.374461260Z [2024-03-21 03:36:03,374: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:36:03.374561318Z [2024-03-21 03:36:03,374: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:36:03.473811697Z [2024-03-21 03:36:03,473: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:36:03.548881314Z [2024-03-21 03:36:03,548: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T03:36:03.552776582Z [2024-03-21 03:36:03,552: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:36:03.597207967Z [2024-03-21 03:36:03,596: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:36:03.599389210Z [2024-03-21 03:36:03,599: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:36:03.599621310Z [2024-03-21 03:36:03,599: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:36:03.599850735Z [2024-03-21 03:36:03,599: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:36:03.599938096Z [2024-03-21 03:36:03,599: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T03:36:03.600378484Z [2024-03-21 03:36:03,600: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:36:03.600510575Z [2024-03-21 03:36:03,600: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:36:03.698417672Z [2024-03-21 03:36:03,698: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:36:07.128505845Z [2024-03-21 03:36:07,127: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[da982aee-6fc4-43ac-9509-5ca39f2aae7a] succeeded in 6.714172506999603s: None
2024-03-21T03:36:07.274744328Z [2024-03-21 03:36:07,273: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8a20c4a7-61d2-4950-97df-43320c2137d1] succeeded in 6.880418617000032s: None
2024-03-21T03:37:00.177979534Z [2024-03-21 03:37:00,177: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ef06f8b-c7b0-4e12-8b95-8dd8a6c93834] received
2024-03-21T03:37:00.186286726Z [2024-03-21 03:37:00,185: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d9e4c97-7a72-46d9-80ff-661c6aa605e3] received
2024-03-21T03:37:00.188194645Z [2024-03-21 03:37:00,187: INFO/ForkPoolWorker-15] [5ef06f8b-c7b0-4e12-8b95-8dd8a6c93834] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:37:00.193182651Z [2024-03-21 03:37:00,192: INFO/ForkPoolWorker-16] [4d9e4c97-7a72-46d9-80ff-661c6aa605e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:37:00.195416249Z [2024-03-21 03:37:00,194: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20e891e0-c8c8-45bc-8c50-84c9586d58b0] received
2024-03-21T03:37:00.202619993Z [2024-03-21 03:37:00,202: INFO/ForkPoolWorker-1] [20e891e0-c8c8-45bc-8c50-84c9586d58b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:37:00.511116450Z [2024-03-21 03:37:00,507: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:37:00.522890977Z [2024-03-21 03:37:00,519: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:37:00.582012445Z [2024-03-21 03:37:00,578: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:37:00.697738999Z [2024-03-21 03:37:00,697: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T03:37:00.702849855Z [2024-03-21 03:37:00,702: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:37:00.730890390Z [2024-03-21 03:37:00,730: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:37:00.732304479Z [2024-03-21 03:37:00,732: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:37:00.732591352Z [2024-03-21 03:37:00,732: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:37:00.732825373Z [2024-03-21 03:37:00,732: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T03:37:00.733165639Z [2024-03-21 03:37:00,733: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:37:00.837656009Z [2024-03-21 03:37:00,837: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:37:01.416356419Z [2024-03-21 03:37:01,415: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[20e891e0-c8c8-45bc-8c50-84c9586d58b0] succeeded in 1.218986922998738s: None
2024-03-21T03:37:01.644976114Z [2024-03-21 03:37:01,644: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:37:01.648535977Z [2024-03-21 03:37:01,647: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:37:01.670295637Z [2024-03-21 03:37:01,670: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:37:01.671895574Z [2024-03-21 03:37:01,671: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:37:01.672213220Z [2024-03-21 03:37:01,671: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:37:01.672825659Z [2024-03-21 03:37:01,672: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:37:01.673071719Z [2024-03-21 03:37:01,672: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:37:01.673557517Z [2024-03-21 03:37:01,673: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:37:01.673740079Z [2024-03-21 03:37:01,673: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:37:01.718773354Z [2024-03-21 03:37:01,718: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:37:01.722263410Z [2024-03-21 03:37:01,721: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:37:01.748233768Z [2024-03-21 03:37:01,748: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:37:01.749558616Z [2024-03-21 03:37:01,749: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:37:01.749590710Z [2024-03-21 03:37:01,749: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:37:01.749612112Z [2024-03-21 03:37:01,749: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:37:01.749679418Z [2024-03-21 03:37:01,749: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:37:01.749981520Z [2024-03-21 03:37:01,749: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:37:01.750068065Z [2024-03-21 03:37:01,749: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:37:01.772929632Z [2024-03-21 03:37:01,772: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:37:01.836753966Z [2024-03-21 03:37:01,836: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:37:03.431317140Z [2024-03-21 03:37:03,430: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4d9e4c97-7a72-46d9-80ff-661c6aa605e3] succeeded in 3.2434158949999983s: None
2024-03-21T03:37:03.822808933Z [2024-03-21 03:37:03,822: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5ef06f8b-c7b0-4e12-8b95-8dd8a6c93834] succeeded in 3.642778014000214s: None
2024-03-21T03:38:01.109992009Z [2024-03-21 03:38:01,109: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cd1f116-20d3-4f10-a3e1-18b141d7a21e] received
2024-03-21T03:38:01.113514184Z [2024-03-21 03:38:01,113: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fb1151e-1325-46bd-974d-1abddad844c4] received
2024-03-21T03:38:01.129340386Z [2024-03-21 03:38:01,129: INFO/ForkPoolWorker-15] [4cd1f116-20d3-4f10-a3e1-18b141d7a21e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T03:38:01.130255562Z [2024-03-21 03:38:01,129: INFO/ForkPoolWorker-16] [8fb1151e-1325-46bd-974d-1abddad844c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:38:01.139282407Z [2024-03-21 03:38:01,139: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56d63197-e633-4426-9142-bb0884216a4c] received
2024-03-21T03:38:01.143564514Z [2024-03-21 03:38:01,143: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[073bed1f-1ce2-45d7-a374-459cc5f6a6fa] received
2024-03-21T03:38:01.146448824Z [2024-03-21 03:38:01,146: INFO/ForkPoolWorker-1] [56d63197-e633-4426-9142-bb0884216a4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:38:01.163404551Z [2024-03-21 03:38:01,163: INFO/ForkPoolWorker-2] [073bed1f-1ce2-45d7-a374-459cc5f6a6fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:38:01.480766942Z [2024-03-21 03:38:01,477: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:38:01.524141160Z [2024-03-21 03:38:01,519: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T03:38:01.550499291Z [2024-03-21 03:38:01,543: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:38:01.552264662Z [2024-03-21 03:38:01,539: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:38:01.661231539Z [2024-03-21 03:38:01,660: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T03:38:01.666527725Z [2024-03-21 03:38:01,666: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:38:01.712707309Z [2024-03-21 03:38:01,712: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:38:01.719006083Z [2024-03-21 03:38:01,718: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:38:01.720277915Z [2024-03-21 03:38:01,718: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:38:01.720512472Z [2024-03-21 03:38:01,720: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T03:38:01.720846602Z [2024-03-21 03:38:01,720: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:38:01.846678686Z [2024-03-21 03:38:01,846: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:38:01.874577138Z [2024-03-21 03:38:01,874: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T03:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:38:02.604416402Z [2024-03-21 03:38:02,603: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[073bed1f-1ce2-45d7-a374-459cc5f6a6fa] succeeded in 1.4582752009991964s: None
2024-03-21T03:38:02.758546673Z [2024-03-21 03:38:02,758: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4cd1f116-20d3-4f10-a3e1-18b141d7a21e] succeeded in 1.6402771570010373s: None
2024-03-21T03:38:03.340517791Z [2024-03-21 03:38:03,339: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:38:03.344255509Z [2024-03-21 03:38:03,343: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:38:03.370520096Z [2024-03-21 03:38:03,370: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:38:03.372156007Z [2024-03-21 03:38:03,371: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:38:03.372187914Z [2024-03-21 03:38:03,372: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:38:03.372516152Z [2024-03-21 03:38:03,372: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:38:03.372621300Z [2024-03-21 03:38:03,372: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:38:03.373030317Z [2024-03-21 03:38:03,372: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:38:03.373155282Z [2024-03-21 03:38:03,372: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:38:03.446942095Z [2024-03-21 03:38:03,446: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:38:03.450613473Z [2024-03-21 03:38:03,450: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:38:03.475160491Z [2024-03-21 03:38:03,474: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:38:03.477015251Z [2024-03-21 03:38:03,476: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:38:03.477474658Z [2024-03-21 03:38:03,477: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:38:03.477646759Z [2024-03-21 03:38:03,477: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:38:03.477740919Z [2024-03-21 03:38:03,477: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:38:03.478171362Z [2024-03-21 03:38:03,477: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:38:03.478271773Z [2024-03-21 03:38:03,478: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:38:03.481661833Z [2024-03-21 03:38:03,481: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:38:03.583355312Z [2024-03-21 03:38:03,582: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:38:05.070493301Z [2024-03-21 03:38:05,069: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[56d63197-e633-4426-9142-bb0884216a4c] succeeded in 3.929587688999163s: None
2024-03-21T03:38:06.505462696Z [2024-03-21 03:38:06,504: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8fb1151e-1325-46bd-974d-1abddad844c4] succeeded in 5.387576594001075s: None
2024-03-21T03:39:00.843540522Z [2024-03-21 03:39:00,843: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53d8c301-8756-4ec2-8f1e-ac228188606b] received
2024-03-21T03:39:00.852962265Z [2024-03-21 03:39:00,852: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5047770-bee9-4fbb-b37a-f9f019c1739f] received
2024-03-21T03:39:00.859521337Z [2024-03-21 03:39:00,858: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e04e2ee-41bb-4005-b042-cca8f83acd1e] received
2024-03-21T03:39:00.862914967Z [2024-03-21 03:39:00,862: INFO/ForkPoolWorker-16] [f5047770-bee9-4fbb-b37a-f9f019c1739f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:39:00.869308557Z [2024-03-21 03:39:00,869: INFO/ForkPoolWorker-15] [53d8c301-8756-4ec2-8f1e-ac228188606b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:39:00.872248370Z [2024-03-21 03:39:00,871: INFO/ForkPoolWorker-1] [5e04e2ee-41bb-4005-b042-cca8f83acd1e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:39:01.153235082Z [2024-03-21 03:39:01,150: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:39:01.232501723Z [2024-03-21 03:39:01,225: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:39:01.233501157Z [2024-03-21 03:39:01,230: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:39:01.390613611Z [2024-03-21 03:39:01,390: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T03:39:01.394682972Z [2024-03-21 03:39:01,394: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:39:01.415483461Z [2024-03-21 03:39:01,415: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:39:01.416796752Z [2024-03-21 03:39:01,416: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:39:01.416850927Z [2024-03-21 03:39:01,416: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:39:01.416939665Z [2024-03-21 03:39:01,416: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T03:39:01.417421318Z [2024-03-21 03:39:01,417: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:39:01.508538708Z [2024-03-21 03:39:01,508: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:39:02.375503140Z [2024-03-21 03:39:02,375: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f5047770-bee9-4fbb-b37a-f9f019c1739f] succeeded in 1.5211100159995112s: None
2024-03-21T03:39:02.517438100Z [2024-03-21 03:39:02,516: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:39:02.521146244Z [2024-03-21 03:39:02,520: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:39:02.538054025Z [2024-03-21 03:39:02,537: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:39:02.542001763Z [2024-03-21 03:39:02,541: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:39:02.543703270Z [2024-03-21 03:39:02,543: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:39:02.545249759Z [2024-03-21 03:39:02,545: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:39:02.545365924Z [2024-03-21 03:39:02,545: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:39:02.545552177Z [2024-03-21 03:39:02,545: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:39:02.545653429Z [2024-03-21 03:39:02,545: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:39:02.545984224Z [2024-03-21 03:39:02,545: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:39:02.546105698Z [2024-03-21 03:39:02,545: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:39:02.563218766Z [2024-03-21 03:39:02,562: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:39:02.564704523Z [2024-03-21 03:39:02,564: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:39:02.564910684Z [2024-03-21 03:39:02,564: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:39:02.565105551Z [2024-03-21 03:39:02,564: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:39:02.565334139Z [2024-03-21 03:39:02,565: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:39:02.566160594Z [2024-03-21 03:39:02,565: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:39:02.566279731Z [2024-03-21 03:39:02,566: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:39:02.633141046Z [2024-03-21 03:39:02,632: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:39:02.646302431Z [2024-03-21 03:39:02,646: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:39:04.161548879Z [2024-03-21 03:39:04,161: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5e04e2ee-41bb-4005-b042-cca8f83acd1e] succeeded in 3.3005918899998505s: None
2024-03-21T03:39:04.421425094Z [2024-03-21 03:39:04,420: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[53d8c301-8756-4ec2-8f1e-ac228188606b] succeeded in 3.5670966779998707s: None
2024-03-21T03:40:01.278468825Z [2024-03-21 03:40:01,278: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b74c6560-ae90-4a23-a475-1bac5999be56] received
2024-03-21T03:40:01.282405915Z [2024-03-21 03:40:01,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b6b4499-78ae-4467-99ec-5424bd8fbc3a] received
2024-03-21T03:40:01.291007598Z [2024-03-21 03:40:01,290: INFO/ForkPoolWorker-15] [b74c6560-ae90-4a23-a475-1bac5999be56] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:40:01.301651280Z [2024-03-21 03:40:01,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cdecf0cd-42ba-4542-9d62-34af993b6af4] received
2024-03-21T03:40:01.302857589Z [2024-03-21 03:40:01,302: INFO/ForkPoolWorker-16] [6b6b4499-78ae-4467-99ec-5424bd8fbc3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:40:01.305352834Z [2024-03-21 03:40:01,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b73bd7a-63a8-4538-a9b4-09a8a5d37c7f] received
2024-03-21T03:40:01.310759681Z [2024-03-21 03:40:01,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[545c0ac5-232e-4d60-b41b-c5394fc5b0a1] received
2024-03-21T03:40:01.320496345Z [2024-03-21 03:40:01,320: INFO/ForkPoolWorker-1] [cdecf0cd-42ba-4542-9d62-34af993b6af4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:40:01.325338993Z [2024-03-21 03:40:01,324: INFO/ForkPoolWorker-2] [1b73bd7a-63a8-4538-a9b4-09a8a5d37c7f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:40:01.333431659Z [2024-03-21 03:40:01,333: INFO/ForkPoolWorker-3] [545c0ac5-232e-4d60-b41b-c5394fc5b0a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T03:40:01.753170106Z [2024-03-21 03:40:01,749: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:40:01.925796865Z [2024-03-21 03:40:01,922: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:40:01.955315908Z [2024-03-21 03:40:01,945: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:40:02.075566314Z [2024-03-21 03:40:02,070: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:40:02.147693458Z [2024-03-21 03:40:02,142: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T03:40:02.157837410Z [2024-03-21 03:40:02,157: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T03:40:02.166409853Z [2024-03-21 03:40:02,165: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:40:02.344659481Z [2024-03-21 03:40:02,337: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:40:02.344735060Z [2024-03-21 03:40:02,344: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:40:02.347436958Z [2024-03-21 03:40:02,347: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:40:02.347893894Z [2024-03-21 03:40:02,347: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T03:40:02.348607469Z [2024-03-21 03:40:02,348: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:40:02.590900309Z [2024-03-21 03:40:02,590: INFO/ForkPoolWorker-3] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T03:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:40:02.628225449Z [2024-03-21 03:40:02,627: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:40:03.587482344Z [2024-03-21 03:40:03,586: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[545c0ac5-232e-4d60-b41b-c5394fc5b0a1] succeeded in 2.273748408000756s: None
2024-03-21T03:40:03.608609970Z [2024-03-21 03:40:03,607: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6b6b4499-78ae-4467-99ec-5424bd8fbc3a] succeeded in 2.3173307529996237s: None
2024-03-21T03:40:04.022484111Z [2024-03-21 03:40:04,022: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:40:04.026413750Z [2024-03-21 03:40:04,025: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:40:04.050825749Z [2024-03-21 03:40:04,050: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:40:04.052562230Z [2024-03-21 03:40:04,052: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:40:04.052587243Z [2024-03-21 03:40:04,052: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:40:04.052677542Z [2024-03-21 03:40:04,052: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:40:04.052686308Z [2024-03-21 03:40:04,052: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:40:04.053287384Z [2024-03-21 03:40:04,053: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:40:04.053356488Z [2024-03-21 03:40:04,053: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:40:04.153437899Z [2024-03-21 03:40:04,153: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:40:04.184807301Z [2024-03-21 03:40:04,184: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:40:04.188465087Z [2024-03-21 03:40:04,187: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:40:04.207262696Z [2024-03-21 03:40:04,206: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T03:40:04.211021495Z [2024-03-21 03:40:04,210: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:40:04.217669362Z [2024-03-21 03:40:04,217: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:40:04.222530856Z [2024-03-21 03:40:04,221: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:40:04.222694584Z [2024-03-21 03:40:04,222: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:40:04.223070457Z [2024-03-21 03:40:04,222: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:40:04.223254864Z [2024-03-21 03:40:04,223: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:40:04.224589594Z [2024-03-21 03:40:04,224: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:40:04.224746992Z [2024-03-21 03:40:04,224: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:40:04.236117861Z [2024-03-21 03:40:04,235: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:40:04.238781648Z [2024-03-21 03:40:04,238: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:40:04.238833024Z [2024-03-21 03:40:04,238: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:40:04.238974351Z [2024-03-21 03:40:04,238: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:40:04.239207396Z [2024-03-21 03:40:04,238: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T03:40:04.239652173Z [2024-03-21 03:40:04,239: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:40:04.240389790Z [2024-03-21 03:40:04,240: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:40:04.361380896Z [2024-03-21 03:40:04,361: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T03:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:40:04.377910974Z [2024-03-21 03:40:04,377: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:40:05.131509041Z [2024-03-21 03:40:05,130: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1b73bd7a-63a8-4538-a9b4-09a8a5d37c7f] succeeded in 3.8244089350009745s: None
2024-03-21T03:40:05.983568491Z [2024-03-21 03:40:05,983: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e71afcf-afb9-412f-bce2-49d301b2b499] received
2024-03-21T03:40:05.991771791Z [2024-03-21 03:40:05,991: INFO/ForkPoolWorker-16] [3e71afcf-afb9-412f-bce2-49d301b2b499] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:40:06.270300509Z [2024-03-21 03:40:06,266: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:40:06.388921372Z [2024-03-21 03:40:06,388: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cdecf0cd-42ba-4542-9d62-34af993b6af4] succeeded in 5.085066603000087s: None
2024-03-21T03:40:06.567342622Z [2024-03-21 03:40:06,566: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b74c6560-ae90-4a23-a475-1bac5999be56] succeeded in 5.283373507998476s: None
2024-03-21T03:40:07.514953419Z [2024-03-21 03:40:07,514: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:40:07.519585024Z [2024-03-21 03:40:07,517: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:40:07.542897048Z [2024-03-21 03:40:07,542: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:40:07.544648394Z [2024-03-21 03:40:07,544: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:40:07.544678647Z [2024-03-21 03:40:07,544: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:40:07.544743342Z [2024-03-21 03:40:07,544: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:40:07.544752692Z [2024-03-21 03:40:07,544: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:40:07.544905883Z [2024-03-21 03:40:07,544: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:40:07.545102833Z [2024-03-21 03:40:07,544: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:40:07.654656498Z [2024-03-21 03:40:07,654: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T03:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:40:08.327854186Z [2024-03-21 03:40:08,327: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3e71afcf-afb9-412f-bce2-49d301b2b499] succeeded in 2.342702551999537s: None
2024-03-21T03:40:09.423294399Z [2024-03-21 03:40:09,416: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c0a6945-e461-47c8-ac79-93e12f05ccc1] received
2024-03-21T03:40:09.435171031Z [2024-03-21 03:40:09,434: INFO/ForkPoolWorker-15] [0c0a6945-e461-47c8-ac79-93e12f05ccc1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T03:40:09.827770751Z [2024-03-21 03:40:09,824: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:40:11.018025429Z [2024-03-21 03:40:11,017: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:40:11.021368664Z [2024-03-21 03:40:11,020: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:40:11.047822386Z [2024-03-21 03:40:11,047: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:40:11.050122686Z [2024-03-21 03:40:11,049: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:40:11.050188394Z [2024-03-21 03:40:11,050: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:40:11.050402736Z [2024-03-21 03:40:11,050: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:40:11.050471629Z [2024-03-21 03:40:11,050: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:40:11.050759829Z [2024-03-21 03:40:11,050: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:40:11.050953372Z [2024-03-21 03:40:11,050: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:40:11.146332971Z [2024-03-21 03:40:11,145: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T03:35:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:40:11.742880468Z [2024-03-21 03:40:11,742: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0c0a6945-e461-47c8-ac79-93e12f05ccc1] succeeded in 2.324121040001046s: None
2024-03-21T03:40:11.791888147Z [2024-03-21 03:40:11,791: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d895fd55-0b77-4b8e-9ed0-cb28efaee5c7] received
2024-03-21T03:40:11.801397448Z [2024-03-21 03:40:11,800: INFO/ForkPoolWorker-15] [d895fd55-0b77-4b8e-9ed0-cb28efaee5c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:40:12.083024280Z [2024-03-21 03:40:12,079: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:40:13.229519996Z [2024-03-21 03:40:13,229: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:40:13.233004018Z [2024-03-21 03:40:13,232: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:40:13.255018316Z [2024-03-21 03:40:13,254: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:40:13.256916566Z [2024-03-21 03:40:13,256: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:40:13.256965052Z [2024-03-21 03:40:13,256: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:40:13.256999546Z [2024-03-21 03:40:13,256: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:40:13.257022442Z [2024-03-21 03:40:13,256: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:40:13.257379430Z [2024-03-21 03:40:13,257: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:40:13.257394774Z [2024-03-21 03:40:13,257: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:40:13.349682899Z [2024-03-21 03:40:13,349: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T03:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:40:13.975444969Z [2024-03-21 03:40:13,974: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d895fd55-0b77-4b8e-9ed0-cb28efaee5c7] succeeded in 2.1812005690007936s: None
2024-03-21T03:41:00.294533853Z [2024-03-21 03:41:00,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6157ad57-28b1-49d4-890c-847d2ced3911] received
2024-03-21T03:41:00.298241188Z [2024-03-21 03:41:00,297: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[47f41e7f-e752-4126-9cdb-6ba7d06f1188] received
2024-03-21T03:41:00.302583558Z [2024-03-21 03:41:00,302: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb8c6b34-2f5d-4e0c-b4ce-807d24f54e7c] received
2024-03-21T03:41:00.308049763Z [2024-03-21 03:41:00,307: INFO/ForkPoolWorker-15] [6157ad57-28b1-49d4-890c-847d2ced3911] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:41:00.309286416Z [2024-03-21 03:41:00,307: INFO/ForkPoolWorker-16] [47f41e7f-e752-4126-9cdb-6ba7d06f1188] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:41:00.309938324Z [2024-03-21 03:41:00,309: INFO/ForkPoolWorker-1] [fb8c6b34-2f5d-4e0c-b4ce-807d24f54e7c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:41:00.591713420Z [2024-03-21 03:41:00,587: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:41:00.643131682Z [2024-03-21 03:41:00,639: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:41:00.654683050Z [2024-03-21 03:41:00,650: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:41:00.828629216Z [2024-03-21 03:41:00,828: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T03:41:00.833211388Z [2024-03-21 03:41:00,832: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:41:00.861933248Z [2024-03-21 03:41:00,861: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:41:00.865214158Z [2024-03-21 03:41:00,864: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:41:00.865327094Z [2024-03-21 03:41:00,865: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:41:00.865381048Z [2024-03-21 03:41:00,865: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T03:41:00.865603902Z [2024-03-21 03:41:00,865: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:41:00.962928469Z [2024-03-21 03:41:00,962: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:41:01.746776349Z [2024-03-21 03:41:01,746: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fb8c6b34-2f5d-4e0c-b4ce-807d24f54e7c] succeeded in 1.4417236869994667s: None
2024-03-21T03:41:01.957966302Z [2024-03-21 03:41:01,957: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:41:01.961663010Z [2024-03-21 03:41:01,961: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:41:01.995921975Z [2024-03-21 03:41:01,995: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:41:01.999252142Z [2024-03-21 03:41:01,998: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:41:01.999588535Z [2024-03-21 03:41:01,999: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:41:01.999926438Z [2024-03-21 03:41:01,999: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:41:02.000208252Z [2024-03-21 03:41:01,999: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:41:02.001014303Z [2024-03-21 03:41:02,000: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:41:02.001257423Z [2024-03-21 03:41:02,001: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:41:02.017284469Z [2024-03-21 03:41:02,016: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:41:02.021589395Z [2024-03-21 03:41:02,020: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:41:02.046119312Z [2024-03-21 03:41:02,045: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:41:02.048281929Z [2024-03-21 03:41:02,047: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:41:02.048489660Z [2024-03-21 03:41:02,048: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:41:02.048708302Z [2024-03-21 03:41:02,048: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:41:02.048818371Z [2024-03-21 03:41:02,048: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:41:02.049329537Z [2024-03-21 03:41:02,049: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:41:02.049469134Z [2024-03-21 03:41:02,049: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:41:02.123163222Z [2024-03-21 03:41:02,122: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:41:02.176252602Z [2024-03-21 03:41:02,175: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:41:03.893946583Z [2024-03-21 03:41:03,893: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[47f41e7f-e752-4126-9cdb-6ba7d06f1188] succeeded in 3.5929881269985344s: None
2024-03-21T03:41:04.291291785Z [2024-03-21 03:41:04,290: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6157ad57-28b1-49d4-890c-847d2ced3911] succeeded in 3.991115233999153s: None
2024-03-21T03:42:01.283866746Z [2024-03-21 03:42:01,283: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7909919a-75ef-4c00-a214-0b3d7882e7a6] received
2024-03-21T03:42:01.292001842Z [2024-03-21 03:42:01,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4c45d78-868f-4dd9-99d6-b469c47a311f] received
2024-03-21T03:42:01.295394085Z [2024-03-21 03:42:01,295: INFO/ForkPoolWorker-15] [7909919a-75ef-4c00-a214-0b3d7882e7a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:42:01.296964937Z [2024-03-21 03:42:01,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c932a99-678c-48b5-a14a-1b15ee9baa62] received
2024-03-21T03:42:01.301892438Z [2024-03-21 03:42:01,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[235de045-2b94-4f12-81d7-17793374bfb0] received
2024-03-21T03:42:01.311343737Z [2024-03-21 03:42:01,310: INFO/ForkPoolWorker-16] [e4c45d78-868f-4dd9-99d6-b469c47a311f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:42:01.311365837Z [2024-03-21 03:42:01,311: INFO/ForkPoolWorker-2] [235de045-2b94-4f12-81d7-17793374bfb0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:42:01.324021683Z [2024-03-21 03:42:01,323: INFO/ForkPoolWorker-1] [3c932a99-678c-48b5-a14a-1b15ee9baa62] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T03:42:01.683837149Z [2024-03-21 03:42:01,678: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:42:01.706803859Z [2024-03-21 03:42:01,703: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:42:01.773298829Z [2024-03-21 03:42:01,769: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T03:42:01.782763048Z [2024-03-21 03:42:01,778: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:42:01.879800618Z [2024-03-21 03:42:01,879: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T03:42:01.883864110Z [2024-03-21 03:42:01,883: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:42:01.905681049Z [2024-03-21 03:42:01,905: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:42:01.908135394Z [2024-03-21 03:42:01,907: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:42:01.908395469Z [2024-03-21 03:42:01,908: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:42:01.908528056Z [2024-03-21 03:42:01,908: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T03:42:01.908796263Z [2024-03-21 03:42:01,908: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:42:01.997795496Z [2024-03-21 03:42:01,997: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:42:02.061396384Z [2024-03-21 03:42:02,061: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T03:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:42:02.740724776Z [2024-03-21 03:42:02,740: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7909919a-75ef-4c00-a214-0b3d7882e7a6] succeeded in 1.4542043159999594s: None
2024-03-21T03:42:02.875946364Z [2024-03-21 03:42:02,875: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3c932a99-678c-48b5-a14a-1b15ee9baa62] succeeded in 1.5748335089992906s: None
2024-03-21T03:42:03.287018797Z [2024-03-21 03:42:03,286: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:42:03.290425525Z [2024-03-21 03:42:03,289: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:42:03.315273701Z [2024-03-21 03:42:03,314: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T03:42:03.318274008Z [2024-03-21 03:42:03,317: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:42:03.319476141Z [2024-03-21 03:42:03,319: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:42:03.320928677Z [2024-03-21 03:42:03,320: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:42:03.321448180Z [2024-03-21 03:42:03,321: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:42:03.321717172Z [2024-03-21 03:42:03,321: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:42:03.321859691Z [2024-03-21 03:42:03,321: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:42:03.322281644Z [2024-03-21 03:42:03,322: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:42:03.322467941Z [2024-03-21 03:42:03,322: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:42:03.347305008Z [2024-03-21 03:42:03,346: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:42:03.351271261Z [2024-03-21 03:42:03,350: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:42:03.351528254Z [2024-03-21 03:42:03,351: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:42:03.352097553Z [2024-03-21 03:42:03,351: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:42:03.352629351Z [2024-03-21 03:42:03,352: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T03:42:03.353525324Z [2024-03-21 03:42:03,353: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:42:03.353770576Z [2024-03-21 03:42:03,353: INFO/ForkPoolWorker-2] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:42:03.431823226Z [2024-03-21 03:42:03,431: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:42:03.459847323Z [2024-03-21 03:42:03,459: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:42:05.249701979Z [2024-03-21 03:42:05,248: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[235de045-2b94-4f12-81d7-17793374bfb0] succeeded in 3.944994925001083s: None
2024-03-21T03:42:05.607818571Z [2024-03-21 03:42:05,607: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e4c45d78-868f-4dd9-99d6-b469c47a311f] succeeded in 4.307629727998574s: None
2024-03-21T03:43:01.157532895Z [2024-03-21 03:43:01,157: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f46fdeae-4301-4c80-95de-a22c5478d3da] received
2024-03-21T03:43:01.166266932Z [2024-03-21 03:43:01,165: INFO/ForkPoolWorker-15] [f46fdeae-4301-4c80-95de-a22c5478d3da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:43:01.166726195Z [2024-03-21 03:43:01,166: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[98c1dbd4-13b5-4e55-944b-e71dc32b1959] received
2024-03-21T03:43:01.180463459Z [2024-03-21 03:43:01,179: INFO/ForkPoolWorker-16] [98c1dbd4-13b5-4e55-944b-e71dc32b1959] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:43:01.183570041Z [2024-03-21 03:43:01,183: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af13dbfa-b038-4c58-b240-592b1bab2624] received
2024-03-21T03:43:01.203121127Z [2024-03-21 03:43:01,202: INFO/ForkPoolWorker-1] [af13dbfa-b038-4c58-b240-592b1bab2624] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:43:01.469845805Z [2024-03-21 03:43:01,466: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:43:01.596839875Z [2024-03-21 03:43:01,593: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:43:01.611549747Z [2024-03-21 03:43:01,608: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:43:01.753111935Z [2024-03-21 03:43:01,752: INFO/ForkPoolWorker-16] Getting SDNC list
2024-03-21T03:43:01.757083145Z [2024-03-21 03:43:01,756: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:43:01.783709102Z [2024-03-21 03:43:01,782: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:43:01.783740105Z [2024-03-21 03:43:01,783: INFO/ForkPoolWorker-16] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:43:01.783817431Z [2024-03-21 03:43:01,783: INFO/ForkPoolWorker-16] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:43:01.783894984Z [2024-03-21 03:43:01,783: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-03-21T03:43:01.784126282Z [2024-03-21 03:43:01,784: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:43:01.874690968Z [2024-03-21 03:43:01,874: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:43:02.730958307Z [2024-03-21 03:43:02,730: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[98c1dbd4-13b5-4e55-944b-e71dc32b1959] succeeded in 1.5610187740003312s: None
2024-03-21T03:43:02.883032435Z [2024-03-21 03:43:02,882: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:43:02.889438322Z [2024-03-21 03:43:02,888: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:43:02.925983766Z [2024-03-21 03:43:02,925: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:43:02.929963576Z [2024-03-21 03:43:02,929: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:43:02.930066217Z [2024-03-21 03:43:02,929: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:43:02.930457478Z [2024-03-21 03:43:02,930: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:43:02.930648856Z [2024-03-21 03:43:02,930: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:43:02.931127762Z [2024-03-21 03:43:02,930: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:43:02.931285399Z [2024-03-21 03:43:02,931: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:43:03.048398374Z [2024-03-21 03:43:03,047: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:43:03.095388535Z [2024-03-21 03:43:03,094: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:43:03.098908930Z [2024-03-21 03:43:03,098: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:43:03.120461338Z [2024-03-21 03:43:03,120: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:43:03.122208233Z [2024-03-21 03:43:03,121: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:43:03.122391778Z [2024-03-21 03:43:03,122: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:43:03.122660113Z [2024-03-21 03:43:03,122: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:43:03.122830296Z [2024-03-21 03:43:03,122: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:43:03.123237621Z [2024-03-21 03:43:03,123: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:43:03.123411947Z [2024-03-21 03:43:03,123: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:43:03.240827245Z [2024-03-21 03:43:03,240: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:43:05.452991479Z [2024-03-21 03:43:05,452: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[af13dbfa-b038-4c58-b240-592b1bab2624] succeeded in 4.266766385000665s: None
2024-03-21T03:43:05.537698860Z [2024-03-21 03:43:05,537: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f46fdeae-4301-4c80-95de-a22c5478d3da] succeeded in 4.37746998700095s: None
2024-03-21T03:44:00.933294151Z [2024-03-21 03:44:00,932: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[110f122b-48fa-4146-ac05-ab51a9966a3c] received
2024-03-21T03:44:00.939357006Z [2024-03-21 03:44:00,939: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73a6d48f-543d-46cb-8eb3-832234117b01] received
2024-03-21T03:44:00.950615722Z [2024-03-21 03:44:00,950: INFO/ForkPoolWorker-15] [110f122b-48fa-4146-ac05-ab51a9966a3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:44:00.952529510Z [2024-03-21 03:44:00,952: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fba3aa9f-c66e-4301-81d4-ff1fdafb1840] received
2024-03-21T03:44:00.952669580Z [2024-03-21 03:44:00,951: INFO/ForkPoolWorker-16] [73a6d48f-543d-46cb-8eb3-832234117b01] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T03:44:00.962087002Z [2024-03-21 03:44:00,961: INFO/ForkPoolWorker-1] [fba3aa9f-c66e-4301-81d4-ff1fdafb1840] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:44:01.352165386Z [2024-03-21 03:44:01,347: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:44:01.453099591Z [2024-03-21 03:44:01,448: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T03:44:01.569290271Z [2024-03-21 03:44:01,560: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:44:01.733182078Z [2024-03-21 03:44:01,732: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[758f84af-bf52-4588-8c77-f4959f4f70e8] received
2024-03-21T03:44:01.771536855Z [2024-03-21 03:44:01,771: INFO/ForkPoolWorker-2] [758f84af-bf52-4588-8c77-f4959f4f70e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:44:02.170949045Z [2024-03-21 03:44:02,159: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T03:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:44:02.490764755Z [2024-03-21 03:44:02,473: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:44:02.872490048Z [2024-03-21 03:44:02,871: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T03:44:02.880354973Z [2024-03-21 03:44:02,879: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:44:02.956618939Z [2024-03-21 03:44:02,952: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:44:02.965101587Z [2024-03-21 03:44:02,964: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:44:02.968837870Z [2024-03-21 03:44:02,968: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:44:02.968912238Z [2024-03-21 03:44:02,968: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T03:44:02.969228570Z [2024-03-21 03:44:02,969: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:44:03.161435678Z [2024-03-21 03:44:03,161: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:44:03.519155586Z [2024-03-21 03:44:03,518: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:44:03.525961640Z [2024-03-21 03:44:03,523: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:44:03.601229589Z [2024-03-21 03:44:03,600: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:44:03.603404448Z [2024-03-21 03:44:03,603: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:44:03.603684847Z [2024-03-21 03:44:03,603: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:44:03.604053539Z [2024-03-21 03:44:03,603: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:44:03.604332963Z [2024-03-21 03:44:03,604: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:44:03.604788984Z [2024-03-21 03:44:03,604: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:44:03.605533925Z [2024-03-21 03:44:03,605: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:44:03.612862796Z [2024-03-21 03:44:03,612: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[73a6d48f-543d-46cb-8eb3-832234117b01] succeeded in 2.6661843760011834s: None
2024-03-21T03:44:03.740260215Z [2024-03-21 03:44:03,739: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:44:03.753760758Z [2024-03-21 03:44:03,753: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:44:03.757724981Z [2024-03-21 03:44:03,757: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:44:03.824446187Z [2024-03-21 03:44:03,820: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:44:03.827192427Z [2024-03-21 03:44:03,826: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:44:03.827215477Z [2024-03-21 03:44:03,827: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:44:03.827308911Z [2024-03-21 03:44:03,827: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:44:03.827355866Z [2024-03-21 03:44:03,827: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:44:03.827637791Z [2024-03-21 03:44:03,827: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:44:03.827686564Z [2024-03-21 03:44:03,827: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:44:03.953524936Z [2024-03-21 03:44:03,953: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:44:04.100665312Z [2024-03-21 03:44:04,100: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[758f84af-bf52-4588-8c77-f4959f4f70e8] succeeded in 2.346088628999496s: None
2024-03-21T03:44:07.660854266Z [2024-03-21 03:44:07,659: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[110f122b-48fa-4146-ac05-ab51a9966a3c] succeeded in 6.72292763599944s: None
2024-03-21T03:44:09.015253843Z [2024-03-21 03:44:09,014: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fba3aa9f-c66e-4301-81d4-ff1fdafb1840] succeeded in 8.060977671000728s: None
2024-03-21T03:45:00.570194172Z [2024-03-21 03:45:00,569: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fbb259f8-3220-4254-a026-5ffacd2720fe] received
2024-03-21T03:45:00.573262325Z [2024-03-21 03:45:00,572: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ca3cac4-3f84-4e51-8f32-171719478bc7] received
2024-03-21T03:45:00.585788112Z [2024-03-21 03:45:00,584: INFO/ForkPoolWorker-15] [fbb259f8-3220-4254-a026-5ffacd2720fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:45:00.585815470Z [2024-03-21 03:45:00,584: INFO/ForkPoolWorker-16] [1ca3cac4-3f84-4e51-8f32-171719478bc7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'extract_metrics_from_vnfrs', 'scheduled__2024-03-21T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:45:00.589694264Z [2024-03-21 03:45:00,589: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c99f997f-80cb-4adb-8a1c-7711d0041ec7] received
2024-03-21T03:45:00.592081277Z [2024-03-21 03:45:00,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c5938c8-4929-427e-887f-e11c3659d3cc] received
2024-03-21T03:45:00.602752918Z [2024-03-21 03:45:00,602: INFO/ForkPoolWorker-1] [c99f997f-80cb-4adb-8a1c-7711d0041ec7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:45:00.610042350Z [2024-03-21 03:45:00,609: INFO/ForkPoolWorker-2] [0c5938c8-4929-427e-887f-e11c3659d3cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:45:00.920914635Z [2024-03-21 03:45:00,913: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:45:00.922502201Z [2024-03-21 03:45:00,919: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:45:00.964112927Z [2024-03-21 03:45:00,960: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:45:00.971373708Z [2024-03-21 03:45:00,967: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:45:01.108052660Z [2024-03-21 03:45:01,107: INFO/ForkPoolWorker-15] Getting SDNC list
2024-03-21T03:45:01.112767040Z [2024-03-21 03:45:01,112: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:45:01.178353588Z [2024-03-21 03:45:01,178: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:45:01.181308701Z [2024-03-21 03:45:01,181: INFO/ForkPoolWorker-15] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:45:01.182347368Z [2024-03-21 03:45:01,181: INFO/ForkPoolWorker-15] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:45:01.182477944Z [2024-03-21 03:45:01,182: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-03-21T03:45:01.182759699Z [2024-03-21 03:45:01,182: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:45:01.311368288Z [2024-03-21 03:45:01,311: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:45:02.121107111Z [2024-03-21 03:45:02,120: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fbb259f8-3220-4254-a026-5ffacd2720fe] succeeded in 1.5460666220005805s: None
2024-03-21T03:45:02.500760665Z [2024-03-21 03:45:02,500: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:45:02.504760401Z [2024-03-21 03:45:02,504: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:45:02.541738674Z [2024-03-21 03:45:02,541: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:45:02.544271493Z [2024-03-21 03:45:02,543: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:45:02.544357952Z [2024-03-21 03:45:02,544: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:45:02.544618394Z [2024-03-21 03:45:02,544: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:45:02.544717981Z [2024-03-21 03:45:02,544: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:45:02.545548530Z [2024-03-21 03:45:02,545: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:45:02.545661731Z [2024-03-21 03:45:02,545: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:45:02.679360127Z [2024-03-21 03:45:02,679: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.extract_metrics_from_vnfrs scheduled__2024-03-21T03:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:45:02.820625319Z [2024-03-21 03:45:02,820: INFO/ForkPoolWorker-2] Getting VIM list
2024-03-21T03:45:02.824289722Z [2024-03-21 03:45:02,823: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:45:02.865491912Z [2024-03-21 03:45:02,865: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:45:02.875516751Z [2024-03-21 03:45:02,875: INFO/ForkPoolWorker-2] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:45:02.875659020Z [2024-03-21 03:45:02,875: INFO/ForkPoolWorker-2] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:45:02.876048411Z [2024-03-21 03:45:02,875: INFO/ForkPoolWorker-2] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:45:02.876059777Z [2024-03-21 03:45:02,875: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-03-21T03:45:02.876511284Z [2024-03-21 03:45:02,876: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:45:02.876590712Z [2024-03-21 03:45:02,876: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:45:02.966936878Z [2024-03-21 03:45:02,966: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:45:02.971735675Z [2024-03-21 03:45:02,971: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:45:03.002646498Z [2024-03-21 03:45:03,002: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:45:03.006070010Z [2024-03-21 03:45:03,005: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:45:03.006444536Z [2024-03-21 03:45:03,006: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:45:03.006606920Z [2024-03-21 03:45:03,006: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:45:03.006665127Z [2024-03-21 03:45:03,006: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:45:03.007002460Z [2024-03-21 03:45:03,006: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:45:03.007629076Z [2024-03-21 03:45:03,007: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:45:03.017831380Z [2024-03-21 03:45:03,010: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:45:03.147644470Z [2024-03-21 03:45:03,147: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:45:03.487814918Z [2024-03-21 03:45:03,487: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1ca3cac4-3f84-4e51-8f32-171719478bc7] succeeded in 2.9100368050003453s: None
2024-03-21T03:45:03.708716088Z [2024-03-21 03:45:03,708: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[141c0d6e-30cd-41d9-bfc8-f29015f1267a] received
2024-03-21T03:45:03.715865340Z [2024-03-21 03:45:03,715: INFO/ForkPoolWorker-15] [141c0d6e-30cd-41d9-bfc8-f29015f1267a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'split_metrics', 'scheduled__2024-03-21T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:45:04.032539103Z [2024-03-21 03:45:04,029: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:45:04.825617110Z [2024-03-21 03:45:04,823: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c99f997f-80cb-4adb-8a1c-7711d0041ec7] succeeded in 4.232431166999959s: None
2024-03-21T03:45:05.045812221Z [2024-03-21 03:45:05,045: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0c5938c8-4929-427e-887f-e11c3659d3cc] succeeded in 4.449614535000364s: None
2024-03-21T03:45:05.248250254Z [2024-03-21 03:45:05,247: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:45:05.251811702Z [2024-03-21 03:45:05,251: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:45:05.274765002Z [2024-03-21 03:45:05,274: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:45:05.276178808Z [2024-03-21 03:45:05,275: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:45:05.276206872Z [2024-03-21 03:45:05,276: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:45:05.276487692Z [2024-03-21 03:45:05,276: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:45:05.276605454Z [2024-03-21 03:45:05,276: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:45:05.276914794Z [2024-03-21 03:45:05,276: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:45:05.277044037Z [2024-03-21 03:45:05,276: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:45:05.357908040Z [2024-03-21 03:45:05,357: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.split_metrics scheduled__2024-03-21T03:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:45:05.977799895Z [2024-03-21 03:45:05,977: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fcb690b0-27a2-4964-81d0-387b5e550125] received
2024-03-21T03:45:05.985961613Z [2024-03-21 03:45:05,985: INFO/ForkPoolWorker-16] [fcb690b0-27a2-4964-81d0-387b5e550125] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'collect_metrics', 'scheduled__2024-03-21T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-03-21T03:45:06.109731126Z [2024-03-21 03:45:06,109: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[141c0d6e-30cd-41d9-bfc8-f29015f1267a] succeeded in 2.3993307599994296s: None
2024-03-21T03:45:06.338711283Z [2024-03-21 03:45:06,335: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:45:07.516820853Z [2024-03-21 03:45:07,516: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:45:07.520064792Z [2024-03-21 03:45:07,519: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:45:07.542593247Z [2024-03-21 03:45:07,542: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:45:07.544099948Z [2024-03-21 03:45:07,543: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:45:07.544140877Z [2024-03-21 03:45:07,544: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:45:07.544394814Z [2024-03-21 03:45:07,544: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:45:07.544409108Z [2024-03-21 03:45:07,544: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:45:07.545238300Z [2024-03-21 03:45:07,545: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:45:07.545277218Z [2024-03-21 03:45:07,545: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:45:07.627443545Z [2024-03-21 03:45:07,627: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.collect_metrics scheduled__2024-03-21T03:40:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:45:08.251773161Z [2024-03-21 03:45:08,251: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fcb690b0-27a2-4964-81d0-387b5e550125] succeeded in 2.2714898890008044s: None
2024-03-21T03:45:08.784386154Z [2024-03-21 03:45:08,784: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[873141d3-5053-4055-8c8b-eb429f5f50e7] received
2024-03-21T03:45:08.817861104Z [2024-03-21 03:45:08,817: INFO/ForkPoolWorker-15] [873141d3-5053-4055-8c8b-eb429f5f50e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'send_prometheus', 'scheduled__2024-03-21T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-03-21T03:45:09.106154449Z [2024-03-21 03:45:09,103: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-03-21T03:45:10.362252185Z [2024-03-21 03:45:10,361: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:45:10.365867485Z [2024-03-21 03:45:10,365: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:45:10.383421492Z [2024-03-21 03:45:10,383: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:45:10.389491773Z [2024-03-21 03:45:10,389: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:45:10.389589564Z [2024-03-21 03:45:10,389: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:45:10.389756605Z [2024-03-21 03:45:10,389: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:45:10.389852624Z [2024-03-21 03:45:10,389: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:45:10.390186287Z [2024-03-21 03:45:10,390: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-03-21T03:45:10.390253141Z [2024-03-21 03:45:10,390: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:45:10.488287194Z [2024-03-21 03:45:10,487: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_958b3e11-674a-4c64-9019-1debbee33d6e.send_prometheus scheduled__2024-03-21T03:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:45:11.132491541Z [2024-03-21 03:45:11,131: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[873141d3-5053-4055-8c8b-eb429f5f50e7] succeeded in 2.3463433230008377s: None
2024-03-21T03:46:00.555650128Z [2024-03-21 03:46:00,555: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8f434f7-7624-4e01-97a2-4ce8a1bc4894] received
2024-03-21T03:46:00.561419172Z [2024-03-21 03:46:00,561: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35c248de-4e9f-42c8-a137-683d61ffb291] received
2024-03-21T03:46:00.566775341Z [2024-03-21 03:46:00,566: INFO/ForkPoolWorker-15] [e8f434f7-7624-4e01-97a2-4ce8a1bc4894] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T03:46:00.568851082Z [2024-03-21 03:46:00,568: INFO/ForkPoolWorker-16] [35c248de-4e9f-42c8-a137-683d61ffb291] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:46:00.573506749Z [2024-03-21 03:46:00,573: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbb4e1f0-138a-4984-9eb1-4fc3c2c5a499] received
2024-03-21T03:46:00.577937748Z [2024-03-21 03:46:00,577: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5befe253-080a-4460-bfa5-d213ee58f4d1] received
2024-03-21T03:46:00.585666814Z [2024-03-21 03:46:00,585: INFO/ForkPoolWorker-1] [cbb4e1f0-138a-4984-9eb1-4fc3c2c5a499] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:46:00.586871751Z [2024-03-21 03:46:00,585: INFO/ForkPoolWorker-2] [5befe253-080a-4460-bfa5-d213ee58f4d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:46:00.873916191Z [2024-03-21 03:46:00,870: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T03:46:00.914203091Z [2024-03-21 03:46:00,910: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:46:01.038073313Z [2024-03-21 03:46:01,034: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:46:01.043927361Z [2024-03-21 03:46:01,039: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:46:01.128225481Z [2024-03-21 03:46:01,127: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T03:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:46:01.133947847Z [2024-03-21 03:46:01,133: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T03:46:01.141656702Z [2024-03-21 03:46:01,141: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:46:01.189003903Z [2024-03-21 03:46:01,188: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:46:01.197041185Z [2024-03-21 03:46:01,196: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:46:01.197342265Z [2024-03-21 03:46:01,196: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:46:01.197357333Z [2024-03-21 03:46:01,197: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T03:46:01.199028266Z [2024-03-21 03:46:01,198: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:46:01.352187617Z [2024-03-21 03:46:01,351: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:46:01.836816752Z [2024-03-21 03:46:01,836: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e8f434f7-7624-4e01-97a2-4ce8a1bc4894] succeeded in 1.2791516580000462s: None
2024-03-21T03:46:02.054404260Z [2024-03-21 03:46:02,054: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5befe253-080a-4460-bfa5-d213ee58f4d1] succeeded in 1.4731792629991105s: None
2024-03-21T03:46:02.557172083Z [2024-03-21 03:46:02,556: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:46:02.557384746Z [2024-03-21 03:46:02,556: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:46:02.561462158Z [2024-03-21 03:46:02,560: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:46:02.561900083Z [2024-03-21 03:46:02,560: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:46:02.583367109Z [2024-03-21 03:46:02,583: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:46:02.584748995Z [2024-03-21 03:46:02,584: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:46:02.585170273Z [2024-03-21 03:46:02,584: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:46:02.585363015Z [2024-03-21 03:46:02,585: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:46:02.585616514Z [2024-03-21 03:46:02,585: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:46:02.585787737Z [2024-03-21 03:46:02,585: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:46:02.586146151Z [2024-03-21 03:46:02,585: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:46:02.586171039Z [2024-03-21 03:46:02,585: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:46:02.586339036Z [2024-03-21 03:46:02,586: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:46:02.586469988Z [2024-03-21 03:46:02,586: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:46:02.586535293Z [2024-03-21 03:46:02,586: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:46:02.586651560Z [2024-03-21 03:46:02,586: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:46:02.587059385Z [2024-03-21 03:46:02,586: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:46:02.587192510Z [2024-03-21 03:46:02,587: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:46:02.670308164Z [2024-03-21 03:46:02,670: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:46:02.672716129Z [2024-03-21 03:46:02,672: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:46:04.369242230Z [2024-03-21 03:46:04,368: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[35c248de-4e9f-42c8-a137-683d61ffb291] succeeded in 3.8057013939996978s: None
2024-03-21T03:46:04.895307026Z [2024-03-21 03:46:04,894: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cbb4e1f0-138a-4984-9eb1-4fc3c2c5a499] succeeded in 4.319621225999072s: None
2024-03-21T03:47:00.393520667Z [2024-03-21 03:47:00,393: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d5ae35b-9a55-42b6-b165-13e84897a1cd] received
2024-03-21T03:47:00.409296507Z [2024-03-21 03:47:00,408: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ebc2b657-9b5d-4202-b4d3-6024c765ecfd] received
2024-03-21T03:47:00.410119263Z [2024-03-21 03:47:00,409: INFO/ForkPoolWorker-15] [5d5ae35b-9a55-42b6-b165-13e84897a1cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:47:00.417712274Z [2024-03-21 03:47:00,417: INFO/ForkPoolWorker-16] [ebc2b657-9b5d-4202-b4d3-6024c765ecfd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:47:00.422182603Z [2024-03-21 03:47:00,421: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4e9a724-f069-4e43-9067-4f922a74bb83] received
2024-03-21T03:47:00.432968126Z [2024-03-21 03:47:00,432: INFO/ForkPoolWorker-1] [c4e9a724-f069-4e43-9067-4f922a74bb83] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:47:00.739022873Z [2024-03-21 03:47:00,734: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:47:00.746366030Z [2024-03-21 03:47:00,742: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:47:00.800981296Z [2024-03-21 03:47:00,796: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:47:00.931505869Z [2024-03-21 03:47:00,930: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T03:47:00.935804294Z [2024-03-21 03:47:00,935: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:47:00.963210575Z [2024-03-21 03:47:00,962: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:47:00.964945913Z [2024-03-21 03:47:00,964: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:47:00.965114418Z [2024-03-21 03:47:00,964: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:47:00.965283285Z [2024-03-21 03:47:00,965: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T03:47:00.965690948Z [2024-03-21 03:47:00,965: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:47:01.098238598Z [2024-03-21 03:47:01,097: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:47:01.863931754Z [2024-03-21 03:47:01,863: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c4e9a724-f069-4e43-9067-4f922a74bb83] succeeded in 1.4392611559997022s: None
2024-03-21T03:47:02.144051080Z [2024-03-21 03:47:02,143: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:47:02.148087785Z [2024-03-21 03:47:02,147: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:47:02.169954693Z [2024-03-21 03:47:02,169: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:47:02.172758710Z [2024-03-21 03:47:02,172: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:47:02.172945873Z [2024-03-21 03:47:02,172: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:47:02.173247808Z [2024-03-21 03:47:02,172: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:47:02.173456065Z [2024-03-21 03:47:02,173: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:47:02.173818297Z [2024-03-21 03:47:02,173: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:47:02.173974945Z [2024-03-21 03:47:02,173: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:47:02.270407625Z [2024-03-21 03:47:02,269: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:47:02.274410463Z [2024-03-21 03:47:02,273: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:47:02.312406117Z [2024-03-21 03:47:02,310: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:47:02.339870092Z [2024-03-21 03:47:02,339: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:47:02.345921346Z [2024-03-21 03:47:02,345: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:47:02.345956038Z [2024-03-21 03:47:02,345: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:47:02.345969641Z [2024-03-21 03:47:02,345: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:47:02.345974187Z [2024-03-21 03:47:02,345: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:47:02.346316303Z [2024-03-21 03:47:02,346: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:47:02.346321778Z [2024-03-21 03:47:02,346: INFO/ForkPoolWorker-16] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:47:02.467876779Z [2024-03-21 03:47:02,467: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:47:04.440562670Z [2024-03-21 03:47:04,439: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5d5ae35b-9a55-42b6-b165-13e84897a1cd] succeeded in 4.041158988000461s: None
2024-03-21T03:47:04.468727338Z [2024-03-21 03:47:04,467: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ebc2b657-9b5d-4202-b4d3-6024c765ecfd] succeeded in 4.056832790998669s: None
2024-03-21T03:48:01.243209090Z [2024-03-21 03:48:01,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0eb4907f-d66e-423d-8792-21430dd1f783] received
2024-03-21T03:48:01.252037043Z [2024-03-21 03:48:01,251: INFO/ForkPoolWorker-15] [0eb4907f-d66e-423d-8792-21430dd1f783] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-03-21T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-03-21T03:48:01.254644017Z [2024-03-21 03:48:01,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93c37615-6d3f-4802-a35f-ad019bbb16f8] received
2024-03-21T03:48:01.258454778Z [2024-03-21 03:48:01,258: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f34acf5c-83bb-4e9c-bf71-31c73db0a47a] received
2024-03-21T03:48:01.266530445Z [2024-03-21 03:48:01,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3df6d91a-8564-4e2d-8312-7d137af1fb1f] received
2024-03-21T03:48:01.277421097Z [2024-03-21 03:48:01,277: INFO/ForkPoolWorker-1] [f34acf5c-83bb-4e9c-bf71-31c73db0a47a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:48:01.278182332Z [2024-03-21 03:48:01,277: INFO/ForkPoolWorker-16] [93c37615-6d3f-4802-a35f-ad019bbb16f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:48:01.281760694Z [2024-03-21 03:48:01,281: INFO/ForkPoolWorker-2] [3df6d91a-8564-4e2d-8312-7d137af1fb1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:48:01.621339087Z [2024-03-21 03:48:01,617: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-03-21T03:48:01.656891506Z [2024-03-21 03:48:01,653: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:48:01.680500231Z [2024-03-21 03:48:01,676: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:48:01.691129464Z [2024-03-21 03:48:01,687: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:48:01.890523672Z [2024-03-21 03:48:01,890: INFO/ForkPoolWorker-2] Getting SDNC list
2024-03-21T03:48:01.894961971Z [2024-03-21 03:48:01,894: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:48:01.929751174Z [2024-03-21 03:48:01,929: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-03-21T03:48:01.930871916Z [2024-03-21 03:48:01,930: INFO/ForkPoolWorker-2] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:48:01.931017206Z [2024-03-21 03:48:01,930: INFO/ForkPoolWorker-2] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:48:01.931062879Z [2024-03-21 03:48:01,930: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-03-21T03:48:01.931279063Z [2024-03-21 03:48:01,931: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:48:01.961137340Z [2024-03-21 03:48:01,960: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-03-21T03:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:48:02.055191245Z [2024-03-21 03:48:02,054: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:48:02.819262076Z [2024-03-21 03:48:02,818: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3df6d91a-8564-4e2d-8312-7d137af1fb1f] succeeded in 1.5512641700006498s: None
2024-03-21T03:48:02.915453310Z [2024-03-21 03:48:02,914: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0eb4907f-d66e-423d-8792-21430dd1f783] succeeded in 1.6698769539998466s: None
2024-03-21T03:48:03.330330286Z [2024-03-21 03:48:03,329: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:48:03.333983110Z [2024-03-21 03:48:03,333: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:48:03.357069063Z [2024-03-21 03:48:03,356: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:48:03.359138147Z [2024-03-21 03:48:03,358: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:48:03.359156142Z [2024-03-21 03:48:03,359: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:48:03.359322659Z [2024-03-21 03:48:03,359: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:48:03.359331839Z [2024-03-21 03:48:03,359: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:48:03.359598911Z [2024-03-21 03:48:03,359: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:48:03.359669182Z [2024-03-21 03:48:03,359: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:48:03.414082536Z [2024-03-21 03:48:03,413: INFO/ForkPoolWorker-1] Getting VIM list
2024-03-21T03:48:03.417988520Z [2024-03-21 03:48:03,417: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:48:03.448860273Z [2024-03-21 03:48:03,448: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:48:03.450718128Z [2024-03-21 03:48:03,450: INFO/ForkPoolWorker-1] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:48:03.450871893Z [2024-03-21 03:48:03,450: INFO/ForkPoolWorker-1] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:48:03.451165385Z [2024-03-21 03:48:03,450: INFO/ForkPoolWorker-1] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:48:03.451303256Z [2024-03-21 03:48:03,451: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-03-21T03:48:03.451753709Z [2024-03-21 03:48:03,451: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:48:03.451906281Z [2024-03-21 03:48:03,451: INFO/ForkPoolWorker-1] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:48:03.477687361Z [2024-03-21 03:48:03,477: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:48:03.533697751Z [2024-03-21 03:48:03,533: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:48:05.199664586Z [2024-03-21 03:48:05,199: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f34acf5c-83bb-4e9c-bf71-31c73db0a47a] succeeded in 3.9390859879986238s: None
2024-03-21T03:48:05.552612159Z [2024-03-21 03:48:05,551: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[93c37615-6d3f-4802-a35f-ad019bbb16f8] succeeded in 4.295581220998429s: None
2024-03-21T03:49:00.822067046Z [2024-03-21 03:49:00,821: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80864abe-a704-447a-976f-2c3b2941cbb3] received
2024-03-21T03:49:00.830410640Z [2024-03-21 03:49:00,830: INFO/ForkPoolWorker-15] [80864abe-a704-447a-976f-2c3b2941cbb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-03-21T03:49:00.832710706Z [2024-03-21 03:49:00,832: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1471d95-1a8d-4cda-bafa-d658d9b23153] received
2024-03-21T03:49:00.836738165Z [2024-03-21 03:49:00,836: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3fc0787-29e2-45f9-a6bc-84fb261b71b5] received
2024-03-21T03:49:00.848579129Z [2024-03-21 03:49:00,848: INFO/ForkPoolWorker-16] [b1471d95-1a8d-4cda-bafa-d658d9b23153] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-03-21T03:49:00.855145484Z [2024-03-21 03:49:00,854: INFO/ForkPoolWorker-1] [d3fc0787-29e2-45f9-a6bc-84fb261b71b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-03-21T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-03-21T03:49:01.149693617Z [2024-03-21 03:49:01,146: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-03-21T03:49:01.174229783Z [2024-03-21 03:49:01,170: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-03-21T03:49:01.297738021Z [2024-03-21 03:49:01,294: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-03-21T03:49:01.345413942Z [2024-03-21 03:49:01,344: INFO/ForkPoolWorker-1] Getting SDNC list
2024-03-21T03:49:01.349807869Z [2024-03-21 03:49:01,349: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:49:01.378329738Z [2024-03-21 03:49:01,378: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-03-21T03:49:01.379570118Z [2024-03-21 03:49:01,379: INFO/ForkPoolWorker-1] Read SDNC a4d6cc77-83b4-4c82-95f1-87963f6db731 (sdnc-osm)
2024-03-21T03:49:01.379756118Z [2024-03-21 03:49:01,379: INFO/ForkPoolWorker-1] [{'_id': 'a4d6cc77-83b4-4c82-95f1-87963f6db731', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-03-21T03:49:01.379877228Z [2024-03-21 03:49:01,379: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-03-21T03:49:01.380220610Z [2024-03-21 03:49:01,380: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731
2024-03-21T03:49:01.474532221Z [2024-03-21 03:49:01,474: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_a4d6cc77-83b4-4c82-95f1-87963f6db731.get_sdnc_status_and_send_to_prometheus scheduled__2024-03-21T03:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:49:02.128527877Z [2024-03-21 03:49:02,127: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d3fc0787-29e2-45f9-a6bc-84fb261b71b5] succeeded in 1.2899535150008887s: None
2024-03-21T03:49:02.525694900Z [2024-03-21 03:49:02,525: INFO/ForkPoolWorker-16] Getting VIM list
2024-03-21T03:49:02.529097714Z [2024-03-21 03:49:02,528: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:49:02.554471554Z [2024-03-21 03:49:02,554: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-03-21T03:49:02.556660769Z [2024-03-21 03:49:02,556: INFO/ForkPoolWorker-16] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:49:02.556690479Z [2024-03-21 03:49:02,556: INFO/ForkPoolWorker-16] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:49:02.557002715Z [2024-03-21 03:49:02,556: INFO/ForkPoolWorker-16] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:49:02.557026136Z [2024-03-21 03:49:02,556: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-03-21T03:49:02.557300902Z [2024-03-21 03:49:02,557: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-03-21T03:49:02.557397290Z [2024-03-21 03:49:02,557: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:49:02.572578350Z [2024-03-21 03:49:02,572: INFO/ForkPoolWorker-15] Getting VIM list
2024-03-21T03:49:02.576235147Z [2024-03-21 03:49:02,575: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'iOV0mELfiCa9ZhalSIacMS25O2StdGw3'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-03-21T03:49:02.613767908Z [2024-03-21 03:49:02,613: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-03-21T03:49:02.615404265Z [2024-03-21 03:49:02,615: INFO/ForkPoolWorker-15] Read VIM fc9da8b3-83cb-4e55-bfba-5252c53616d6 (_system-osm-vim)
2024-03-21T03:49:02.615570169Z [2024-03-21 03:49:02,615: INFO/ForkPoolWorker-15] Read VIM 958b3e11-674a-4c64-9019-1debbee33d6e (osm)
2024-03-21T03:49:02.615818688Z [2024-03-21 03:49:02,615: INFO/ForkPoolWorker-15] [{'_id': 'fc9da8b3-83cb-4e55-bfba-5252c53616d6', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '958b3e11-674a-4c64-9019-1debbee33d6e', 'name': 'osm', 'vim_type': 'openstack'}]
2024-03-21T03:49:02.616082244Z [2024-03-21 03:49:02,615: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-03-21T03:49:02.616471215Z [2024-03-21 03:49:02,616: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-03-21T03:49:02.616806192Z [2024-03-21 03:49:02,616: INFO/ForkPoolWorker-15] Creating DAG vim_status_958b3e11-674a-4c64-9019-1debbee33d6e
2024-03-21T03:49:02.688763690Z [2024-03-21 03:49:02,688: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_958b3e11-674a-4c64-9019-1debbee33d6e.get_all_vm_status_and_send_to_prometheus scheduled__2024-03-21T03:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:49:02.713416090Z [2024-03-21 03:49:02,713: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_958b3e11-674a-4c64-9019-1debbee33d6e.get_vim_status_and_send_to_prometheus scheduled__2024-03-21T03:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-03-21T03:49:04.331589777Z [2024-03-21 03:49:04,331: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[80864abe-a704-447a-976f-2c3b2941cbb3] succeeded in 3.507463567000741s: None
2024-03-21T03:49:04.835627471Z [2024-03-21 03:49:04,835: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b1471d95-1a8d-4cda-bafa-d658d9b23153] succeeded in 4.001021406000291s: None
2024-03-20T23:30:27.469915007Z 
2024-03-20T23:30:27.476479548Z Cleaning logs every 900 seconds
2024-03-20T23:30:27.477021049Z Trimming airflow logs to 15 days.
2024-03-20T23:45:00.501297784Z Trimming airflow logs to 15 days.
2024-03-20T23:45:01.540994621Z Trimming airflow logs to 15 days.
2024-03-21T00:00:00.586407465Z Trimming airflow logs to 15 days.
2024-03-21T00:00:01.640495221Z Trimming airflow logs to 15 days.
2024-03-21T00:15:00.691057101Z Trimming airflow logs to 15 days.
2024-03-21T00:15:01.726174057Z Trimming airflow logs to 15 days.
2024-03-21T00:30:00.793071438Z Trimming airflow logs to 15 days.
2024-03-21T00:30:01.861470466Z Trimming airflow logs to 15 days.
2024-03-21T00:45:00.940630007Z Trimming airflow logs to 15 days.
2024-03-21T00:45:01.977300078Z Trimming airflow logs to 15 days.
2024-03-21T01:00:00.041395371Z Trimming airflow logs to 15 days.
2024-03-21T01:00:01.103643811Z Trimming airflow logs to 15 days.
2024-03-21T01:15:00.158939221Z Trimming airflow logs to 15 days.
2024-03-21T01:15:01.224632577Z Trimming airflow logs to 15 days.
2024-03-21T01:30:00.306945270Z Trimming airflow logs to 15 days.
2024-03-21T01:30:01.376586926Z Trimming airflow logs to 15 days.
2024-03-21T01:45:00.464961531Z Trimming airflow logs to 15 days.
2024-03-21T01:45:01.535161738Z Trimming airflow logs to 15 days.
2024-03-21T02:00:00.634411261Z Trimming airflow logs to 15 days.
2024-03-21T02:00:01.726789736Z Trimming airflow logs to 15 days.
2024-03-21T02:15:00.809037107Z Trimming airflow logs to 15 days.
2024-03-21T02:15:01.906988571Z Trimming airflow logs to 15 days.
2024-03-21T02:30:00.017029684Z Trimming airflow logs to 15 days.
2024-03-21T02:30:01.127358473Z Trimming airflow logs to 15 days.
2024-03-21T02:45:00.243165292Z Trimming airflow logs to 15 days.
2024-03-21T02:45:01.344590361Z Trimming airflow logs to 15 days.
2024-03-21T03:00:00.416366573Z Trimming airflow logs to 15 days.
2024-03-21T03:00:01.620508509Z Trimming airflow logs to 15 days.
2024-03-21T03:15:00.752718976Z Trimming airflow logs to 15 days.
2024-03-21T03:15:01.869023408Z Trimming airflow logs to 15 days.
2024-03-21T03:30:00.036204663Z Trimming airflow logs to 15 days.
2024-03-21T03:30:01.133133159Z Trimming airflow logs to 15 days.
2024-03-21T03:45:00.251179035Z Trimming airflow logs to 15 days.
2024-03-21T03:45:01.356688609Z Trimming airflow logs to 15 days.